Apr 11 15:16:43 user nova-compute[71229]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Apr 11 15:16:46 user nova-compute[71229]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=71229) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=71229) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=71229) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 11 15:16:46 user nova-compute[71229]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.021s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:16:46 user nova-compute[71229]: INFO nova.virt.driver [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] Loading compute driver 'libvirt.LibvirtDriver'
Apr 11 15:16:46 user nova-compute[71229]: INFO nova.compute.provider_config [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] Acquiring lock "singleton_lock" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] Acquired lock "singleton_lock" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] Releasing lock "singleton_lock" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] Full set of CONF: {{(pid=71229) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] ******************************************************************************** {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] Configuration options gathered from: {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] ================================================================================ {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] allow_resize_to_same_host      = True {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] arq_binding_timeout            = 300 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] backdoor_port                  = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] backdoor_socket                = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] block_device_allocate_retries  = 300 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] block_device_allocate_retries_interval = 5 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cert                           = self.pem {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] compute_monitors               = [] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] config_dir                     = [] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] config_drive_format            = iso9660 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] config_source                  = [] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] console_host                   = user {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] control_exchange               = nova {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cpu_allocation_ratio           = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] daemon                         = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] debug                          = True {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] default_access_ip_network_name = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] default_availability_zone      = nova {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] default_ephemeral_format       = ext4 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] default_schedule_zone          = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] disk_allocation_ratio          = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] enable_new_services            = True {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] enabled_apis                   = ['osapi_compute'] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] enabled_ssl_apis               = [] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] flat_injected                  = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] force_config_drive             = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] force_raw_images               = True {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] graceful_shutdown_timeout      = 5 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] heal_instance_info_cache_interval = 60 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] host                           = user {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] instance_build_timeout         = 0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] instance_delete_interval       = 300 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] instance_format                = [instance: %(uuid)s]  {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] instance_name_template         = instance-%08x {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] instance_usage_audit           = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] instance_usage_audit_period    = month {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] internal_service_availability_zone = internal {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] key                            = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] live_migration_retry_count     = 30 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] log_config_append              = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] log_dir                        = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] log_file                       = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] log_options                    = True {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] log_rotate_interval            = 1 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] log_rotate_interval_type       = days {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] log_rotation_type              = none {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] long_rpc_timeout               = 1800 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] max_concurrent_builds          = 10 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] max_concurrent_live_migrations = 1 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] max_concurrent_snapshots       = 5 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] max_local_block_devices        = 3 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] max_logfile_count              = 30 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] max_logfile_size_mb            = 200 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] maximum_instance_delete_attempts = 5 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] metadata_listen                = 0.0.0.0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] metadata_listen_port           = 8775 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] metadata_workers               = 3 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] migrate_max_retries            = -1 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] mkisofs_cmd                    = genisoimage {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] my_ip                          = 10.0.0.210 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] network_allocate_retries       = 0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] osapi_compute_listen_port      = 8774 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] osapi_compute_unique_server_name_scope =  {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] osapi_compute_workers          = 3 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] password_length                = 12 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] periodic_enable                = True {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:46 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] periodic_fuzzy_delay           = 60 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] pointer_model                  = ps2mouse {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] preallocate_images             = none {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] publish_errors                 = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] pybasedir                      = /opt/stack/nova {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] ram_allocation_ratio           = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] rate_limit_burst               = 0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] rate_limit_except_level        = CRITICAL {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] rate_limit_interval            = 0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] reboot_timeout                 = 0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] reclaim_instance_interval      = 0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] record                         = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] reimage_timeout_per_gb         = 20 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] report_interval                = 10 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] rescue_timeout                 = 0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] reserved_host_cpus             = 0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] reserved_host_disk_mb          = 0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] reserved_host_memory_mb        = 512 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] reserved_huge_pages            = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] resize_confirm_window          = 0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] resize_fs_using_block_device   = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] resume_guests_state_on_host_boot = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] rpc_response_timeout           = 60 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] run_external_periodic_tasks    = True {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] running_deleted_instance_action = reap {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] running_deleted_instance_poll_interval = 1800 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] running_deleted_instance_timeout = 0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] scheduler_instance_sync_interval = 120 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] service_down_time              = 60 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] servicegroup_driver            = db {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] shelved_offload_time           = 0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] shelved_poll_interval          = 3600 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] shutdown_timeout               = 0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] source_is_ipv6                 = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] ssl_only                       = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] state_path                     = /opt/stack/data/nova {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] sync_power_state_interval      = 600 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] sync_power_state_pool_size     = 1000 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] syslog_log_facility            = LOG_USER {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] tempdir                        = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] timeout_nbd                    = 10 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] transport_url                  = **** {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] update_resources_interval      = 0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] use_cow_images                 = True {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] use_eventlog                   = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] use_journal                    = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] use_json                       = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] use_rootwrap_daemon            = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] use_stderr                     = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] use_syslog                     = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vcpu_pin_set                   = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vif_plugging_is_fatal          = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vif_plugging_timeout           = 0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] virt_mkfs                      = [] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] volume_usage_poll_interval     = 0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] watch_log_file                 = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] web                            = /usr/share/spice-html5 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_concurrency.disable_process_locking = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] api.auth_strategy              = keystone {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] api.compute_link_prefix        = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] api.dhcp_domain                = novalocal {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] api.enable_instance_password   = True {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] api.glance_link_prefix         = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] api.instance_list_per_project_cells = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] api.list_records_by_skipping_down_cells = True {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] api.local_metadata_per_cell    = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] api.max_limit                  = 1000 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] api.metadata_cache_expiration  = 15 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] api.neutron_default_tenant_id  = default {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] api.use_forwarded_for          = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] api.use_neutron_default_nets   = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] api.vendordata_dynamic_targets = [] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] api.vendordata_jsonfile_path   = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cache.backend                  = dogpile.cache.memcached {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cache.backend_argument         = **** {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cache.config_prefix            = cache.oslo {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cache.dead_timeout             = 60.0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cache.debug_cache_backend      = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cache.enable_retry_client      = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cache.enable_socket_keepalive  = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cache.enabled                  = True {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cache.expiration_time          = 600 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cache.hashclient_retry_attempts = 2 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cache.memcache_dead_retry      = 300 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cache.memcache_password        =  {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cache.memcache_pool_maxsize    = 10 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cache.memcache_sasl_enabled    = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cache.memcache_username        =  {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cache.proxies                  = [] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cache.retry_attempts           = 2 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cache.retry_delay              = 0.0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cache.socket_keepalive_count   = 1 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cache.socket_keepalive_idle    = 1 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cache.socket_keepalive_interval = 1 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cache.tls_allowed_ciphers      = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cache.tls_cafile               = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cache.tls_certfile             = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cache.tls_enabled              = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cache.tls_keyfile              = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cinder.auth_section            = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cinder.auth_type               = password {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cinder.cafile                  = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cinder.certfile                = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cinder.collect_timing          = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cinder.cross_az_attach         = True {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cinder.debug                   = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cinder.endpoint_template       = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cinder.http_retries            = 3 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cinder.insecure                = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cinder.keyfile                 = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cinder.os_region_name          = RegionOne {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cinder.split_loggers           = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cinder.timeout                 = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] compute.cpu_dedicated_set      = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] compute.cpu_shared_set         = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] compute.image_type_exclude_list = [] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] compute.max_concurrent_disk_ops = 0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] compute.max_disk_devices_to_attach = -1 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] compute.resource_provider_association_refresh = 300 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] compute.shutdown_retry_interval = 10 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] conductor.workers              = 3 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] console.allowed_origins        = [] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] console.ssl_ciphers            = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] console.ssl_minimum_version    = default {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] consoleauth.token_ttl          = 600 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cyborg.cafile                  = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cyborg.certfile                = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cyborg.collect_timing          = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cyborg.connect_retries         = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cyborg.connect_retry_delay     = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cyborg.endpoint_override       = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cyborg.insecure                = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cyborg.keyfile                 = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cyborg.max_version             = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cyborg.min_version             = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cyborg.region_name             = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cyborg.service_name            = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cyborg.service_type            = accelerator {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cyborg.split_loggers           = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cyborg.status_code_retries     = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cyborg.status_code_retry_delay = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cyborg.timeout                 = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] cyborg.version                 = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] database.backend               = sqlalchemy {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] database.connection            = **** {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] database.connection_debug      = 0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] database.connection_parameters =  {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] database.connection_recycle_time = 3600 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] database.connection_trace      = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] database.db_inc_retry_interval = True {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] database.db_max_retries        = 20 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] database.db_max_retry_interval = 10 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] database.db_retry_interval     = 1 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] database.max_overflow          = 50 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] database.max_pool_size         = 5 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] database.max_retries           = 10 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] database.mysql_enable_ndb      = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] database.mysql_wsrep_sync_wait = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] database.pool_timeout          = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] database.retry_interval        = 10 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] database.slave_connection      = **** {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] database.sqlite_synchronous    = True {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] api_database.backend           = sqlalchemy {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] api_database.connection        = **** {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] api_database.connection_debug  = 0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] api_database.connection_parameters =  {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] api_database.connection_recycle_time = 3600 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] api_database.connection_trace  = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] api_database.db_inc_retry_interval = True {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] api_database.db_max_retries    = 20 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] api_database.db_max_retry_interval = 10 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] api_database.db_retry_interval = 1 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] api_database.max_overflow      = 50 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] api_database.max_pool_size     = 5 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] api_database.max_retries       = 10 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] api_database.mysql_enable_ndb  = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] api_database.pool_timeout      = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] api_database.retry_interval    = 10 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] api_database.slave_connection  = **** {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] api_database.sqlite_synchronous = True {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] devices.enabled_mdev_types     = [] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] ephemeral_storage_encryption.enabled = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] glance.api_servers             = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] glance.cafile                  = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] glance.certfile                = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] glance.collect_timing          = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] glance.connect_retries         = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] glance.connect_retry_delay     = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] glance.debug                   = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] glance.default_trusted_certificate_ids = [] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] glance.enable_certificate_validation = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] glance.enable_rbd_download     = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] glance.endpoint_override       = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] glance.insecure                = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] glance.keyfile                 = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] glance.max_version             = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] glance.min_version             = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] glance.num_retries             = 3 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] glance.rbd_ceph_conf           =  {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] glance.rbd_connect_timeout     = 5 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] glance.rbd_pool                =  {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] glance.rbd_user                =  {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] glance.region_name             = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] glance.service_name            = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] glance.service_type            = image {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] glance.split_loggers           = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] glance.status_code_retries     = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] glance.status_code_retry_delay = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] glance.timeout                 = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] glance.verify_glance_signatures = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] glance.version                 = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] guestfs.debug                  = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] hyperv.config_drive_cdrom      = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] hyperv.config_drive_inject_password = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] hyperv.enable_instance_metrics_collection = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] hyperv.enable_remotefx         = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] hyperv.instances_path_share    =  {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] hyperv.iscsi_initiator_list    = [] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] hyperv.limit_cpu_features      = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] hyperv.power_state_check_timeframe = 60 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] hyperv.use_multipath_io        = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] hyperv.volume_attach_retry_count = 10 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] hyperv.vswitch_name            = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] mks.enabled                    = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] image_cache.manager_interval   = 2400 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] image_cache.precache_concurrency = 1 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] image_cache.remove_unused_base_images = True {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] image_cache.subdirectory_name  = _base {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] ironic.api_max_retries         = 60 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] ironic.api_retry_interval      = 2 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] ironic.auth_section            = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] ironic.auth_type               = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] ironic.cafile                  = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] ironic.certfile                = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] ironic.collect_timing          = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] ironic.connect_retries         = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] ironic.connect_retry_delay     = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] ironic.endpoint_override       = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] ironic.insecure                = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] ironic.keyfile                 = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] ironic.max_version             = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] ironic.min_version             = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] ironic.partition_key           = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] ironic.peer_list               = [] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] ironic.region_name             = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] ironic.serial_console_state_timeout = 10 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] ironic.service_name            = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] ironic.service_type            = baremetal {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] ironic.split_loggers           = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] ironic.status_code_retries     = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] ironic.status_code_retry_delay = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] ironic.timeout                 = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] ironic.version                 = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] key_manager.fixed_key          = **** {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] barbican.barbican_api_version  = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] barbican.barbican_endpoint     = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] barbican.barbican_endpoint_type = public {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] barbican.barbican_region_name  = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] barbican.cafile                = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] barbican.certfile              = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] barbican.collect_timing        = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] barbican.insecure              = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] barbican.keyfile               = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] barbican.number_of_retries     = 60 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] barbican.retry_delay           = 1 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] barbican.send_service_user_token = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] barbican.split_loggers         = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] barbican.timeout               = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] barbican.verify_ssl            = True {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] barbican.verify_ssl_path       = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] barbican_service_user.auth_section = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] barbican_service_user.auth_type = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] barbican_service_user.cafile   = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] barbican_service_user.certfile = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] barbican_service_user.collect_timing = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] barbican_service_user.insecure = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] barbican_service_user.keyfile  = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] barbican_service_user.split_loggers = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] barbican_service_user.timeout  = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vault.approle_role_id          = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vault.approle_secret_id        = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vault.cafile                   = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vault.certfile                 = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vault.collect_timing           = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vault.insecure                 = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vault.keyfile                  = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vault.kv_mountpoint            = secret {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vault.kv_version               = 2 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vault.namespace                = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vault.root_token_id            = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vault.split_loggers            = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vault.ssl_ca_crt_file          = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vault.timeout                  = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vault.use_ssl                  = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] keystone.cafile                = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] keystone.certfile              = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] keystone.collect_timing        = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] keystone.connect_retries       = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] keystone.connect_retry_delay   = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] keystone.endpoint_override     = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] keystone.insecure              = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] keystone.keyfile               = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] keystone.max_version           = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] keystone.min_version           = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] keystone.region_name           = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] keystone.service_name          = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] keystone.service_type          = identity {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] keystone.split_loggers         = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] keystone.status_code_retries   = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] keystone.status_code_retry_delay = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] keystone.timeout               = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] keystone.version               = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.connection_uri         =  {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.cpu_mode               = custom {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: WARNING oslo_config.cfg [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.cpu_power_governor_high = performance {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.cpu_power_governor_low = powersave {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.cpu_power_management   = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.device_detach_attempts = 8 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.device_detach_timeout  = 20 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.disk_cachemodes        = [] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.disk_prefix            = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.enabled_perf_events    = [] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.file_backed_memory     = 0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.gid_maps               = [] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.hw_disk_discard        = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.hw_machine_type        = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.images_rbd_glance_store_name =  {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.images_rbd_pool        = rbd {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.images_type            = default {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.images_volume_group    = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.inject_key             = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.inject_partition       = -2 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.inject_password        = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.iscsi_iface            = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.iser_use_multipath     = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.live_migration_bandwidth = 0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.live_migration_downtime = 500 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.live_migration_inbound_addr = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.live_migration_permit_post_copy = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.live_migration_scheme  = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.live_migration_timeout_action = abort {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.live_migration_tunnelled = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: WARNING oslo_config.cfg [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Apr 11 15:16:47 user nova-compute[71229]: live_migration_uri is deprecated for removal in favor of two other options that
Apr 11 15:16:47 user nova-compute[71229]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Apr 11 15:16:47 user nova-compute[71229]: and ``live_migration_inbound_addr`` respectively.
Apr 11 15:16:47 user nova-compute[71229]: ).  Its value may be silently ignored in the future.
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.live_migration_with_native_tls = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.max_queues             = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.nfs_mount_options      = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.num_memory_encrypted_guests = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.num_pcie_ports         = 0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.pmem_namespaces        = [] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.quobyte_client_cfg     = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.rbd_secret_uuid        = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.rbd_user               = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.remote_filesystem_transport = ssh {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.rescue_image_id        = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.rescue_kernel_id       = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.rescue_ramdisk_id      = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.rx_queue_size          = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.smbfs_mount_options    =  {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.snapshot_compression   = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.snapshot_image_format  = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.sparse_logical_volumes = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.swtpm_enabled          = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.swtpm_group            = tss {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.swtpm_user             = tss {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.sysinfo_serial         = unique {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.tx_queue_size          = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.uid_maps               = [] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.use_virtio_for_bridges = True {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.virt_type              = kvm {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.volume_clear           = zero {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.volume_clear_size      = 0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.volume_use_multipath   = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.vzstorage_cache_path   = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.vzstorage_mount_user   = stack {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] neutron.auth_section           = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] neutron.auth_type              = password {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] neutron.cafile                 = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] neutron.certfile               = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] neutron.collect_timing         = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] neutron.connect_retries        = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] neutron.connect_retry_delay    = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] neutron.default_floating_pool  = public {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] neutron.endpoint_override      = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] neutron.extension_sync_interval = 600 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] neutron.http_retries           = 3 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] neutron.insecure               = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] neutron.keyfile                = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] neutron.max_version            = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] neutron.min_version            = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] neutron.ovs_bridge             = br-int {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] neutron.physnets               = [] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] neutron.region_name            = RegionOne {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] neutron.service_metadata_proxy = True {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] neutron.service_name           = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] neutron.service_type           = network {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] neutron.split_loggers          = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] neutron.status_code_retries    = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] neutron.status_code_retry_delay = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] neutron.timeout                = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] neutron.version                = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] notifications.bdms_in_notifications = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] notifications.default_level    = INFO {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] notifications.notification_format = unversioned {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] notifications.notify_on_state_change = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] pci.alias                      = [] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] pci.device_spec                = [] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] pci.report_in_placement        = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] placement.auth_section         = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] placement.auth_type            = password {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] placement.cafile               = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] placement.certfile             = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] placement.collect_timing       = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] placement.connect_retries      = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] placement.connect_retry_delay  = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] placement.default_domain_id    = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] placement.default_domain_name  = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] placement.domain_id            = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] placement.domain_name          = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] placement.endpoint_override    = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] placement.insecure             = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] placement.keyfile              = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] placement.max_version          = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] placement.min_version          = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] placement.password             = **** {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] placement.project_domain_id    = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] placement.project_domain_name  = Default {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] placement.project_id           = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] placement.project_name         = service {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] placement.region_name          = RegionOne {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] placement.service_name         = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] placement.service_type         = placement {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] placement.split_loggers        = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] placement.status_code_retries  = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] placement.status_code_retry_delay = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] placement.system_scope         = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] placement.timeout              = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] placement.trust_id             = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] placement.user_domain_id       = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] placement.user_domain_name     = Default {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] placement.user_id              = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] placement.username             = placement {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] placement.version              = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] quota.cores                    = 20 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] quota.count_usage_from_placement = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] quota.injected_file_content_bytes = 10240 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] quota.injected_file_path_length = 255 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] quota.injected_files           = 5 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] quota.instances                = 10 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] quota.key_pairs                = 100 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] quota.metadata_items           = 128 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] quota.ram                      = 51200 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] quota.recheck_quota            = True {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] quota.server_group_members     = 10 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] quota.server_groups            = 10 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] rdp.enabled                    = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] scheduler.image_metadata_prefilter = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] scheduler.max_attempts         = 3 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] scheduler.max_placement_results = 1000 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] scheduler.query_placement_for_availability_zone = True {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] scheduler.query_placement_for_image_type_support = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] scheduler.workers              = 3 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] filter_scheduler.host_subset_size = 1 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] filter_scheduler.isolated_hosts = [] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] filter_scheduler.isolated_images = [] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] filter_scheduler.pci_in_placement = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] filter_scheduler.track_instance_changes = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] metrics.required               = True {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] metrics.weight_multiplier      = 1.0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] metrics.weight_setting         = [] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] serial_console.enabled         = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] serial_console.port_range      = 10000:20000 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] serial_console.serialproxy_port = 6083 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] service_user.auth_section      = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] service_user.auth_type         = password {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] service_user.cafile            = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] service_user.certfile          = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] service_user.collect_timing    = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] service_user.insecure          = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] service_user.keyfile           = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] service_user.send_service_user_token = True {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] service_user.split_loggers     = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] service_user.timeout           = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] spice.agent_enabled            = True {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] spice.enabled                  = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] spice.html5proxy_port          = 6082 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] spice.image_compression        = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] spice.jpeg_compression         = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] spice.playback_compression     = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] spice.server_listen            = 127.0.0.1 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] spice.streaming_mode           = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] spice.zlib_compression         = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] upgrade_levels.baseapi         = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] upgrade_levels.cert            = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] upgrade_levels.compute         = auto {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] upgrade_levels.conductor       = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] upgrade_levels.scheduler       = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vendordata_dynamic_auth.auth_section = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vendordata_dynamic_auth.auth_type = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vendordata_dynamic_auth.cafile = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vendordata_dynamic_auth.certfile = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vendordata_dynamic_auth.insecure = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vendordata_dynamic_auth.keyfile = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vendordata_dynamic_auth.timeout = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vmware.api_retry_count         = 10 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vmware.ca_file                 = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vmware.cache_prefix            = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vmware.cluster_name            = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vmware.connection_pool_size    = 10 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vmware.console_delay_seconds   = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vmware.datastore_regex         = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vmware.host_ip                 = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vmware.host_password           = **** {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vmware.host_port               = 443 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vmware.host_username           = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vmware.insecure                = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vmware.integration_bridge      = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vmware.maximum_objects         = 100 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vmware.pbm_default_policy      = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vmware.pbm_enabled             = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vmware.pbm_wsdl_location       = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vmware.serial_port_proxy_uri   = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vmware.serial_port_service_uri = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vmware.task_poll_interval      = 0.5 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vmware.use_linked_clone        = True {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vmware.vnc_keymap              = en-us {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vmware.vnc_port                = 5900 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vmware.vnc_port_total          = 10000 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vnc.auth_schemes               = ['none'] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vnc.enabled                    = True {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vnc.novncproxy_port            = 6080 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vnc.server_listen              = 0.0.0.0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vnc.vencrypt_ca_certs          = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vnc.vencrypt_client_cert       = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vnc.vencrypt_client_key        = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] workarounds.disable_rootwrap   = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] workarounds.enable_numa_live_migration = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] workarounds.libvirt_disable_apic = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] wsgi.client_socket_timeout     = 900 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] wsgi.default_pool_size         = 1000 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] wsgi.keep_alive                = True {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] wsgi.max_header_line           = 16384 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] wsgi.ssl_ca_file               = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] wsgi.ssl_cert_file             = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] wsgi.ssl_key_file              = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] wsgi.tcp_keepidle              = 600 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] zvm.ca_file                    = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] zvm.cloud_connector_url        = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] zvm.reachable_timeout          = 300 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_policy.enforce_new_defaults = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_policy.enforce_scope      = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_policy.policy_default_rule = default {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_policy.policy_file        = policy.yaml {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] profiler.connection_string     = messaging:// {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] profiler.enabled               = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] profiler.es_doc_type           = notification {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] profiler.es_scroll_size        = 10000 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] profiler.es_scroll_time        = 2m {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] profiler.filter_error_trace    = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] profiler.hmac_keys             = SECRET_KEY {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] profiler.sentinel_service_name = mymaster {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] profiler.socket_timeout        = 0.1 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] profiler.trace_sqlalchemy      = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] remote_debug.host              = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] remote_debug.port              = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_messaging_rabbit.ssl      = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_messaging_notifications.retry = -1 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_messaging_notifications.transport_url = **** {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_limit.auth_section        = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_limit.auth_type           = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_limit.cafile              = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_limit.certfile            = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_limit.collect_timing      = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_limit.connect_retries     = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_limit.connect_retry_delay = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_limit.endpoint_id         = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_limit.endpoint_override   = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_limit.insecure            = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_limit.keyfile             = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_limit.max_version         = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_limit.min_version         = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_limit.region_name         = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_limit.service_name        = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_limit.service_type        = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_limit.split_loggers       = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_limit.status_code_retries = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_limit.status_code_retry_delay = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_limit.timeout             = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_limit.valid_interfaces    = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_limit.version             = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_reports.file_event_handler = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] oslo_reports.log_dir           = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vif_plug_ovs_privileged.group  = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] vif_plug_ovs_privileged.user   = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] os_vif_linux_bridge.flat_interface = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] os_vif_ovs.isolate_vif         = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] os_vif_ovs.per_port_bridge     = False {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] os_brick.lock_path             = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] privsep_osbrick.capabilities   = [21] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] privsep_osbrick.group          = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] privsep_osbrick.helper_command = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] privsep_osbrick.user           = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] nova_sys_admin.group           = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] nova_sys_admin.helper_command  = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] nova_sys_admin.user            = None {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG oslo_service.service [None req-aa3665de-5959-4c81-95b2-c33147d76c56 None None] ******************************************************************************** {{(pid=71229) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Apr 11 15:16:47 user nova-compute[71229]: INFO nova.service [-] Starting compute node (version 0.0.0)
Apr 11 15:16:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Starting native event thread {{(pid=71229) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Starting green dispatch thread {{(pid=71229) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Starting connection event dispatch thread {{(pid=71229) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Connecting to libvirt: qemu:///system {{(pid=71229) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fcb65bb2680> {{(pid=71229) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Apr 11 15:16:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fcb65bb2680> {{(pid=71229) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Apr 11 15:16:47 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Connection event '1' reason 'None'
Apr 11 15:16:47 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 11 15:16:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.mount [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Initialising _HostMountState generation 0 {{(pid=71229) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Apr 11 15:16:54 user nova-compute[71229]: INFO nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Libvirt host capabilities <capabilities>
Apr 11 15:16:54 user nova-compute[71229]:   <host>
Apr 11 15:16:54 user nova-compute[71229]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Apr 11 15:16:54 user nova-compute[71229]:     <cpu>
Apr 11 15:16:54 user nova-compute[71229]:       <arch>x86_64</arch>
Apr 11 15:16:54 user nova-compute[71229]:       <model>IvyBridge-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <vendor>Intel</vendor>
Apr 11 15:16:54 user nova-compute[71229]:       <microcode version='1070'/>
Apr 11 15:16:54 user nova-compute[71229]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Apr 11 15:16:54 user nova-compute[71229]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature name='ss'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature name='vmx'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature name='pcid'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature name='osxsave'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature name='hypervisor'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature name='arat'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature name='tsc_adjust'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature name='md-clear'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature name='stibp'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature name='arch-capabilities'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature name='ssbd'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature name='invtsc'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature name='rsba'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature name='skip-l1dfl-vmentry'/>
Apr 11 15:16:54 user nova-compute[71229]:       <pages unit='KiB' size='4'/>
Apr 11 15:16:54 user nova-compute[71229]:       <pages unit='KiB' size='2048'/>
Apr 11 15:16:54 user nova-compute[71229]:     </cpu>
Apr 11 15:16:54 user nova-compute[71229]:     <power_management>
Apr 11 15:16:54 user nova-compute[71229]:       <suspend_mem/>
Apr 11 15:16:54 user nova-compute[71229]:       <suspend_disk/>
Apr 11 15:16:54 user nova-compute[71229]:       <suspend_hybrid/>
Apr 11 15:16:54 user nova-compute[71229]:     </power_management>
Apr 11 15:16:54 user nova-compute[71229]:     <iommu support='no'/>
Apr 11 15:16:54 user nova-compute[71229]:     <migration_features>
Apr 11 15:16:54 user nova-compute[71229]:       <live/>
Apr 11 15:16:54 user nova-compute[71229]:       <uri_transports>
Apr 11 15:16:54 user nova-compute[71229]:         <uri_transport>tcp</uri_transport>
Apr 11 15:16:54 user nova-compute[71229]:         <uri_transport>rdma</uri_transport>
Apr 11 15:16:54 user nova-compute[71229]:       </uri_transports>
Apr 11 15:16:54 user nova-compute[71229]:     </migration_features>
Apr 11 15:16:54 user nova-compute[71229]:     <topology>
Apr 11 15:16:54 user nova-compute[71229]:       <cells num='2'>
Apr 11 15:16:54 user nova-compute[71229]:         <cell id='0'>
Apr 11 15:16:54 user nova-compute[71229]:           <memory unit='KiB'>8152920</memory>
Apr 11 15:16:54 user nova-compute[71229]:           <pages unit='KiB' size='4'>2038230</pages>
Apr 11 15:16:54 user nova-compute[71229]:           <pages unit='KiB' size='2048'>0</pages>
Apr 11 15:16:54 user nova-compute[71229]:           <distances>
Apr 11 15:16:54 user nova-compute[71229]:             <sibling id='0' value='10'/>
Apr 11 15:16:54 user nova-compute[71229]:             <sibling id='1' value='20'/>
Apr 11 15:16:54 user nova-compute[71229]:           </distances>
Apr 11 15:16:54 user nova-compute[71229]:           <cpus num='6'>
Apr 11 15:16:54 user nova-compute[71229]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Apr 11 15:16:54 user nova-compute[71229]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Apr 11 15:16:54 user nova-compute[71229]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Apr 11 15:16:54 user nova-compute[71229]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Apr 11 15:16:54 user nova-compute[71229]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Apr 11 15:16:54 user nova-compute[71229]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Apr 11 15:16:54 user nova-compute[71229]:           </cpus>
Apr 11 15:16:54 user nova-compute[71229]:         </cell>
Apr 11 15:16:54 user nova-compute[71229]:         <cell id='1'>
Apr 11 15:16:54 user nova-compute[71229]:           <memory unit='KiB'>8255100</memory>
Apr 11 15:16:54 user nova-compute[71229]:           <pages unit='KiB' size='4'>2063775</pages>
Apr 11 15:16:54 user nova-compute[71229]:           <pages unit='KiB' size='2048'>0</pages>
Apr 11 15:16:54 user nova-compute[71229]:           <distances>
Apr 11 15:16:54 user nova-compute[71229]:             <sibling id='0' value='20'/>
Apr 11 15:16:54 user nova-compute[71229]:             <sibling id='1' value='10'/>
Apr 11 15:16:54 user nova-compute[71229]:           </distances>
Apr 11 15:16:54 user nova-compute[71229]:           <cpus num='6'>
Apr 11 15:16:54 user nova-compute[71229]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Apr 11 15:16:54 user nova-compute[71229]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Apr 11 15:16:54 user nova-compute[71229]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Apr 11 15:16:54 user nova-compute[71229]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Apr 11 15:16:54 user nova-compute[71229]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Apr 11 15:16:54 user nova-compute[71229]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Apr 11 15:16:54 user nova-compute[71229]:           </cpus>
Apr 11 15:16:54 user nova-compute[71229]:         </cell>
Apr 11 15:16:54 user nova-compute[71229]:       </cells>
Apr 11 15:16:54 user nova-compute[71229]:     </topology>
Apr 11 15:16:54 user nova-compute[71229]:     <cache>
Apr 11 15:16:54 user nova-compute[71229]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Apr 11 15:16:54 user nova-compute[71229]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Apr 11 15:16:54 user nova-compute[71229]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Apr 11 15:16:54 user nova-compute[71229]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Apr 11 15:16:54 user nova-compute[71229]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Apr 11 15:16:54 user nova-compute[71229]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Apr 11 15:16:54 user nova-compute[71229]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Apr 11 15:16:54 user nova-compute[71229]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Apr 11 15:16:54 user nova-compute[71229]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Apr 11 15:16:54 user nova-compute[71229]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Apr 11 15:16:54 user nova-compute[71229]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Apr 11 15:16:54 user nova-compute[71229]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Apr 11 15:16:54 user nova-compute[71229]:     </cache>
Apr 11 15:16:54 user nova-compute[71229]:     <secmodel>
Apr 11 15:16:54 user nova-compute[71229]:       <model>apparmor</model>
Apr 11 15:16:54 user nova-compute[71229]:       <doi>0</doi>
Apr 11 15:16:54 user nova-compute[71229]:     </secmodel>
Apr 11 15:16:54 user nova-compute[71229]:     <secmodel>
Apr 11 15:16:54 user nova-compute[71229]:       <model>dac</model>
Apr 11 15:16:54 user nova-compute[71229]:       <doi>0</doi>
Apr 11 15:16:54 user nova-compute[71229]:       <baselabel type='kvm'>+64055:+108</baselabel>
Apr 11 15:16:54 user nova-compute[71229]:       <baselabel type='qemu'>+64055:+108</baselabel>
Apr 11 15:16:54 user nova-compute[71229]:     </secmodel>
Apr 11 15:16:54 user nova-compute[71229]:   </host>
Apr 11 15:16:54 user nova-compute[71229]:   <guest>
Apr 11 15:16:54 user nova-compute[71229]:     <os_type>hvm</os_type>
Apr 11 15:16:54 user nova-compute[71229]:     <arch name='alpha'>
Apr 11 15:16:54 user nova-compute[71229]:       <wordsize>64</wordsize>
Apr 11 15:16:54 user nova-compute[71229]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='4'>clipper</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <domain type='qemu'/>
Apr 11 15:16:54 user nova-compute[71229]:     </arch>
Apr 11 15:16:54 user nova-compute[71229]:     <features>
Apr 11 15:16:54 user nova-compute[71229]:       <cpuselection/>
Apr 11 15:16:54 user nova-compute[71229]:       <deviceboot/>
Apr 11 15:16:54 user nova-compute[71229]:       <disksnapshot default='on' toggle='no'/>
Apr 11 15:16:54 user nova-compute[71229]:     </features>
Apr 11 15:16:54 user nova-compute[71229]:   </guest>
Apr 11 15:16:54 user nova-compute[71229]:   <guest>
Apr 11 15:16:54 user nova-compute[71229]:     <os_type>hvm</os_type>
Apr 11 15:16:54 user nova-compute[71229]:     <arch name='armv6l'>
Apr 11 15:16:54 user nova-compute[71229]:       <wordsize>32</wordsize>
Apr 11 15:16:54 user nova-compute[71229]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>integratorcp</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>borzoi</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>spitz</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2'>nuri</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2'>musca-b1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>versatileab</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>kzm</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2'>musca-a</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2'>smdkc210</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>sx1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>z2</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>tosa</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='4'>sabrelite</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>realview-eb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>n810</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>n800</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>versatilepb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>terrier</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>mainstone</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='4'>midway</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>musicpal</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>microbit</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>cubieboard</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>verdex</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>netduino2</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='4'>raspi2b</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>cheetah</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='4'>highbank</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>akita</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>connex</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>collie</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>raspi0</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <domain type='qemu'/>
Apr 11 15:16:54 user nova-compute[71229]:     </arch>
Apr 11 15:16:54 user nova-compute[71229]:     <features>
Apr 11 15:16:54 user nova-compute[71229]:       <cpuselection/>
Apr 11 15:16:54 user nova-compute[71229]:       <deviceboot/>
Apr 11 15:16:54 user nova-compute[71229]:       <disksnapshot default='on' toggle='no'/>
Apr 11 15:16:54 user nova-compute[71229]:     </features>
Apr 11 15:16:54 user nova-compute[71229]:   </guest>
Apr 11 15:16:54 user nova-compute[71229]:   <guest>
Apr 11 15:16:54 user nova-compute[71229]:     <os_type>hvm</os_type>
Apr 11 15:16:54 user nova-compute[71229]:     <arch name='armv7l'>
Apr 11 15:16:54 user nova-compute[71229]:       <wordsize>32</wordsize>
Apr 11 15:16:54 user nova-compute[71229]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>integratorcp</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>borzoi</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>spitz</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2'>nuri</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2'>musca-b1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>versatileab</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>kzm</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2'>musca-a</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2'>smdkc210</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>sx1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>z2</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>tosa</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='4'>sabrelite</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>realview-eb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>n810</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>n800</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>versatilepb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>terrier</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>mainstone</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='4'>midway</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>musicpal</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>microbit</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>cubieboard</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>verdex</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>netduino2</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='4'>raspi2b</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>cheetah</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='4'>highbank</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>akita</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>connex</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>collie</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>raspi0</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <domain type='qemu'/>
Apr 11 15:16:54 user nova-compute[71229]:     </arch>
Apr 11 15:16:54 user nova-compute[71229]:     <features>
Apr 11 15:16:54 user nova-compute[71229]:       <cpuselection/>
Apr 11 15:16:54 user nova-compute[71229]:       <deviceboot/>
Apr 11 15:16:54 user nova-compute[71229]:       <disksnapshot default='on' toggle='no'/>
Apr 11 15:16:54 user nova-compute[71229]:     </features>
Apr 11 15:16:54 user nova-compute[71229]:   </guest>
Apr 11 15:16:54 user nova-compute[71229]:   <guest>
Apr 11 15:16:54 user nova-compute[71229]:     <os_type>hvm</os_type>
Apr 11 15:16:54 user nova-compute[71229]:     <arch name='aarch64'>
Apr 11 15:16:54 user nova-compute[71229]:       <wordsize>64</wordsize>
Apr 11 15:16:54 user nova-compute[71229]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>integratorcp</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>borzoi</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>spitz</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2'>nuri</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2'>musca-b1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>versatileab</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>kzm</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2'>musca-a</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2'>smdkc210</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>sx1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>z2</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>tosa</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='4'>sabrelite</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>realview-eb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='512'>sbsa-ref</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>n810</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>n800</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>versatilepb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>terrier</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>mainstone</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='4'>midway</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>musicpal</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>microbit</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='4'>raspi3ap</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>cubieboard</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>verdex</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>netduino2</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='4'>raspi3b</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='4'>raspi2b</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>cheetah</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='4'>highbank</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>akita</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>connex</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>collie</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>raspi0</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <domain type='qemu'/>
Apr 11 15:16:54 user nova-compute[71229]:     </arch>
Apr 11 15:16:54 user nova-compute[71229]:     <features>
Apr 11 15:16:54 user nova-compute[71229]:       <acpi default='on' toggle='yes'/>
Apr 11 15:16:54 user nova-compute[71229]:       <cpuselection/>
Apr 11 15:16:54 user nova-compute[71229]:       <deviceboot/>
Apr 11 15:16:54 user nova-compute[71229]:       <disksnapshot default='on' toggle='no'/>
Apr 11 15:16:54 user nova-compute[71229]:     </features>
Apr 11 15:16:54 user nova-compute[71229]:   </guest>
Apr 11 15:16:54 user nova-compute[71229]:   <guest>
Apr 11 15:16:54 user nova-compute[71229]:     <os_type>hvm</os_type>
Apr 11 15:16:54 user nova-compute[71229]:     <arch name='cris'>
Apr 11 15:16:54 user nova-compute[71229]:       <wordsize>32</wordsize>
Apr 11 15:16:54 user nova-compute[71229]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>axis-dev88</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <domain type='qemu'/>
Apr 11 15:16:54 user nova-compute[71229]:     </arch>
Apr 11 15:16:54 user nova-compute[71229]:     <features>
Apr 11 15:16:54 user nova-compute[71229]:       <cpuselection/>
Apr 11 15:16:54 user nova-compute[71229]:       <deviceboot/>
Apr 11 15:16:54 user nova-compute[71229]:       <disksnapshot default='on' toggle='no'/>
Apr 11 15:16:54 user nova-compute[71229]:     </features>
Apr 11 15:16:54 user nova-compute[71229]:   </guest>
Apr 11 15:16:54 user nova-compute[71229]:   <guest>
Apr 11 15:16:54 user nova-compute[71229]:     <os_type>hvm</os_type>
Apr 11 15:16:54 user nova-compute[71229]:     <arch name='i686'>
Apr 11 15:16:54 user nova-compute[71229]:       <wordsize>32</wordsize>
Apr 11 15:16:54 user nova-compute[71229]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>x-remote</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>isapc</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>microvm</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <domain type='qemu'/>
Apr 11 15:16:54 user nova-compute[71229]:       <domain type='kvm'/>
Apr 11 15:16:54 user nova-compute[71229]:     </arch>
Apr 11 15:16:54 user nova-compute[71229]:     <features>
Apr 11 15:16:54 user nova-compute[71229]:       <pae/>
Apr 11 15:16:54 user nova-compute[71229]:       <nonpae/>
Apr 11 15:16:54 user nova-compute[71229]:       <acpi default='on' toggle='yes'/>
Apr 11 15:16:54 user nova-compute[71229]:       <apic default='on' toggle='no'/>
Apr 11 15:16:54 user nova-compute[71229]:       <cpuselection/>
Apr 11 15:16:54 user nova-compute[71229]:       <deviceboot/>
Apr 11 15:16:54 user nova-compute[71229]:       <disksnapshot default='on' toggle='no'/>
Apr 11 15:16:54 user nova-compute[71229]:     </features>
Apr 11 15:16:54 user nova-compute[71229]:   </guest>
Apr 11 15:16:54 user nova-compute[71229]:   <guest>
Apr 11 15:16:54 user nova-compute[71229]:     <os_type>hvm</os_type>
Apr 11 15:16:54 user nova-compute[71229]:     <arch name='m68k'>
Apr 11 15:16:54 user nova-compute[71229]:       <wordsize>32</wordsize>
Apr 11 15:16:54 user nova-compute[71229]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>mcf5208evb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>an5206</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>virt-6.0</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>q800</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>virt-6.2</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>next-cube</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>virt-6.1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <domain type='qemu'/>
Apr 11 15:16:54 user nova-compute[71229]:     </arch>
Apr 11 15:16:54 user nova-compute[71229]:     <features>
Apr 11 15:16:54 user nova-compute[71229]:       <cpuselection/>
Apr 11 15:16:54 user nova-compute[71229]:       <deviceboot/>
Apr 11 15:16:54 user nova-compute[71229]:       <disksnapshot default='on' toggle='no'/>
Apr 11 15:16:54 user nova-compute[71229]:     </features>
Apr 11 15:16:54 user nova-compute[71229]:   </guest>
Apr 11 15:16:54 user nova-compute[71229]:   <guest>
Apr 11 15:16:54 user nova-compute[71229]:     <os_type>hvm</os_type>
Apr 11 15:16:54 user nova-compute[71229]:     <arch name='microblaze'>
Apr 11 15:16:54 user nova-compute[71229]:       <wordsize>32</wordsize>
Apr 11 15:16:54 user nova-compute[71229]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <domain type='qemu'/>
Apr 11 15:16:54 user nova-compute[71229]:     </arch>
Apr 11 15:16:54 user nova-compute[71229]:     <features>
Apr 11 15:16:54 user nova-compute[71229]:       <cpuselection/>
Apr 11 15:16:54 user nova-compute[71229]:       <deviceboot/>
Apr 11 15:16:54 user nova-compute[71229]:       <disksnapshot default='on' toggle='no'/>
Apr 11 15:16:54 user nova-compute[71229]:     </features>
Apr 11 15:16:54 user nova-compute[71229]:   </guest>
Apr 11 15:16:54 user nova-compute[71229]:   <guest>
Apr 11 15:16:54 user nova-compute[71229]:     <os_type>hvm</os_type>
Apr 11 15:16:54 user nova-compute[71229]:     <arch name='microblazeel'>
Apr 11 15:16:54 user nova-compute[71229]:       <wordsize>32</wordsize>
Apr 11 15:16:54 user nova-compute[71229]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <domain type='qemu'/>
Apr 11 15:16:54 user nova-compute[71229]:     </arch>
Apr 11 15:16:54 user nova-compute[71229]:     <features>
Apr 11 15:16:54 user nova-compute[71229]:       <cpuselection/>
Apr 11 15:16:54 user nova-compute[71229]:       <deviceboot/>
Apr 11 15:16:54 user nova-compute[71229]:       <disksnapshot default='on' toggle='no'/>
Apr 11 15:16:54 user nova-compute[71229]:     </features>
Apr 11 15:16:54 user nova-compute[71229]:   </guest>
Apr 11 15:16:54 user nova-compute[71229]:   <guest>
Apr 11 15:16:54 user nova-compute[71229]:     <os_type>hvm</os_type>
Apr 11 15:16:54 user nova-compute[71229]:     <arch name='mips'>
Apr 11 15:16:54 user nova-compute[71229]:       <wordsize>32</wordsize>
Apr 11 15:16:54 user nova-compute[71229]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='16'>malta</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>mipssim</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <domain type='qemu'/>
Apr 11 15:16:54 user nova-compute[71229]:     </arch>
Apr 11 15:16:54 user nova-compute[71229]:     <features>
Apr 11 15:16:54 user nova-compute[71229]:       <cpuselection/>
Apr 11 15:16:54 user nova-compute[71229]:       <deviceboot/>
Apr 11 15:16:54 user nova-compute[71229]:       <disksnapshot default='on' toggle='no'/>
Apr 11 15:16:54 user nova-compute[71229]:     </features>
Apr 11 15:16:54 user nova-compute[71229]:   </guest>
Apr 11 15:16:54 user nova-compute[71229]:   <guest>
Apr 11 15:16:54 user nova-compute[71229]:     <os_type>hvm</os_type>
Apr 11 15:16:54 user nova-compute[71229]:     <arch name='mipsel'>
Apr 11 15:16:54 user nova-compute[71229]:       <wordsize>32</wordsize>
Apr 11 15:16:54 user nova-compute[71229]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='16'>malta</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>mipssim</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <domain type='qemu'/>
Apr 11 15:16:54 user nova-compute[71229]:     </arch>
Apr 11 15:16:54 user nova-compute[71229]:     <features>
Apr 11 15:16:54 user nova-compute[71229]:       <cpuselection/>
Apr 11 15:16:54 user nova-compute[71229]:       <deviceboot/>
Apr 11 15:16:54 user nova-compute[71229]:       <disksnapshot default='on' toggle='no'/>
Apr 11 15:16:54 user nova-compute[71229]:     </features>
Apr 11 15:16:54 user nova-compute[71229]:   </guest>
Apr 11 15:16:54 user nova-compute[71229]:   <guest>
Apr 11 15:16:54 user nova-compute[71229]:     <os_type>hvm</os_type>
Apr 11 15:16:54 user nova-compute[71229]:     <arch name='mips64'>
Apr 11 15:16:54 user nova-compute[71229]:       <wordsize>64</wordsize>
Apr 11 15:16:54 user nova-compute[71229]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='16'>malta</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>mipssim</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>pica61</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>magnum</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <domain type='qemu'/>
Apr 11 15:16:54 user nova-compute[71229]:     </arch>
Apr 11 15:16:54 user nova-compute[71229]:     <features>
Apr 11 15:16:54 user nova-compute[71229]:       <cpuselection/>
Apr 11 15:16:54 user nova-compute[71229]:       <deviceboot/>
Apr 11 15:16:54 user nova-compute[71229]:       <disksnapshot default='on' toggle='no'/>
Apr 11 15:16:54 user nova-compute[71229]:     </features>
Apr 11 15:16:54 user nova-compute[71229]:   </guest>
Apr 11 15:16:54 user nova-compute[71229]:   <guest>
Apr 11 15:16:54 user nova-compute[71229]:     <os_type>hvm</os_type>
Apr 11 15:16:54 user nova-compute[71229]:     <arch name='mips64el'>
Apr 11 15:16:54 user nova-compute[71229]:       <wordsize>64</wordsize>
Apr 11 15:16:54 user nova-compute[71229]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='16'>malta</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='16'>loongson3-virt</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>mipssim</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>pica61</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>magnum</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='16'>boston</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>fuloong2e</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <domain type='qemu'/>
Apr 11 15:16:54 user nova-compute[71229]:     </arch>
Apr 11 15:16:54 user nova-compute[71229]:     <features>
Apr 11 15:16:54 user nova-compute[71229]:       <cpuselection/>
Apr 11 15:16:54 user nova-compute[71229]:       <deviceboot/>
Apr 11 15:16:54 user nova-compute[71229]:       <disksnapshot default='on' toggle='no'/>
Apr 11 15:16:54 user nova-compute[71229]:     </features>
Apr 11 15:16:54 user nova-compute[71229]:   </guest>
Apr 11 15:16:54 user nova-compute[71229]:   <guest>
Apr 11 15:16:54 user nova-compute[71229]:     <os_type>hvm</os_type>
Apr 11 15:16:54 user nova-compute[71229]:     <arch name='ppc'>
Apr 11 15:16:54 user nova-compute[71229]:       <wordsize>32</wordsize>
Apr 11 15:16:54 user nova-compute[71229]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>g3beige</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>mac99</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='32'>ppce500</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>pegasos2</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>sam460ex</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>bamboo</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>40p</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>ref405ep</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>taihu</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <domain type='qemu'/>
Apr 11 15:16:54 user nova-compute[71229]:     </arch>
Apr 11 15:16:54 user nova-compute[71229]:     <features>
Apr 11 15:16:54 user nova-compute[71229]:       <cpuselection/>
Apr 11 15:16:54 user nova-compute[71229]:       <deviceboot/>
Apr 11 15:16:54 user nova-compute[71229]:       <disksnapshot default='on' toggle='no'/>
Apr 11 15:16:54 user nova-compute[71229]:     </features>
Apr 11 15:16:54 user nova-compute[71229]:   </guest>
Apr 11 15:16:54 user nova-compute[71229]:   <guest>
Apr 11 15:16:54 user nova-compute[71229]:     <os_type>hvm</os_type>
Apr 11 15:16:54 user nova-compute[71229]:     <arch name='ppc64'>
Apr 11 15:16:54 user nova-compute[71229]:       <wordsize>64</wordsize>
Apr 11 15:16:54 user nova-compute[71229]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2048'>powernv9</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>taihu</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2048'>powernv10</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='32'>ppce500</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>40p</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>pegasos2</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>bamboo</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>g3beige</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>mac99</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>sam460ex</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>ref405ep</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2048'>powernv8</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <domain type='qemu'/>
Apr 11 15:16:54 user nova-compute[71229]:     </arch>
Apr 11 15:16:54 user nova-compute[71229]:     <features>
Apr 11 15:16:54 user nova-compute[71229]:       <cpuselection/>
Apr 11 15:16:54 user nova-compute[71229]:       <deviceboot/>
Apr 11 15:16:54 user nova-compute[71229]:       <disksnapshot default='on' toggle='no'/>
Apr 11 15:16:54 user nova-compute[71229]:     </features>
Apr 11 15:16:54 user nova-compute[71229]:   </guest>
Apr 11 15:16:54 user nova-compute[71229]:   <guest>
Apr 11 15:16:54 user nova-compute[71229]:     <os_type>hvm</os_type>
Apr 11 15:16:54 user nova-compute[71229]:     <arch name='ppc64le'>
Apr 11 15:16:54 user nova-compute[71229]:       <wordsize>64</wordsize>
Apr 11 15:16:54 user nova-compute[71229]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2048'>powernv9</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>taihu</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2048'>powernv10</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='32'>ppce500</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>40p</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>pegasos2</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>bamboo</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>g3beige</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>mac99</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>sam460ex</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>ref405ep</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2048'>powernv8</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <domain type='qemu'/>
Apr 11 15:16:54 user nova-compute[71229]:     </arch>
Apr 11 15:16:54 user nova-compute[71229]:     <features>
Apr 11 15:16:54 user nova-compute[71229]:       <cpuselection/>
Apr 11 15:16:54 user nova-compute[71229]:       <deviceboot/>
Apr 11 15:16:54 user nova-compute[71229]:       <disksnapshot default='on' toggle='no'/>
Apr 11 15:16:54 user nova-compute[71229]:     </features>
Apr 11 15:16:54 user nova-compute[71229]:   </guest>
Apr 11 15:16:54 user nova-compute[71229]:   <guest>
Apr 11 15:16:54 user nova-compute[71229]:     <os_type>hvm</os_type>
Apr 11 15:16:54 user nova-compute[71229]:     <arch name='riscv32'>
Apr 11 15:16:54 user nova-compute[71229]:       <wordsize>32</wordsize>
Apr 11 15:16:54 user nova-compute[71229]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='8'>spike</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>opentitan</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='5'>sifive_u</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>sifive_e</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='8'>virt</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <domain type='qemu'/>
Apr 11 15:16:54 user nova-compute[71229]:     </arch>
Apr 11 15:16:54 user nova-compute[71229]:     <features>
Apr 11 15:16:54 user nova-compute[71229]:       <cpuselection/>
Apr 11 15:16:54 user nova-compute[71229]:       <deviceboot/>
Apr 11 15:16:54 user nova-compute[71229]:       <disksnapshot default='on' toggle='no'/>
Apr 11 15:16:54 user nova-compute[71229]:     </features>
Apr 11 15:16:54 user nova-compute[71229]:   </guest>
Apr 11 15:16:54 user nova-compute[71229]:   <guest>
Apr 11 15:16:54 user nova-compute[71229]:     <os_type>hvm</os_type>
Apr 11 15:16:54 user nova-compute[71229]:     <arch name='riscv64'>
Apr 11 15:16:54 user nova-compute[71229]:       <wordsize>64</wordsize>
Apr 11 15:16:54 user nova-compute[71229]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='8'>spike</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='5'>sifive_u</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>shakti_c</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>sifive_e</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='8'>virt</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <domain type='qemu'/>
Apr 11 15:16:54 user nova-compute[71229]:     </arch>
Apr 11 15:16:54 user nova-compute[71229]:     <features>
Apr 11 15:16:54 user nova-compute[71229]:       <cpuselection/>
Apr 11 15:16:54 user nova-compute[71229]:       <deviceboot/>
Apr 11 15:16:54 user nova-compute[71229]:       <disksnapshot default='on' toggle='no'/>
Apr 11 15:16:54 user nova-compute[71229]:     </features>
Apr 11 15:16:54 user nova-compute[71229]:   </guest>
Apr 11 15:16:54 user nova-compute[71229]:   <guest>
Apr 11 15:16:54 user nova-compute[71229]:     <os_type>hvm</os_type>
Apr 11 15:16:54 user nova-compute[71229]:     <arch name='s390x'>
Apr 11 15:16:54 user nova-compute[71229]:       <wordsize>64</wordsize>
Apr 11 15:16:54 user nova-compute[71229]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <domain type='qemu'/>
Apr 11 15:16:54 user nova-compute[71229]:     </arch>
Apr 11 15:16:54 user nova-compute[71229]:     <features>
Apr 11 15:16:54 user nova-compute[71229]:       <cpuselection/>
Apr 11 15:16:54 user nova-compute[71229]:       <deviceboot/>
Apr 11 15:16:54 user nova-compute[71229]:       <disksnapshot default='on' toggle='no'/>
Apr 11 15:16:54 user nova-compute[71229]:     </features>
Apr 11 15:16:54 user nova-compute[71229]:   </guest>
Apr 11 15:16:54 user nova-compute[71229]:   <guest>
Apr 11 15:16:54 user nova-compute[71229]:     <os_type>hvm</os_type>
Apr 11 15:16:54 user nova-compute[71229]:     <arch name='sh4'>
Apr 11 15:16:54 user nova-compute[71229]:       <wordsize>32</wordsize>
Apr 11 15:16:54 user nova-compute[71229]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>shix</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>r2d</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <domain type='qemu'/>
Apr 11 15:16:54 user nova-compute[71229]:     </arch>
Apr 11 15:16:54 user nova-compute[71229]:     <features>
Apr 11 15:16:54 user nova-compute[71229]:       <cpuselection/>
Apr 11 15:16:54 user nova-compute[71229]:       <deviceboot/>
Apr 11 15:16:54 user nova-compute[71229]:       <disksnapshot default='on' toggle='no'/>
Apr 11 15:16:54 user nova-compute[71229]:     </features>
Apr 11 15:16:54 user nova-compute[71229]:   </guest>
Apr 11 15:16:54 user nova-compute[71229]:   <guest>
Apr 11 15:16:54 user nova-compute[71229]:     <os_type>hvm</os_type>
Apr 11 15:16:54 user nova-compute[71229]:     <arch name='sh4eb'>
Apr 11 15:16:54 user nova-compute[71229]:       <wordsize>64</wordsize>
Apr 11 15:16:54 user nova-compute[71229]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>shix</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>r2d</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <domain type='qemu'/>
Apr 11 15:16:54 user nova-compute[71229]:     </arch>
Apr 11 15:16:54 user nova-compute[71229]:     <features>
Apr 11 15:16:54 user nova-compute[71229]:       <cpuselection/>
Apr 11 15:16:54 user nova-compute[71229]:       <deviceboot/>
Apr 11 15:16:54 user nova-compute[71229]:       <disksnapshot default='on' toggle='no'/>
Apr 11 15:16:54 user nova-compute[71229]:     </features>
Apr 11 15:16:54 user nova-compute[71229]:   </guest>
Apr 11 15:16:54 user nova-compute[71229]:   <guest>
Apr 11 15:16:54 user nova-compute[71229]:     <os_type>hvm</os_type>
Apr 11 15:16:54 user nova-compute[71229]:     <arch name='sparc'>
Apr 11 15:16:54 user nova-compute[71229]:       <wordsize>32</wordsize>
Apr 11 15:16:54 user nova-compute[71229]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>SS-5</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='4'>SS-20</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>LX</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>SPARCClassic</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>leon3_generic</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>SPARCbook</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>SS-4</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='4'>SS-600MP</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='4'>SS-10</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>Voyager</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <domain type='qemu'/>
Apr 11 15:16:54 user nova-compute[71229]:     </arch>
Apr 11 15:16:54 user nova-compute[71229]:     <features>
Apr 11 15:16:54 user nova-compute[71229]:       <cpuselection/>
Apr 11 15:16:54 user nova-compute[71229]:       <deviceboot/>
Apr 11 15:16:54 user nova-compute[71229]:       <disksnapshot default='on' toggle='no'/>
Apr 11 15:16:54 user nova-compute[71229]:     </features>
Apr 11 15:16:54 user nova-compute[71229]:   </guest>
Apr 11 15:16:54 user nova-compute[71229]:   <guest>
Apr 11 15:16:54 user nova-compute[71229]:     <os_type>hvm</os_type>
Apr 11 15:16:54 user nova-compute[71229]:     <arch name='sparc64'>
Apr 11 15:16:54 user nova-compute[71229]:       <wordsize>64</wordsize>
Apr 11 15:16:54 user nova-compute[71229]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>sun4u</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>niagara</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>sun4v</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <domain type='qemu'/>
Apr 11 15:16:54 user nova-compute[71229]:     </arch>
Apr 11 15:16:54 user nova-compute[71229]:     <features>
Apr 11 15:16:54 user nova-compute[71229]:       <cpuselection/>
Apr 11 15:16:54 user nova-compute[71229]:       <deviceboot/>
Apr 11 15:16:54 user nova-compute[71229]:       <disksnapshot default='on' toggle='no'/>
Apr 11 15:16:54 user nova-compute[71229]:     </features>
Apr 11 15:16:54 user nova-compute[71229]:   </guest>
Apr 11 15:16:54 user nova-compute[71229]:   <guest>
Apr 11 15:16:54 user nova-compute[71229]:     <os_type>hvm</os_type>
Apr 11 15:16:54 user nova-compute[71229]:     <arch name='x86_64'>
Apr 11 15:16:54 user nova-compute[71229]:       <wordsize>64</wordsize>
Apr 11 15:16:54 user nova-compute[71229]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>x-remote</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='1'>isapc</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>microvm</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <domain type='qemu'/>
Apr 11 15:16:54 user nova-compute[71229]:       <domain type='kvm'/>
Apr 11 15:16:54 user nova-compute[71229]:     </arch>
Apr 11 15:16:54 user nova-compute[71229]:     <features>
Apr 11 15:16:54 user nova-compute[71229]:       <acpi default='on' toggle='yes'/>
Apr 11 15:16:54 user nova-compute[71229]:       <apic default='on' toggle='no'/>
Apr 11 15:16:54 user nova-compute[71229]:       <cpuselection/>
Apr 11 15:16:54 user nova-compute[71229]:       <deviceboot/>
Apr 11 15:16:54 user nova-compute[71229]:       <disksnapshot default='on' toggle='no'/>
Apr 11 15:16:54 user nova-compute[71229]:     </features>
Apr 11 15:16:54 user nova-compute[71229]:   </guest>
Apr 11 15:16:54 user nova-compute[71229]:   <guest>
Apr 11 15:16:54 user nova-compute[71229]:     <os_type>hvm</os_type>
Apr 11 15:16:54 user nova-compute[71229]:     <arch name='xtensa'>
Apr 11 15:16:54 user nova-compute[71229]:       <wordsize>32</wordsize>
Apr 11 15:16:54 user nova-compute[71229]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='4'>sim</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='32'>kc705</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='32'>ml605</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='32'>virt</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='32'>lx200</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='32'>lx60</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <domain type='qemu'/>
Apr 11 15:16:54 user nova-compute[71229]:     </arch>
Apr 11 15:16:54 user nova-compute[71229]:     <features>
Apr 11 15:16:54 user nova-compute[71229]:       <cpuselection/>
Apr 11 15:16:54 user nova-compute[71229]:       <deviceboot/>
Apr 11 15:16:54 user nova-compute[71229]:       <disksnapshot default='on' toggle='no'/>
Apr 11 15:16:54 user nova-compute[71229]:     </features>
Apr 11 15:16:54 user nova-compute[71229]:   </guest>
Apr 11 15:16:54 user nova-compute[71229]:   <guest>
Apr 11 15:16:54 user nova-compute[71229]:     <os_type>hvm</os_type>
Apr 11 15:16:54 user nova-compute[71229]:     <arch name='xtensaeb'>
Apr 11 15:16:54 user nova-compute[71229]:       <wordsize>32</wordsize>
Apr 11 15:16:54 user nova-compute[71229]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='4'>sim</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='32'>kc705</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='32'>ml605</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='32'>virt</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='32'>lx200</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='32'>lx60</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 11 15:16:54 user nova-compute[71229]:       <domain type='qemu'/>
Apr 11 15:16:54 user nova-compute[71229]:     </arch>
Apr 11 15:16:54 user nova-compute[71229]:     <features>
Apr 11 15:16:54 user nova-compute[71229]:       <cpuselection/>
Apr 11 15:16:54 user nova-compute[71229]:       <deviceboot/>
Apr 11 15:16:54 user nova-compute[71229]:       <disksnapshot default='on' toggle='no'/>
Apr 11 15:16:54 user nova-compute[71229]:     </features>
Apr 11 15:16:54 user nova-compute[71229]:   </guest>
Apr 11 15:16:54 user nova-compute[71229]: </capabilities>
Apr 11 15:16:54 user nova-compute[71229]: 
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=71229) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=71229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=71229) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=71229) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=71229) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=71229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=71229) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=71229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu-q35', 'ubuntu', 'pc'} {{(pid=71229) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Apr 11 15:16:54 user nova-compute[71229]: <domainCapabilities>
Apr 11 15:16:54 user nova-compute[71229]:   <path>/usr/bin/qemu-system-i386</path>
Apr 11 15:16:54 user nova-compute[71229]:   <domain>kvm</domain>
Apr 11 15:16:54 user nova-compute[71229]:   <machine>pc-q35-6.2</machine>
Apr 11 15:16:54 user nova-compute[71229]:   <arch>i686</arch>
Apr 11 15:16:54 user nova-compute[71229]:   <vcpu max='288'/>
Apr 11 15:16:54 user nova-compute[71229]:   <iothreads supported='yes'/>
Apr 11 15:16:54 user nova-compute[71229]:   <os supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:     <enum name='firmware'/>
Apr 11 15:16:54 user nova-compute[71229]:     <loader supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 11 15:16:54 user nova-compute[71229]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 11 15:16:54 user nova-compute[71229]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 11 15:16:54 user nova-compute[71229]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 11 15:16:54 user nova-compute[71229]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='type'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>rom</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>pflash</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='readonly'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>yes</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>no</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='secure'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>no</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </loader>
Apr 11 15:16:54 user nova-compute[71229]:   </os>
Apr 11 15:16:54 user nova-compute[71229]:   <cpu>
Apr 11 15:16:54 user nova-compute[71229]:     <mode name='host-passthrough' supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='hostPassthroughMigratable'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>off</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </mode>
Apr 11 15:16:54 user nova-compute[71229]:     <mode name='maximum' supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='maximumMigratable'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>on</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>off</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </mode>
Apr 11 15:16:54 user nova-compute[71229]:     <mode name='host-model' supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <vendor>Intel</vendor>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='ss'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='vmx'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='pcid'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='hypervisor'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='arat'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='umip'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='md-clear'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='stibp'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='ssbd'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='ibpb'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='ibrs'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='amd-stibp'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='disable' name='erms'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='disable' name='lm'/>
Apr 11 15:16:54 user nova-compute[71229]:     </mode>
Apr 11 15:16:54 user nova-compute[71229]:     <mode name='custom' supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>qemu64</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>qemu32</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>phenom</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>pentium3</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>pentium2</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>pentium</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>n270</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>kvm64</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>kvm32</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>coreduo</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>core2duo</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>athlon</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Westmere-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Westmere</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Snowridge</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Skylake-Server</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Skylake-Client</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>SandyBridge</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Penryn</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Opteron_G5</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Opteron_G4</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Opteron_G3</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Opteron_G2</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Opteron_G1</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Nehalem-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Nehalem</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>IvyBridge</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Icelake-Server</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Haswell</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>EPYC-Rome</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>EPYC-Milan</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>EPYC</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Dhyana</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Cooperlake</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Conroe</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Broadwell</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>486</model>
Apr 11 15:16:54 user nova-compute[71229]:     </mode>
Apr 11 15:16:54 user nova-compute[71229]:   </cpu>
Apr 11 15:16:54 user nova-compute[71229]:   <memoryBacking supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:     <enum name='sourceType'>
Apr 11 15:16:54 user nova-compute[71229]:       <value>file</value>
Apr 11 15:16:54 user nova-compute[71229]:       <value>anonymous</value>
Apr 11 15:16:54 user nova-compute[71229]:       <value>memfd</value>
Apr 11 15:16:54 user nova-compute[71229]:     </enum>
Apr 11 15:16:54 user nova-compute[71229]:   </memoryBacking>
Apr 11 15:16:54 user nova-compute[71229]:   <devices>
Apr 11 15:16:54 user nova-compute[71229]:     <disk supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='diskDevice'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>disk</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>cdrom</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>floppy</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>lun</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='bus'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>fdc</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>scsi</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>usb</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>sata</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='model'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio-transitional</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio-non-transitional</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </disk>
Apr 11 15:16:54 user nova-compute[71229]:     <graphics supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='type'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>sdl</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>vnc</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>spice</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>egl-headless</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </graphics>
Apr 11 15:16:54 user nova-compute[71229]:     <video supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='modelType'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>vga</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>cirrus</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>vmvga</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>qxl</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>none</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>bochs</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>ramfb</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </video>
Apr 11 15:16:54 user nova-compute[71229]:     <hostdev supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='mode'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>subsystem</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='startupPolicy'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>default</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>mandatory</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>requisite</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>optional</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='subsysType'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>usb</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>pci</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>scsi</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='capsType'/>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='pciBackend'/>
Apr 11 15:16:54 user nova-compute[71229]:     </hostdev>
Apr 11 15:16:54 user nova-compute[71229]:     <rng supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='model'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio-transitional</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio-non-transitional</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='backendModel'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>random</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>egd</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>builtin</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </rng>
Apr 11 15:16:54 user nova-compute[71229]:     <filesystem supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='driverType'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>path</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>handle</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtiofs</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </filesystem>
Apr 11 15:16:54 user nova-compute[71229]:     <tpm supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='model'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>tpm-tis</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>tpm-crb</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='backendModel'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>passthrough</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>emulator</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </tpm>
Apr 11 15:16:54 user nova-compute[71229]:   </devices>
Apr 11 15:16:54 user nova-compute[71229]:   <features>
Apr 11 15:16:54 user nova-compute[71229]:     <gic supported='no'/>
Apr 11 15:16:54 user nova-compute[71229]:     <vmcoreinfo supported='yes'/>
Apr 11 15:16:54 user nova-compute[71229]:     <genid supported='yes'/>
Apr 11 15:16:54 user nova-compute[71229]:     <backingStoreInput supported='yes'/>
Apr 11 15:16:54 user nova-compute[71229]:     <backup supported='yes'/>
Apr 11 15:16:54 user nova-compute[71229]:     <sev supported='no'/>
Apr 11 15:16:54 user nova-compute[71229]:   </features>
Apr 11 15:16:54 user nova-compute[71229]: </domainCapabilities>
Apr 11 15:16:54 user nova-compute[71229]:  {{(pid=71229) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Apr 11 15:16:54 user nova-compute[71229]: <domainCapabilities>
Apr 11 15:16:54 user nova-compute[71229]:   <path>/usr/bin/qemu-system-i386</path>
Apr 11 15:16:54 user nova-compute[71229]:   <domain>kvm</domain>
Apr 11 15:16:54 user nova-compute[71229]:   <machine>pc-q35-jammy</machine>
Apr 11 15:16:54 user nova-compute[71229]:   <arch>i686</arch>
Apr 11 15:16:54 user nova-compute[71229]:   <vcpu max='288'/>
Apr 11 15:16:54 user nova-compute[71229]:   <iothreads supported='yes'/>
Apr 11 15:16:54 user nova-compute[71229]:   <os supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:     <enum name='firmware'/>
Apr 11 15:16:54 user nova-compute[71229]:     <loader supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 11 15:16:54 user nova-compute[71229]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 11 15:16:54 user nova-compute[71229]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 11 15:16:54 user nova-compute[71229]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 11 15:16:54 user nova-compute[71229]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='type'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>rom</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>pflash</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='readonly'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>yes</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>no</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='secure'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>no</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </loader>
Apr 11 15:16:54 user nova-compute[71229]:   </os>
Apr 11 15:16:54 user nova-compute[71229]:   <cpu>
Apr 11 15:16:54 user nova-compute[71229]:     <mode name='host-passthrough' supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='hostPassthroughMigratable'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>off</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </mode>
Apr 11 15:16:54 user nova-compute[71229]:     <mode name='maximum' supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='maximumMigratable'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>on</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>off</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </mode>
Apr 11 15:16:54 user nova-compute[71229]:     <mode name='host-model' supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <vendor>Intel</vendor>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='ss'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='vmx'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='pcid'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='hypervisor'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='arat'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='umip'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='md-clear'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='stibp'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='ssbd'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='ibpb'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='ibrs'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='amd-stibp'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='disable' name='erms'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='disable' name='lm'/>
Apr 11 15:16:54 user nova-compute[71229]:     </mode>
Apr 11 15:16:54 user nova-compute[71229]:     <mode name='custom' supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>qemu64</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>qemu32</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>phenom</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>pentium3</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>pentium2</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>pentium</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>n270</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>kvm64</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>kvm32</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>coreduo</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>core2duo</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>athlon</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Westmere-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Westmere</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Snowridge</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Skylake-Server</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Skylake-Client</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>SandyBridge</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Penryn</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Opteron_G5</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Opteron_G4</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Opteron_G3</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Opteron_G2</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Opteron_G1</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Nehalem-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Nehalem</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>IvyBridge</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Icelake-Server</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Haswell</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>EPYC-Rome</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>EPYC-Milan</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>EPYC</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Dhyana</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Cooperlake</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Conroe</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Broadwell</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>486</model>
Apr 11 15:16:54 user nova-compute[71229]:     </mode>
Apr 11 15:16:54 user nova-compute[71229]:   </cpu>
Apr 11 15:16:54 user nova-compute[71229]:   <memoryBacking supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:     <enum name='sourceType'>
Apr 11 15:16:54 user nova-compute[71229]:       <value>file</value>
Apr 11 15:16:54 user nova-compute[71229]:       <value>anonymous</value>
Apr 11 15:16:54 user nova-compute[71229]:       <value>memfd</value>
Apr 11 15:16:54 user nova-compute[71229]:     </enum>
Apr 11 15:16:54 user nova-compute[71229]:   </memoryBacking>
Apr 11 15:16:54 user nova-compute[71229]:   <devices>
Apr 11 15:16:54 user nova-compute[71229]:     <disk supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='diskDevice'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>disk</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>cdrom</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>floppy</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>lun</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='bus'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>fdc</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>scsi</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>usb</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>sata</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='model'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio-transitional</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio-non-transitional</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </disk>
Apr 11 15:16:54 user nova-compute[71229]:     <graphics supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='type'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>sdl</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>vnc</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>spice</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>egl-headless</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </graphics>
Apr 11 15:16:54 user nova-compute[71229]:     <video supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='modelType'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>vga</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>cirrus</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>vmvga</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>qxl</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>none</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>bochs</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>ramfb</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </video>
Apr 11 15:16:54 user nova-compute[71229]:     <hostdev supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='mode'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>subsystem</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='startupPolicy'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>default</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>mandatory</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>requisite</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>optional</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='subsysType'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>usb</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>pci</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>scsi</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='capsType'/>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='pciBackend'/>
Apr 11 15:16:54 user nova-compute[71229]:     </hostdev>
Apr 11 15:16:54 user nova-compute[71229]:     <rng supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='model'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio-transitional</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio-non-transitional</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='backendModel'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>random</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>egd</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>builtin</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </rng>
Apr 11 15:16:54 user nova-compute[71229]:     <filesystem supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='driverType'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>path</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>handle</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtiofs</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </filesystem>
Apr 11 15:16:54 user nova-compute[71229]:     <tpm supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='model'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>tpm-tis</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>tpm-crb</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='backendModel'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>passthrough</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>emulator</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </tpm>
Apr 11 15:16:54 user nova-compute[71229]:   </devices>
Apr 11 15:16:54 user nova-compute[71229]:   <features>
Apr 11 15:16:54 user nova-compute[71229]:     <gic supported='no'/>
Apr 11 15:16:54 user nova-compute[71229]:     <vmcoreinfo supported='yes'/>
Apr 11 15:16:54 user nova-compute[71229]:     <genid supported='yes'/>
Apr 11 15:16:54 user nova-compute[71229]:     <backingStoreInput supported='yes'/>
Apr 11 15:16:54 user nova-compute[71229]:     <backup supported='yes'/>
Apr 11 15:16:54 user nova-compute[71229]:     <sev supported='no'/>
Apr 11 15:16:54 user nova-compute[71229]:   </features>
Apr 11 15:16:54 user nova-compute[71229]: </domainCapabilities>
Apr 11 15:16:54 user nova-compute[71229]:  {{(pid=71229) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Apr 11 15:16:54 user nova-compute[71229]: <domainCapabilities>
Apr 11 15:16:54 user nova-compute[71229]:   <path>/usr/bin/qemu-system-i386</path>
Apr 11 15:16:54 user nova-compute[71229]:   <domain>kvm</domain>
Apr 11 15:16:54 user nova-compute[71229]:   <machine>pc-i440fx-jammy</machine>
Apr 11 15:16:54 user nova-compute[71229]:   <arch>i686</arch>
Apr 11 15:16:54 user nova-compute[71229]:   <vcpu max='255'/>
Apr 11 15:16:54 user nova-compute[71229]:   <iothreads supported='yes'/>
Apr 11 15:16:54 user nova-compute[71229]:   <os supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:     <enum name='firmware'/>
Apr 11 15:16:54 user nova-compute[71229]:     <loader supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 11 15:16:54 user nova-compute[71229]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 11 15:16:54 user nova-compute[71229]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 11 15:16:54 user nova-compute[71229]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 11 15:16:54 user nova-compute[71229]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='type'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>rom</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>pflash</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='readonly'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>yes</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>no</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='secure'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>no</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </loader>
Apr 11 15:16:54 user nova-compute[71229]:   </os>
Apr 11 15:16:54 user nova-compute[71229]:   <cpu>
Apr 11 15:16:54 user nova-compute[71229]:     <mode name='host-passthrough' supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='hostPassthroughMigratable'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>off</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </mode>
Apr 11 15:16:54 user nova-compute[71229]:     <mode name='maximum' supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='maximumMigratable'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>on</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>off</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </mode>
Apr 11 15:16:54 user nova-compute[71229]:     <mode name='host-model' supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <vendor>Intel</vendor>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='ss'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='vmx'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='pcid'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='hypervisor'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='arat'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='umip'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='md-clear'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='stibp'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='ssbd'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='ibpb'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='ibrs'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='amd-stibp'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='disable' name='erms'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='disable' name='lm'/>
Apr 11 15:16:54 user nova-compute[71229]:     </mode>
Apr 11 15:16:54 user nova-compute[71229]:     <mode name='custom' supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>qemu64</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>qemu32</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>phenom</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>pentium3</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>pentium2</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>pentium</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>n270</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>kvm64</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>kvm32</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>coreduo</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>core2duo</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>athlon</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Westmere-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Westmere</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Snowridge</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Skylake-Server</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Skylake-Client</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>SandyBridge</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Penryn</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Opteron_G5</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Opteron_G4</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Opteron_G3</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Opteron_G2</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Opteron_G1</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Nehalem-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Nehalem</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>IvyBridge</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Icelake-Server</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Haswell</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>EPYC-Rome</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>EPYC-Milan</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>EPYC</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Dhyana</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Cooperlake</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Conroe</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Broadwell</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>486</model>
Apr 11 15:16:54 user nova-compute[71229]:     </mode>
Apr 11 15:16:54 user nova-compute[71229]:   </cpu>
Apr 11 15:16:54 user nova-compute[71229]:   <memoryBacking supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:     <enum name='sourceType'>
Apr 11 15:16:54 user nova-compute[71229]:       <value>file</value>
Apr 11 15:16:54 user nova-compute[71229]:       <value>anonymous</value>
Apr 11 15:16:54 user nova-compute[71229]:       <value>memfd</value>
Apr 11 15:16:54 user nova-compute[71229]:     </enum>
Apr 11 15:16:54 user nova-compute[71229]:   </memoryBacking>
Apr 11 15:16:54 user nova-compute[71229]:   <devices>
Apr 11 15:16:54 user nova-compute[71229]:     <disk supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='diskDevice'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>disk</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>cdrom</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>floppy</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>lun</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='bus'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>ide</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>fdc</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>scsi</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>usb</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>sata</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='model'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio-transitional</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio-non-transitional</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </disk>
Apr 11 15:16:54 user nova-compute[71229]:     <graphics supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='type'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>sdl</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>vnc</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>spice</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>egl-headless</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </graphics>
Apr 11 15:16:54 user nova-compute[71229]:     <video supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='modelType'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>vga</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>cirrus</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>vmvga</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>qxl</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>none</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>bochs</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>ramfb</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </video>
Apr 11 15:16:54 user nova-compute[71229]:     <hostdev supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='mode'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>subsystem</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='startupPolicy'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>default</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>mandatory</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>requisite</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>optional</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='subsysType'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>usb</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>pci</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>scsi</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='capsType'/>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='pciBackend'/>
Apr 11 15:16:54 user nova-compute[71229]:     </hostdev>
Apr 11 15:16:54 user nova-compute[71229]:     <rng supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='model'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio-transitional</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio-non-transitional</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='backendModel'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>random</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>egd</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>builtin</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </rng>
Apr 11 15:16:54 user nova-compute[71229]:     <filesystem supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='driverType'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>path</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>handle</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtiofs</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </filesystem>
Apr 11 15:16:54 user nova-compute[71229]:     <tpm supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='model'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>tpm-tis</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>tpm-crb</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='backendModel'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>passthrough</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>emulator</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </tpm>
Apr 11 15:16:54 user nova-compute[71229]:   </devices>
Apr 11 15:16:54 user nova-compute[71229]:   <features>
Apr 11 15:16:54 user nova-compute[71229]:     <gic supported='no'/>
Apr 11 15:16:54 user nova-compute[71229]:     <vmcoreinfo supported='yes'/>
Apr 11 15:16:54 user nova-compute[71229]:     <genid supported='yes'/>
Apr 11 15:16:54 user nova-compute[71229]:     <backingStoreInput supported='yes'/>
Apr 11 15:16:54 user nova-compute[71229]:     <backup supported='yes'/>
Apr 11 15:16:54 user nova-compute[71229]:     <sev supported='no'/>
Apr 11 15:16:54 user nova-compute[71229]:   </features>
Apr 11 15:16:54 user nova-compute[71229]: </domainCapabilities>
Apr 11 15:16:54 user nova-compute[71229]:  {{(pid=71229) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Apr 11 15:16:54 user nova-compute[71229]: <domainCapabilities>
Apr 11 15:16:54 user nova-compute[71229]:   <path>/usr/bin/qemu-system-i386</path>
Apr 11 15:16:54 user nova-compute[71229]:   <domain>kvm</domain>
Apr 11 15:16:54 user nova-compute[71229]:   <machine>pc-i440fx-6.2</machine>
Apr 11 15:16:54 user nova-compute[71229]:   <arch>i686</arch>
Apr 11 15:16:54 user nova-compute[71229]:   <vcpu max='255'/>
Apr 11 15:16:54 user nova-compute[71229]:   <iothreads supported='yes'/>
Apr 11 15:16:54 user nova-compute[71229]:   <os supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:     <enum name='firmware'/>
Apr 11 15:16:54 user nova-compute[71229]:     <loader supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 11 15:16:54 user nova-compute[71229]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 11 15:16:54 user nova-compute[71229]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 11 15:16:54 user nova-compute[71229]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 11 15:16:54 user nova-compute[71229]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='type'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>rom</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>pflash</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='readonly'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>yes</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>no</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='secure'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>no</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </loader>
Apr 11 15:16:54 user nova-compute[71229]:   </os>
Apr 11 15:16:54 user nova-compute[71229]:   <cpu>
Apr 11 15:16:54 user nova-compute[71229]:     <mode name='host-passthrough' supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='hostPassthroughMigratable'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>off</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </mode>
Apr 11 15:16:54 user nova-compute[71229]:     <mode name='maximum' supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='maximumMigratable'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>on</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>off</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </mode>
Apr 11 15:16:54 user nova-compute[71229]:     <mode name='host-model' supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <vendor>Intel</vendor>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='ss'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='vmx'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='pcid'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='hypervisor'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='arat'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='umip'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='md-clear'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='stibp'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='ssbd'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='ibpb'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='ibrs'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='amd-stibp'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='disable' name='erms'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='disable' name='lm'/>
Apr 11 15:16:54 user nova-compute[71229]:     </mode>
Apr 11 15:16:54 user nova-compute[71229]:     <mode name='custom' supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>qemu64</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>qemu32</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>phenom</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>pentium3</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>pentium2</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>pentium</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>n270</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>kvm64</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>kvm32</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>coreduo</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>core2duo</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>athlon</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Westmere-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Westmere</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Snowridge</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Skylake-Server</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Skylake-Client</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>SandyBridge</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Penryn</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Opteron_G5</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Opteron_G4</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Opteron_G3</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Opteron_G2</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Opteron_G1</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Nehalem-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Nehalem</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>IvyBridge</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Icelake-Server</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Haswell</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>EPYC-Rome</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>EPYC-Milan</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>EPYC</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Dhyana</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Cooperlake</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Conroe</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Broadwell</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>486</model>
Apr 11 15:16:54 user nova-compute[71229]:     </mode>
Apr 11 15:16:54 user nova-compute[71229]:   </cpu>
Apr 11 15:16:54 user nova-compute[71229]:   <memoryBacking supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:     <enum name='sourceType'>
Apr 11 15:16:54 user nova-compute[71229]:       <value>file</value>
Apr 11 15:16:54 user nova-compute[71229]:       <value>anonymous</value>
Apr 11 15:16:54 user nova-compute[71229]:       <value>memfd</value>
Apr 11 15:16:54 user nova-compute[71229]:     </enum>
Apr 11 15:16:54 user nova-compute[71229]:   </memoryBacking>
Apr 11 15:16:54 user nova-compute[71229]:   <devices>
Apr 11 15:16:54 user nova-compute[71229]:     <disk supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='diskDevice'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>disk</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>cdrom</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>floppy</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>lun</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='bus'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>ide</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>fdc</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>scsi</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>usb</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>sata</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='model'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio-transitional</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio-non-transitional</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </disk>
Apr 11 15:16:54 user nova-compute[71229]:     <graphics supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='type'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>sdl</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>vnc</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>spice</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>egl-headless</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </graphics>
Apr 11 15:16:54 user nova-compute[71229]:     <video supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='modelType'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>vga</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>cirrus</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>vmvga</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>qxl</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>none</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>bochs</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>ramfb</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </video>
Apr 11 15:16:54 user nova-compute[71229]:     <hostdev supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='mode'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>subsystem</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='startupPolicy'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>default</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>mandatory</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>requisite</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>optional</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='subsysType'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>usb</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>pci</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>scsi</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='capsType'/>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='pciBackend'/>
Apr 11 15:16:54 user nova-compute[71229]:     </hostdev>
Apr 11 15:16:54 user nova-compute[71229]:     <rng supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='model'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio-transitional</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio-non-transitional</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='backendModel'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>random</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>egd</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>builtin</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </rng>
Apr 11 15:16:54 user nova-compute[71229]:     <filesystem supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='driverType'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>path</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>handle</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtiofs</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </filesystem>
Apr 11 15:16:54 user nova-compute[71229]:     <tpm supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='model'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>tpm-tis</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>tpm-crb</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='backendModel'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>passthrough</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>emulator</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </tpm>
Apr 11 15:16:54 user nova-compute[71229]:   </devices>
Apr 11 15:16:54 user nova-compute[71229]:   <features>
Apr 11 15:16:54 user nova-compute[71229]:     <gic supported='no'/>
Apr 11 15:16:54 user nova-compute[71229]:     <vmcoreinfo supported='yes'/>
Apr 11 15:16:54 user nova-compute[71229]:     <genid supported='yes'/>
Apr 11 15:16:54 user nova-compute[71229]:     <backingStoreInput supported='yes'/>
Apr 11 15:16:54 user nova-compute[71229]:     <backup supported='yes'/>
Apr 11 15:16:54 user nova-compute[71229]:     <sev supported='no'/>
Apr 11 15:16:54 user nova-compute[71229]:   </features>
Apr 11 15:16:54 user nova-compute[71229]: </domainCapabilities>
Apr 11 15:16:54 user nova-compute[71229]:  {{(pid=71229) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=71229) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=71229) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=71229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=71229) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=71229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=71229) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=71229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=71229) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=71229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=71229) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=71229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=71229) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=71229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=71229) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=71229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=71229) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=71229) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=71229) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=71229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=71229) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=71229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=71229) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=71229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=71229) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=71229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=71229) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=71229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=71229) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=71229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=71229) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=71229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu-q35', 'ubuntu', 'pc'} {{(pid=71229) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Apr 11 15:16:54 user nova-compute[71229]: <domainCapabilities>
Apr 11 15:16:54 user nova-compute[71229]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 11 15:16:54 user nova-compute[71229]:   <domain>kvm</domain>
Apr 11 15:16:54 user nova-compute[71229]:   <machine>pc-q35-6.2</machine>
Apr 11 15:16:54 user nova-compute[71229]:   <arch>x86_64</arch>
Apr 11 15:16:54 user nova-compute[71229]:   <vcpu max='288'/>
Apr 11 15:16:54 user nova-compute[71229]:   <iothreads supported='yes'/>
Apr 11 15:16:54 user nova-compute[71229]:   <os supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:     <enum name='firmware'>
Apr 11 15:16:54 user nova-compute[71229]:       <value>efi</value>
Apr 11 15:16:54 user nova-compute[71229]:     </enum>
Apr 11 15:16:54 user nova-compute[71229]:     <loader supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 11 15:16:54 user nova-compute[71229]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 11 15:16:54 user nova-compute[71229]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='type'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>rom</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>pflash</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='readonly'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>yes</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>no</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='secure'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>yes</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>no</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </loader>
Apr 11 15:16:54 user nova-compute[71229]:   </os>
Apr 11 15:16:54 user nova-compute[71229]:   <cpu>
Apr 11 15:16:54 user nova-compute[71229]:     <mode name='host-passthrough' supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='hostPassthroughMigratable'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>on</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>off</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </mode>
Apr 11 15:16:54 user nova-compute[71229]:     <mode name='maximum' supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='maximumMigratable'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>on</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>off</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </mode>
Apr 11 15:16:54 user nova-compute[71229]:     <mode name='host-model' supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <vendor>Intel</vendor>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='ss'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='vmx'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='pcid'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='hypervisor'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='arat'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='umip'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='md-clear'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='stibp'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='ssbd'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='invtsc'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='ibpb'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='ibrs'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='amd-stibp'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='rsba'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='pschange-mc-no'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='disable' name='erms'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 15:16:54 user nova-compute[71229]:     </mode>
Apr 11 15:16:54 user nova-compute[71229]:     <mode name='custom' supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>qemu64</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>qemu32</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>phenom</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>pentium3</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>pentium2</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>pentium</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>n270</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>kvm64</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>kvm32</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>coreduo</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>core2duo</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>athlon</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>Westmere-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>Westmere</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Snowridge</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Skylake-Server</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Skylake-Client</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>SandyBridge</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>Penryn</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Opteron_G5</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Opteron_G4</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Opteron_G3</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Opteron_G2</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>Opteron_G1</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>Nehalem</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>IvyBridge</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Icelake-Server</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Haswell</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>EPYC-Rome</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>EPYC-Milan</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>EPYC</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Dhyana</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Cooperlake</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>Conroe</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Broadwell</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>486</model>
Apr 11 15:16:54 user nova-compute[71229]:     </mode>
Apr 11 15:16:54 user nova-compute[71229]:   </cpu>
Apr 11 15:16:54 user nova-compute[71229]:   <memoryBacking supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:     <enum name='sourceType'>
Apr 11 15:16:54 user nova-compute[71229]:       <value>file</value>
Apr 11 15:16:54 user nova-compute[71229]:       <value>anonymous</value>
Apr 11 15:16:54 user nova-compute[71229]:       <value>memfd</value>
Apr 11 15:16:54 user nova-compute[71229]:     </enum>
Apr 11 15:16:54 user nova-compute[71229]:   </memoryBacking>
Apr 11 15:16:54 user nova-compute[71229]:   <devices>
Apr 11 15:16:54 user nova-compute[71229]:     <disk supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='diskDevice'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>disk</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>cdrom</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>floppy</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>lun</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='bus'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>fdc</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>scsi</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>usb</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>sata</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='model'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio-transitional</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio-non-transitional</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </disk>
Apr 11 15:16:54 user nova-compute[71229]:     <graphics supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='type'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>sdl</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>vnc</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>spice</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>egl-headless</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </graphics>
Apr 11 15:16:54 user nova-compute[71229]:     <video supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='modelType'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>vga</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>cirrus</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>vmvga</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>qxl</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>none</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>bochs</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>ramfb</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </video>
Apr 11 15:16:54 user nova-compute[71229]:     <hostdev supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='mode'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>subsystem</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='startupPolicy'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>default</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>mandatory</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>requisite</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>optional</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='subsysType'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>usb</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>pci</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>scsi</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='capsType'/>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='pciBackend'/>
Apr 11 15:16:54 user nova-compute[71229]:     </hostdev>
Apr 11 15:16:54 user nova-compute[71229]:     <rng supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='model'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio-transitional</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio-non-transitional</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='backendModel'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>random</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>egd</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>builtin</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </rng>
Apr 11 15:16:54 user nova-compute[71229]:     <filesystem supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='driverType'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>path</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>handle</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtiofs</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </filesystem>
Apr 11 15:16:54 user nova-compute[71229]:     <tpm supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='model'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>tpm-tis</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>tpm-crb</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='backendModel'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>passthrough</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>emulator</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </tpm>
Apr 11 15:16:54 user nova-compute[71229]:   </devices>
Apr 11 15:16:54 user nova-compute[71229]:   <features>
Apr 11 15:16:54 user nova-compute[71229]:     <gic supported='no'/>
Apr 11 15:16:54 user nova-compute[71229]:     <vmcoreinfo supported='yes'/>
Apr 11 15:16:54 user nova-compute[71229]:     <genid supported='yes'/>
Apr 11 15:16:54 user nova-compute[71229]:     <backingStoreInput supported='yes'/>
Apr 11 15:16:54 user nova-compute[71229]:     <backup supported='yes'/>
Apr 11 15:16:54 user nova-compute[71229]:     <sev supported='no'/>
Apr 11 15:16:54 user nova-compute[71229]:   </features>
Apr 11 15:16:54 user nova-compute[71229]: </domainCapabilities>
Apr 11 15:16:54 user nova-compute[71229]:  {{(pid=71229) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Apr 11 15:16:54 user nova-compute[71229]: <domainCapabilities>
Apr 11 15:16:54 user nova-compute[71229]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 11 15:16:54 user nova-compute[71229]:   <domain>kvm</domain>
Apr 11 15:16:54 user nova-compute[71229]:   <machine>pc-q35-jammy</machine>
Apr 11 15:16:54 user nova-compute[71229]:   <arch>x86_64</arch>
Apr 11 15:16:54 user nova-compute[71229]:   <vcpu max='288'/>
Apr 11 15:16:54 user nova-compute[71229]:   <iothreads supported='yes'/>
Apr 11 15:16:54 user nova-compute[71229]:   <os supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:     <enum name='firmware'>
Apr 11 15:16:54 user nova-compute[71229]:       <value>efi</value>
Apr 11 15:16:54 user nova-compute[71229]:     </enum>
Apr 11 15:16:54 user nova-compute[71229]:     <loader supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 11 15:16:54 user nova-compute[71229]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 11 15:16:54 user nova-compute[71229]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='type'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>rom</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>pflash</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='readonly'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>yes</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>no</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='secure'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>yes</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>no</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </loader>
Apr 11 15:16:54 user nova-compute[71229]:   </os>
Apr 11 15:16:54 user nova-compute[71229]:   <cpu>
Apr 11 15:16:54 user nova-compute[71229]:     <mode name='host-passthrough' supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='hostPassthroughMigratable'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>on</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>off</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </mode>
Apr 11 15:16:54 user nova-compute[71229]:     <mode name='maximum' supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='maximumMigratable'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>on</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>off</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </mode>
Apr 11 15:16:54 user nova-compute[71229]:     <mode name='host-model' supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <vendor>Intel</vendor>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='ss'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='vmx'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='pcid'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='hypervisor'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='arat'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='umip'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='md-clear'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='stibp'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='ssbd'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='invtsc'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='ibpb'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='ibrs'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='amd-stibp'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='rsba'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='pschange-mc-no'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='disable' name='erms'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 15:16:54 user nova-compute[71229]:     </mode>
Apr 11 15:16:54 user nova-compute[71229]:     <mode name='custom' supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>qemu64</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>qemu32</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>phenom</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>pentium3</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>pentium2</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>pentium</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>n270</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>kvm64</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>kvm32</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>coreduo</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>core2duo</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>athlon</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>Westmere-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>Westmere</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Snowridge</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Skylake-Server</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Skylake-Client</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>SandyBridge</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>Penryn</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Opteron_G5</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Opteron_G4</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Opteron_G3</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Opteron_G2</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>Opteron_G1</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>Nehalem</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>IvyBridge</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Icelake-Server</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Haswell</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>EPYC-Rome</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>EPYC-Milan</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>EPYC</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Dhyana</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Cooperlake</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>Conroe</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Broadwell</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>486</model>
Apr 11 15:16:54 user nova-compute[71229]:     </mode>
Apr 11 15:16:54 user nova-compute[71229]:   </cpu>
Apr 11 15:16:54 user nova-compute[71229]:   <memoryBacking supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:     <enum name='sourceType'>
Apr 11 15:16:54 user nova-compute[71229]:       <value>file</value>
Apr 11 15:16:54 user nova-compute[71229]:       <value>anonymous</value>
Apr 11 15:16:54 user nova-compute[71229]:       <value>memfd</value>
Apr 11 15:16:54 user nova-compute[71229]:     </enum>
Apr 11 15:16:54 user nova-compute[71229]:   </memoryBacking>
Apr 11 15:16:54 user nova-compute[71229]:   <devices>
Apr 11 15:16:54 user nova-compute[71229]:     <disk supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='diskDevice'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>disk</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>cdrom</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>floppy</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>lun</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='bus'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>fdc</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>scsi</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>usb</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>sata</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='model'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio-transitional</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio-non-transitional</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </disk>
Apr 11 15:16:54 user nova-compute[71229]:     <graphics supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='type'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>sdl</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>vnc</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>spice</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>egl-headless</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </graphics>
Apr 11 15:16:54 user nova-compute[71229]:     <video supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='modelType'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>vga</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>cirrus</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>vmvga</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>qxl</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>none</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>bochs</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>ramfb</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </video>
Apr 11 15:16:54 user nova-compute[71229]:     <hostdev supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='mode'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>subsystem</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='startupPolicy'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>default</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>mandatory</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>requisite</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>optional</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='subsysType'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>usb</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>pci</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>scsi</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='capsType'/>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='pciBackend'/>
Apr 11 15:16:54 user nova-compute[71229]:     </hostdev>
Apr 11 15:16:54 user nova-compute[71229]:     <rng supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='model'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio-transitional</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio-non-transitional</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='backendModel'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>random</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>egd</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>builtin</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </rng>
Apr 11 15:16:54 user nova-compute[71229]:     <filesystem supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='driverType'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>path</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>handle</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtiofs</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </filesystem>
Apr 11 15:16:54 user nova-compute[71229]:     <tpm supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='model'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>tpm-tis</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>tpm-crb</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='backendModel'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>passthrough</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>emulator</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </tpm>
Apr 11 15:16:54 user nova-compute[71229]:   </devices>
Apr 11 15:16:54 user nova-compute[71229]:   <features>
Apr 11 15:16:54 user nova-compute[71229]:     <gic supported='no'/>
Apr 11 15:16:54 user nova-compute[71229]:     <vmcoreinfo supported='yes'/>
Apr 11 15:16:54 user nova-compute[71229]:     <genid supported='yes'/>
Apr 11 15:16:54 user nova-compute[71229]:     <backingStoreInput supported='yes'/>
Apr 11 15:16:54 user nova-compute[71229]:     <backup supported='yes'/>
Apr 11 15:16:54 user nova-compute[71229]:     <sev supported='no'/>
Apr 11 15:16:54 user nova-compute[71229]:   </features>
Apr 11 15:16:54 user nova-compute[71229]: </domainCapabilities>
Apr 11 15:16:54 user nova-compute[71229]:  {{(pid=71229) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Apr 11 15:16:54 user nova-compute[71229]: <domainCapabilities>
Apr 11 15:16:54 user nova-compute[71229]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 11 15:16:54 user nova-compute[71229]:   <domain>kvm</domain>
Apr 11 15:16:54 user nova-compute[71229]:   <machine>pc-i440fx-jammy</machine>
Apr 11 15:16:54 user nova-compute[71229]:   <arch>x86_64</arch>
Apr 11 15:16:54 user nova-compute[71229]:   <vcpu max='255'/>
Apr 11 15:16:54 user nova-compute[71229]:   <iothreads supported='yes'/>
Apr 11 15:16:54 user nova-compute[71229]:   <os supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:     <enum name='firmware'>
Apr 11 15:16:54 user nova-compute[71229]:       <value>efi</value>
Apr 11 15:16:54 user nova-compute[71229]:     </enum>
Apr 11 15:16:54 user nova-compute[71229]:     <loader supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='type'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>rom</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>pflash</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='readonly'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>yes</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>no</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='secure'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>no</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </loader>
Apr 11 15:16:54 user nova-compute[71229]:   </os>
Apr 11 15:16:54 user nova-compute[71229]:   <cpu>
Apr 11 15:16:54 user nova-compute[71229]:     <mode name='host-passthrough' supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='hostPassthroughMigratable'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>on</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>off</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </mode>
Apr 11 15:16:54 user nova-compute[71229]:     <mode name='maximum' supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='maximumMigratable'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>on</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>off</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </mode>
Apr 11 15:16:54 user nova-compute[71229]:     <mode name='host-model' supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <vendor>Intel</vendor>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='ss'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='vmx'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='pcid'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='hypervisor'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='arat'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='umip'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='md-clear'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='stibp'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='ssbd'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='invtsc'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='ibpb'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='ibrs'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='amd-stibp'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='rsba'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='pschange-mc-no'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='disable' name='erms'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 15:16:54 user nova-compute[71229]:     </mode>
Apr 11 15:16:54 user nova-compute[71229]:     <mode name='custom' supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>qemu64</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>qemu32</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>phenom</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>pentium3</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>pentium2</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>pentium</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>n270</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>kvm64</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>kvm32</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>coreduo</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>core2duo</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>athlon</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>Westmere-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>Westmere</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Snowridge</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Skylake-Server</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Skylake-Client</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>SandyBridge</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>Penryn</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Opteron_G5</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Opteron_G4</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Opteron_G3</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Opteron_G2</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>Opteron_G1</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>Nehalem</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>IvyBridge</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Icelake-Server</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Haswell</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>EPYC-Rome</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>EPYC-Milan</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>EPYC</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Dhyana</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Cooperlake</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>Conroe</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Broadwell</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>486</model>
Apr 11 15:16:54 user nova-compute[71229]:     </mode>
Apr 11 15:16:54 user nova-compute[71229]:   </cpu>
Apr 11 15:16:54 user nova-compute[71229]:   <memoryBacking supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:     <enum name='sourceType'>
Apr 11 15:16:54 user nova-compute[71229]:       <value>file</value>
Apr 11 15:16:54 user nova-compute[71229]:       <value>anonymous</value>
Apr 11 15:16:54 user nova-compute[71229]:       <value>memfd</value>
Apr 11 15:16:54 user nova-compute[71229]:     </enum>
Apr 11 15:16:54 user nova-compute[71229]:   </memoryBacking>
Apr 11 15:16:54 user nova-compute[71229]:   <devices>
Apr 11 15:16:54 user nova-compute[71229]:     <disk supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='diskDevice'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>disk</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>cdrom</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>floppy</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>lun</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='bus'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>ide</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>fdc</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>scsi</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>usb</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>sata</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='model'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio-transitional</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio-non-transitional</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </disk>
Apr 11 15:16:54 user nova-compute[71229]:     <graphics supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='type'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>sdl</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>vnc</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>spice</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>egl-headless</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </graphics>
Apr 11 15:16:54 user nova-compute[71229]:     <video supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='modelType'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>vga</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>cirrus</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>vmvga</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>qxl</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>none</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>bochs</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>ramfb</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </video>
Apr 11 15:16:54 user nova-compute[71229]:     <hostdev supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='mode'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>subsystem</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='startupPolicy'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>default</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>mandatory</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>requisite</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>optional</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='subsysType'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>usb</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>pci</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>scsi</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='capsType'/>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='pciBackend'/>
Apr 11 15:16:54 user nova-compute[71229]:     </hostdev>
Apr 11 15:16:54 user nova-compute[71229]:     <rng supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='model'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio-transitional</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio-non-transitional</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='backendModel'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>random</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>egd</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>builtin</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </rng>
Apr 11 15:16:54 user nova-compute[71229]:     <filesystem supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='driverType'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>path</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>handle</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtiofs</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </filesystem>
Apr 11 15:16:54 user nova-compute[71229]:     <tpm supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='model'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>tpm-tis</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>tpm-crb</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='backendModel'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>passthrough</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>emulator</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </tpm>
Apr 11 15:16:54 user nova-compute[71229]:   </devices>
Apr 11 15:16:54 user nova-compute[71229]:   <features>
Apr 11 15:16:54 user nova-compute[71229]:     <gic supported='no'/>
Apr 11 15:16:54 user nova-compute[71229]:     <vmcoreinfo supported='yes'/>
Apr 11 15:16:54 user nova-compute[71229]:     <genid supported='yes'/>
Apr 11 15:16:54 user nova-compute[71229]:     <backingStoreInput supported='yes'/>
Apr 11 15:16:54 user nova-compute[71229]:     <backup supported='yes'/>
Apr 11 15:16:54 user nova-compute[71229]:     <sev supported='no'/>
Apr 11 15:16:54 user nova-compute[71229]:   </features>
Apr 11 15:16:54 user nova-compute[71229]: </domainCapabilities>
Apr 11 15:16:54 user nova-compute[71229]:  {{(pid=71229) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Apr 11 15:16:54 user nova-compute[71229]: <domainCapabilities>
Apr 11 15:16:54 user nova-compute[71229]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 11 15:16:54 user nova-compute[71229]:   <domain>kvm</domain>
Apr 11 15:16:54 user nova-compute[71229]:   <machine>pc-i440fx-6.2</machine>
Apr 11 15:16:54 user nova-compute[71229]:   <arch>x86_64</arch>
Apr 11 15:16:54 user nova-compute[71229]:   <vcpu max='255'/>
Apr 11 15:16:54 user nova-compute[71229]:   <iothreads supported='yes'/>
Apr 11 15:16:54 user nova-compute[71229]:   <os supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:     <enum name='firmware'>
Apr 11 15:16:54 user nova-compute[71229]:       <value>efi</value>
Apr 11 15:16:54 user nova-compute[71229]:     </enum>
Apr 11 15:16:54 user nova-compute[71229]:     <loader supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='type'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>rom</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>pflash</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='readonly'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>yes</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>no</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='secure'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>no</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </loader>
Apr 11 15:16:54 user nova-compute[71229]:   </os>
Apr 11 15:16:54 user nova-compute[71229]:   <cpu>
Apr 11 15:16:54 user nova-compute[71229]:     <mode name='host-passthrough' supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='hostPassthroughMigratable'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>on</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>off</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </mode>
Apr 11 15:16:54 user nova-compute[71229]:     <mode name='maximum' supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='maximumMigratable'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>on</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>off</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </mode>
Apr 11 15:16:54 user nova-compute[71229]:     <mode name='host-model' supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <vendor>Intel</vendor>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='ss'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='vmx'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='pcid'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='hypervisor'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='arat'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='umip'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='md-clear'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='stibp'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='ssbd'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='invtsc'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='ibpb'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='ibrs'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='amd-stibp'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='rsba'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='require' name='pschange-mc-no'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='disable' name='erms'/>
Apr 11 15:16:54 user nova-compute[71229]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 15:16:54 user nova-compute[71229]:     </mode>
Apr 11 15:16:54 user nova-compute[71229]:     <mode name='custom' supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>qemu64</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>qemu32</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>phenom</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>pentium3</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>pentium2</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>pentium</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>n270</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>kvm64</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>kvm32</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>coreduo</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>core2duo</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>athlon</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>Westmere-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>Westmere</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Snowridge</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Skylake-Server</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Skylake-Client</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>SandyBridge</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>Penryn</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Opteron_G5</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Opteron_G4</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Opteron_G3</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Opteron_G2</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>Opteron_G1</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>Nehalem</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>IvyBridge</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Icelake-Server</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Haswell</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>EPYC-Rome</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>EPYC-Milan</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>EPYC</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Dhyana</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Cooperlake</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>Conroe</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='no'>Broadwell</model>
Apr 11 15:16:54 user nova-compute[71229]:       <model usable='yes'>486</model>
Apr 11 15:16:54 user nova-compute[71229]:     </mode>
Apr 11 15:16:54 user nova-compute[71229]:   </cpu>
Apr 11 15:16:54 user nova-compute[71229]:   <memoryBacking supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:     <enum name='sourceType'>
Apr 11 15:16:54 user nova-compute[71229]:       <value>file</value>
Apr 11 15:16:54 user nova-compute[71229]:       <value>anonymous</value>
Apr 11 15:16:54 user nova-compute[71229]:       <value>memfd</value>
Apr 11 15:16:54 user nova-compute[71229]:     </enum>
Apr 11 15:16:54 user nova-compute[71229]:   </memoryBacking>
Apr 11 15:16:54 user nova-compute[71229]:   <devices>
Apr 11 15:16:54 user nova-compute[71229]:     <disk supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='diskDevice'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>disk</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>cdrom</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>floppy</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>lun</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='bus'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>ide</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>fdc</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>scsi</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>usb</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>sata</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='model'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio-transitional</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio-non-transitional</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </disk>
Apr 11 15:16:54 user nova-compute[71229]:     <graphics supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='type'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>sdl</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>vnc</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>spice</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>egl-headless</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </graphics>
Apr 11 15:16:54 user nova-compute[71229]:     <video supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='modelType'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>vga</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>cirrus</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>vmvga</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>qxl</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>none</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>bochs</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>ramfb</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </video>
Apr 11 15:16:54 user nova-compute[71229]:     <hostdev supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='mode'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>subsystem</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='startupPolicy'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>default</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>mandatory</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>requisite</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>optional</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='subsysType'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>usb</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>pci</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>scsi</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='capsType'/>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='pciBackend'/>
Apr 11 15:16:54 user nova-compute[71229]:     </hostdev>
Apr 11 15:16:54 user nova-compute[71229]:     <rng supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='model'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio-transitional</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtio-non-transitional</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='backendModel'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>random</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>egd</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>builtin</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </rng>
Apr 11 15:16:54 user nova-compute[71229]:     <filesystem supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='driverType'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>path</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>handle</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>virtiofs</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </filesystem>
Apr 11 15:16:54 user nova-compute[71229]:     <tpm supported='yes'>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='model'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>tpm-tis</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>tpm-crb</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:       <enum name='backendModel'>
Apr 11 15:16:54 user nova-compute[71229]:         <value>passthrough</value>
Apr 11 15:16:54 user nova-compute[71229]:         <value>emulator</value>
Apr 11 15:16:54 user nova-compute[71229]:       </enum>
Apr 11 15:16:54 user nova-compute[71229]:     </tpm>
Apr 11 15:16:54 user nova-compute[71229]:   </devices>
Apr 11 15:16:54 user nova-compute[71229]:   <features>
Apr 11 15:16:54 user nova-compute[71229]:     <gic supported='no'/>
Apr 11 15:16:54 user nova-compute[71229]:     <vmcoreinfo supported='yes'/>
Apr 11 15:16:54 user nova-compute[71229]:     <genid supported='yes'/>
Apr 11 15:16:54 user nova-compute[71229]:     <backingStoreInput supported='yes'/>
Apr 11 15:16:54 user nova-compute[71229]:     <backup supported='yes'/>
Apr 11 15:16:54 user nova-compute[71229]:     <sev supported='no'/>
Apr 11 15:16:54 user nova-compute[71229]:   </features>
Apr 11 15:16:54 user nova-compute[71229]: </domainCapabilities>
Apr 11 15:16:54 user nova-compute[71229]:  {{(pid=71229) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=71229) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=71229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=71229) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=71229) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Checking secure boot support for host arch (x86_64) {{(pid=71229) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 11 15:16:54 user nova-compute[71229]: INFO nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Secure Boot support detected
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] cpu compare xml: <cpu match="exact">
Apr 11 15:16:54 user nova-compute[71229]:   <model>Nehalem</model>
Apr 11 15:16:54 user nova-compute[71229]: </cpu>
Apr 11 15:16:54 user nova-compute[71229]:  {{(pid=71229) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:9996}}
Apr 11 15:16:54 user nova-compute[71229]: INFO nova.virt.node [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Generated node identity 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de
Apr 11 15:16:54 user nova-compute[71229]: INFO nova.virt.node [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Wrote node identity 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de to /opt/stack/data/nova/compute_id
Apr 11 15:16:54 user nova-compute[71229]: WARNING nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Compute nodes ['116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Apr 11 15:16:54 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Apr 11 15:16:54 user nova-compute[71229]: WARNING nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 11 15:16:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:16:54 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 15:16:55 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:16:55 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:16:55 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Hypervisor/Node resource view: name=user free_ram=10881MB free_disk=26.90643310546875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 15:16:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:16:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:16:55 user nova-compute[71229]: WARNING nova.compute.resource_tracker [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] No compute node record for user:116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de could not be found.
Apr 11 15:16:55 user nova-compute[71229]: INFO nova.compute.resource_tracker [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Compute node record created for user:user with uuid: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de
Apr 11 15:16:55 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 15:16:55 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 15:16:55 user nova-compute[71229]: INFO nova.scheduler.client.report [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [req-09411deb-27eb-4606-8f20-e5ddc7c30318] Created resource provider record via placement API for resource provider with UUID 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de and name user.
Apr 11 15:16:55 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=71229) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1766}}
Apr 11 15:16:55 user nova-compute[71229]: INFO nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] kernel doesn't support AMD SEV
Apr 11 15:16:55 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Updating inventory in ProviderTree for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de with inventory: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 15:16:55 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:16:55 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Libvirt baseline CPU <cpu>
Apr 11 15:16:55 user nova-compute[71229]:   <arch>x86_64</arch>
Apr 11 15:16:55 user nova-compute[71229]:   <model>Nehalem</model>
Apr 11 15:16:55 user nova-compute[71229]:   <vendor>Intel</vendor>
Apr 11 15:16:55 user nova-compute[71229]:   <topology sockets="6" cores="1" threads="1"/>
Apr 11 15:16:55 user nova-compute[71229]: </cpu>
Apr 11 15:16:55 user nova-compute[71229]:  {{(pid=71229) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12486}}
Apr 11 15:16:55 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Updated inventory for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Apr 11 15:16:55 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Updating resource provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de generation from 0 to 1 during operation: update_inventory {{(pid=71229) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 11 15:16:55 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Updating inventory in ProviderTree for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de with inventory: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 15:16:55 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Updating resource provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de generation from 1 to 2 during operation: update_traits {{(pid=71229) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 11 15:16:55 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 15:16:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.679s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:16:55 user nova-compute[71229]: DEBUG nova.service [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Creating RPC server for service compute {{(pid=71229) start /opt/stack/nova/nova/service.py:182}}
Apr 11 15:16:55 user nova-compute[71229]: DEBUG nova.service [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Join ServiceGroup membership for this service compute {{(pid=71229) start /opt/stack/nova/nova/service.py:199}}
Apr 11 15:16:55 user nova-compute[71229]: DEBUG nova.servicegroup.drivers.db [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=71229) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Apr 11 15:17:31 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:17:31 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:17:46 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:17:46 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:17:46 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 15:17:46 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Rebuilding the list of instances to heal {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 15:17:46 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Didn't find any instances for network info cache update. {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 15:17:46 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:17:46 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:17:46 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:17:46 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:17:46 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:17:46 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:17:46 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 15:17:46 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:17:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:17:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:17:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:17:47 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 15:17:47 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:17:47 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:17:47 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=10262MB free_disk=26.820281982421875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 15:17:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:17:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:17:47 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 15:17:47 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 15:17:47 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:17:47 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:17:47 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 15:17:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.106s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:18:47 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:18:47 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:18:47 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:18:47 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 15:18:47 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Rebuilding the list of instances to heal {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 15:18:47 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Didn't find any instances for network info cache update. {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 15:18:47 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:18:47 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:18:47 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:18:47 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:18:47 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:18:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:18:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:18:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:18:47 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 15:18:48 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:18:48 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:18:48 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=10230MB free_disk=26.86661148071289GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 15:18:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:18:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:18:48 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 15:18:48 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 15:18:48 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:18:48 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:18:48 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 15:18:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:18:49 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:18:49 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:18:49 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 15:19:46 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:19:46 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:19:46 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 15:19:46 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Rebuilding the list of instances to heal {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 15:19:46 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Didn't find any instances for network info cache update. {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 15:19:47 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:19:47 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:19:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:19:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:19:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:19:47 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 15:19:48 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:19:48 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:19:48 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=10191MB free_disk=26.64250946044922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 15:19:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:19:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:19:48 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 15:19:48 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 15:19:48 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:19:48 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:19:48 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 15:19:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:19:49 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:19:49 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:19:49 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:19:49 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:19:49 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:19:49 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 15:20:47 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:20:48 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:20:48 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 15:20:48 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Rebuilding the list of instances to heal {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 15:20:48 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Didn't find any instances for network info cache update. {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 15:20:49 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:20:49 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:20:49 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:20:49 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:20:49 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:20:49 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:20:49 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 15:20:49 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:20:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:20:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:20:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:20:49 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 15:20:50 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:20:50 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:20:50 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=9460MB free_disk=26.663658142089844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 15:20:50 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:20:50 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:20:50 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 15:20:50 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 15:20:50 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:20:50 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:20:50 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 15:20:50 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.136s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:20:51 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:20:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "de1a45fd-27be-4438-80a4-2f3a100643c9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:20:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "de1a45fd-27be-4438-80a4-2f3a100643c9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:20:55 user nova-compute[71229]: DEBUG nova.compute.manager [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Starting instance... {{(pid=71229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 15:20:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:20:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:20:55 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 15:20:55 user nova-compute[71229]: INFO nova.compute.claims [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Claim successful on node user
Apr 11 15:20:56 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:20:56 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:20:56 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.373s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:20:56 user nova-compute[71229]: DEBUG nova.compute.manager [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Start building networks asynchronously for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 15:20:56 user nova-compute[71229]: DEBUG nova.compute.manager [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Allocating IP information in the background. {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 15:20:56 user nova-compute[71229]: DEBUG nova.network.neutron [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] allocate_for_instance() {{(pid=71229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 15:20:56 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 15:20:56 user nova-compute[71229]: DEBUG nova.compute.manager [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Start building block device mappings for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 15:20:56 user nova-compute[71229]: DEBUG nova.compute.manager [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Start spawning the instance on the hypervisor. {{(pid=71229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 15:20:56 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Creating instance directory {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 15:20:56 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Creating image(s)
Apr 11 15:20:56 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "/opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:20:56 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "/opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:20:56 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "/opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:20:56 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:20:56 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:20:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a.part --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:20:57 user nova-compute[71229]: DEBUG nova.policy [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71229) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 15:20:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a.part --force-share --output=json" returned: 0 in 0.238s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:20:57 user nova-compute[71229]: DEBUG nova.virt.images [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] 52fe638c-5ada-47d5-b376-233bfa808a37 was qcow2, converting to raw {{(pid=71229) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 15:20:57 user nova-compute[71229]: DEBUG nova.privsep.utils [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71229) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 15:20:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a.part /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a.converted {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:20:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a.part /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a.converted" returned: 0 in 0.214s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:20:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a.converted --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:20:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a.converted --force-share --output=json" returned: 0 in 0.136s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:20:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.367s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:20:58 user nova-compute[71229]: INFO oslo.privsep.daemon [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpgpma7j1e/privsep.sock']
Apr 11 15:20:58 user sudo[79954]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpgpma7j1e/privsep.sock
Apr 11 15:20:58 user sudo[79954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 11 15:20:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Acquiring lock "074896e5-8065-4b4a-b61a-653bc67718db" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:20:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "074896e5-8065-4b4a-b61a-653bc67718db" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:20:58 user nova-compute[71229]: DEBUG nova.compute.manager [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Starting instance... {{(pid=71229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 15:20:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:20:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:20:58 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 15:20:58 user nova-compute[71229]: INFO nova.compute.claims [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Claim successful on node user
Apr 11 15:20:58 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:20:58 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:20:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.271s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:20:58 user nova-compute[71229]: DEBUG nova.compute.manager [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Start building networks asynchronously for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 15:20:58 user nova-compute[71229]: DEBUG nova.compute.manager [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Allocating IP information in the background. {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 15:20:58 user nova-compute[71229]: DEBUG nova.network.neutron [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] allocate_for_instance() {{(pid=71229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 15:20:58 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 15:20:58 user nova-compute[71229]: DEBUG nova.compute.manager [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Start building block device mappings for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 15:20:58 user nova-compute[71229]: DEBUG nova.compute.manager [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Start spawning the instance on the hypervisor. {{(pid=71229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 15:20:58 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Creating instance directory {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 15:20:58 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Creating image(s)
Apr 11 15:20:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Acquiring lock "/opt/stack/data/nova/instances/074896e5-8065-4b4a-b61a-653bc67718db/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:20:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "/opt/stack/data/nova/instances/074896e5-8065-4b4a-b61a-653bc67718db/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:20:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "/opt/stack/data/nova/instances/074896e5-8065-4b4a-b61a-653bc67718db/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:20:58 user nova-compute[71229]: DEBUG nova.policy [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6b62270e2c254a888625c7e4491adf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc574e5ba43d43029c450e4fa80ac501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71229) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 15:20:59 user sudo[79954]: pam_unix(sudo:session): session closed for user root
Apr 11 15:20:59 user nova-compute[71229]: INFO oslo.privsep.daemon [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Spawned new privsep daemon via rootwrap
Apr 11 15:20:59 user nova-compute[71229]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 11 15:20:59 user nova-compute[71229]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 11 15:20:59 user nova-compute[71229]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 11 15:20:59 user nova-compute[71229]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 79957
Apr 11 15:20:59 user nova-compute[71229]: WARNING oslo_privsep.priv_context [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] privsep daemon already running
Apr 11 15:20:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:20:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:20:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.153s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:20:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:20:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:20:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:20:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.153s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:20:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Acquiring lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.131s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk 1073741824 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk 1073741824" returned: 0 in 0.045s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.183s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.189s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.131s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:00 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Checking if we can resize image /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk. size=1073741824 {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 15:21:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.136s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/074896e5-8065-4b4a-b61a-653bc67718db/disk 1073741824 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/074896e5-8065-4b4a-b61a-653bc67718db/disk 1073741824" returned: 0 in 0.065s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.208s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:00 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Cannot resize image /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk to a smaller size. {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 15:21:00 user nova-compute[71229]: DEBUG nova.objects.instance [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lazy-loading 'migration_context' on Instance uuid de1a45fd-27be-4438-80a4-2f3a100643c9 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:21:00 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Created local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 15:21:00 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Ensure instance console log exists: /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 15:21:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.122s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:00 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Checking if we can resize image /opt/stack/data/nova/instances/074896e5-8065-4b4a-b61a-653bc67718db/disk. size=1073741824 {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 15:21:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/074896e5-8065-4b4a-b61a-653bc67718db/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/074896e5-8065-4b4a-b61a-653bc67718db/disk --force-share --output=json" returned: 0 in 0.122s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:00 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Cannot resize image /opt/stack/data/nova/instances/074896e5-8065-4b4a-b61a-653bc67718db/disk to a smaller size. {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 15:21:00 user nova-compute[71229]: DEBUG nova.objects.instance [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lazy-loading 'migration_context' on Instance uuid 074896e5-8065-4b4a-b61a-653bc67718db {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:21:00 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Created local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 15:21:00 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Ensure instance console log exists: /opt/stack/data/nova/instances/074896e5-8065-4b4a-b61a-653bc67718db/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 15:21:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:00 user nova-compute[71229]: DEBUG nova.network.neutron [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Successfully created port: 197ae974-459a-49ab-9d70-89bfaa073f50 {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 15:21:01 user nova-compute[71229]: DEBUG nova.network.neutron [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Successfully created port: b0a1c8e2-240f-45dc-bfcc-24902144caf8 {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 15:21:01 user nova-compute[71229]: DEBUG nova.network.neutron [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Successfully updated port: b0a1c8e2-240f-45dc-bfcc-24902144caf8 {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:21:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Acquiring lock "refresh_cache-074896e5-8065-4b4a-b61a-653bc67718db" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:21:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Acquired lock "refresh_cache-074896e5-8065-4b4a-b61a-653bc67718db" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:21:01 user nova-compute[71229]: DEBUG nova.network.neutron [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:21:01 user nova-compute[71229]: DEBUG nova.network.neutron [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:21:02 user nova-compute[71229]: DEBUG nova.compute.manager [req-e84d76d0-a1bf-4087-bb5f-fc05abd2a3f9 req-aa3212a3-dfe4-4722-a743-d65e4303b3c3 service nova] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Received event network-changed-b0a1c8e2-240f-45dc-bfcc-24902144caf8 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:21:02 user nova-compute[71229]: DEBUG nova.compute.manager [req-e84d76d0-a1bf-4087-bb5f-fc05abd2a3f9 req-aa3212a3-dfe4-4722-a743-d65e4303b3c3 service nova] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Refreshing instance network info cache due to event network-changed-b0a1c8e2-240f-45dc-bfcc-24902144caf8. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:21:02 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e84d76d0-a1bf-4087-bb5f-fc05abd2a3f9 req-aa3212a3-dfe4-4722-a743-d65e4303b3c3 service nova] Acquiring lock "refresh_cache-074896e5-8065-4b4a-b61a-653bc67718db" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:21:02 user nova-compute[71229]: DEBUG nova.network.neutron [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Updating instance_info_cache with network_info: [{"id": "b0a1c8e2-240f-45dc-bfcc-24902144caf8", "address": "fa:16:3e:9d:aa:23", "network": {"id": "7c5ce6d1-32c2-4fd9-a28f-234811470f19", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2073264016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc574e5ba43d43029c450e4fa80ac501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0a1c8e2-24", "ovs_interfaceid": "b0a1c8e2-240f-45dc-bfcc-24902144caf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:21:02 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Releasing lock "refresh_cache-074896e5-8065-4b4a-b61a-653bc67718db" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:21:02 user nova-compute[71229]: DEBUG nova.compute.manager [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Instance network_info: |[{"id": "b0a1c8e2-240f-45dc-bfcc-24902144caf8", "address": "fa:16:3e:9d:aa:23", "network": {"id": "7c5ce6d1-32c2-4fd9-a28f-234811470f19", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2073264016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc574e5ba43d43029c450e4fa80ac501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0a1c8e2-24", "ovs_interfaceid": "b0a1c8e2-240f-45dc-bfcc-24902144caf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 15:21:02 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e84d76d0-a1bf-4087-bb5f-fc05abd2a3f9 req-aa3212a3-dfe4-4722-a743-d65e4303b3c3 service nova] Acquired lock "refresh_cache-074896e5-8065-4b4a-b61a-653bc67718db" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:21:02 user nova-compute[71229]: DEBUG nova.network.neutron [req-e84d76d0-a1bf-4087-bb5f-fc05abd2a3f9 req-aa3212a3-dfe4-4722-a743-d65e4303b3c3 service nova] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Refreshing network info cache for port b0a1c8e2-240f-45dc-bfcc-24902144caf8 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:21:02 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Start _get_guest_xml network_info=[{"id": "b0a1c8e2-240f-45dc-bfcc-24902144caf8", "address": "fa:16:3e:9d:aa:23", "network": {"id": "7c5ce6d1-32c2-4fd9-a28f-234811470f19", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2073264016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc574e5ba43d43029c450e4fa80ac501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0a1c8e2-24", "ovs_interfaceid": "b0a1c8e2-240f-45dc-bfcc-24902144caf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '52fe638c-5ada-47d5-b376-233bfa808a37'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:21:02 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:21:02 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:21:02 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:21:02 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:21:02 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:21:02 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:21:02 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:21:02 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:21:02 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:21:02 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:21:02 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:21:02 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:21:02 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:21:02 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:21:02 user nova-compute[71229]: DEBUG nova.privsep.utils [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71229) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 15:21:02 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:20:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1908410251',display_name='tempest-DeleteServersTestJSON-server-1908410251',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1908410251',id=2,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc574e5ba43d43029c450e4fa80ac501',ramdisk_id='',reservation_id='r-0hyoaswl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-738772639',owner_user_name='tempest-DeleteServersTestJSON-738772639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:20:59Z,user_data=None,user_id='6b62270e2c254a888625c7e4491adf05',uuid=074896e5-8065-4b4a-b61a-653bc67718db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0a1c8e2-240f-45dc-bfcc-24902144caf8", "address": "fa:16:3e:9d:aa:23", "network": {"id": "7c5ce6d1-32c2-4fd9-a28f-234811470f19", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2073264016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc574e5ba43d43029c450e4fa80ac501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0a1c8e2-24", "ovs_interfaceid": "b0a1c8e2-240f-45dc-bfcc-24902144caf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:21:02 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Converting VIF {"id": "b0a1c8e2-240f-45dc-bfcc-24902144caf8", "address": "fa:16:3e:9d:aa:23", "network": {"id": "7c5ce6d1-32c2-4fd9-a28f-234811470f19", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2073264016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc574e5ba43d43029c450e4fa80ac501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0a1c8e2-24", "ovs_interfaceid": "b0a1c8e2-240f-45dc-bfcc-24902144caf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:21:02 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:aa:23,bridge_name='br-int',has_traffic_filtering=True,id=b0a1c8e2-240f-45dc-bfcc-24902144caf8,network=Network(7c5ce6d1-32c2-4fd9-a28f-234811470f19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0a1c8e2-24') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:21:02 user nova-compute[71229]: DEBUG nova.objects.instance [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lazy-loading 'pci_devices' on Instance uuid 074896e5-8065-4b4a-b61a-653bc67718db {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:21:02 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:21:02 user nova-compute[71229]:   <uuid>074896e5-8065-4b4a-b61a-653bc67718db</uuid>
Apr 11 15:21:02 user nova-compute[71229]:   <name>instance-00000002</name>
Apr 11 15:21:02 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:21:02 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:21:02 user nova-compute[71229]:   <metadata>
Apr 11 15:21:02 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:21:02 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:21:02 user nova-compute[71229]:       <nova:name>tempest-DeleteServersTestJSON-server-1908410251</nova:name>
Apr 11 15:21:02 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:21:02</nova:creationTime>
Apr 11 15:21:02 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:21:02 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:21:02 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:21:02 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:21:02 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:21:02 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:21:02 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:21:02 user nova-compute[71229]:       <nova:owner>
Apr 11 15:21:02 user nova-compute[71229]:         <nova:user uuid="6b62270e2c254a888625c7e4491adf05">tempest-DeleteServersTestJSON-738772639-project-member</nova:user>
Apr 11 15:21:02 user nova-compute[71229]:         <nova:project uuid="bc574e5ba43d43029c450e4fa80ac501">tempest-DeleteServersTestJSON-738772639</nova:project>
Apr 11 15:21:02 user nova-compute[71229]:       </nova:owner>
Apr 11 15:21:02 user nova-compute[71229]:       <nova:root type="image" uuid="52fe638c-5ada-47d5-b376-233bfa808a37"/>
Apr 11 15:21:02 user nova-compute[71229]:       <nova:ports>
Apr 11 15:21:02 user nova-compute[71229]:         <nova:port uuid="b0a1c8e2-240f-45dc-bfcc-24902144caf8">
Apr 11 15:21:02 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 11 15:21:02 user nova-compute[71229]:         </nova:port>
Apr 11 15:21:02 user nova-compute[71229]:       </nova:ports>
Apr 11 15:21:02 user nova-compute[71229]:     </nova:instance>
Apr 11 15:21:02 user nova-compute[71229]:   </metadata>
Apr 11 15:21:02 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:21:02 user nova-compute[71229]:     <system>
Apr 11 15:21:02 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:21:02 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:21:02 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:21:02 user nova-compute[71229]:       <entry name="serial">074896e5-8065-4b4a-b61a-653bc67718db</entry>
Apr 11 15:21:02 user nova-compute[71229]:       <entry name="uuid">074896e5-8065-4b4a-b61a-653bc67718db</entry>
Apr 11 15:21:02 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:21:02 user nova-compute[71229]:     </system>
Apr 11 15:21:02 user nova-compute[71229]:   </sysinfo>
Apr 11 15:21:02 user nova-compute[71229]:   <os>
Apr 11 15:21:02 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:21:02 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 15:21:02 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:21:02 user nova-compute[71229]:   </os>
Apr 11 15:21:02 user nova-compute[71229]:   <features>
Apr 11 15:21:02 user nova-compute[71229]:     <acpi/>
Apr 11 15:21:02 user nova-compute[71229]:     <apic/>
Apr 11 15:21:02 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:21:02 user nova-compute[71229]:   </features>
Apr 11 15:21:02 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:21:02 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:21:02 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:21:02 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:21:02 user nova-compute[71229]:   </clock>
Apr 11 15:21:02 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:21:02 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:21:02 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:21:02 user nova-compute[71229]:   </cpu>
Apr 11 15:21:02 user nova-compute[71229]:   <devices>
Apr 11 15:21:02 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 15:21:02 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 15:21:02 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/074896e5-8065-4b4a-b61a-653bc67718db/disk"/>
Apr 11 15:21:02 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:21:02 user nova-compute[71229]:     </disk>
Apr 11 15:21:02 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:21:02 user nova-compute[71229]:       <mac address="fa:16:3e:9d:aa:23"/>
Apr 11 15:21:02 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:21:02 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:21:02 user nova-compute[71229]:       <target dev="tapb0a1c8e2-24"/>
Apr 11 15:21:02 user nova-compute[71229]:     </interface>
Apr 11 15:21:02 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:21:02 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/074896e5-8065-4b4a-b61a-653bc67718db/console.log" append="off"/>
Apr 11 15:21:02 user nova-compute[71229]:     </serial>
Apr 11 15:21:02 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:21:02 user nova-compute[71229]:     <video>
Apr 11 15:21:02 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:21:02 user nova-compute[71229]:     </video>
Apr 11 15:21:02 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:21:02 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:21:02 user nova-compute[71229]:     </rng>
Apr 11 15:21:02 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:21:02 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:21:02 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:21:02 user nova-compute[71229]:     </memballoon>
Apr 11 15:21:02 user nova-compute[71229]:   </devices>
Apr 11 15:21:02 user nova-compute[71229]: </domain>
Apr 11 15:21:02 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:21:02 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:20:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1908410251',display_name='tempest-DeleteServersTestJSON-server-1908410251',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1908410251',id=2,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc574e5ba43d43029c450e4fa80ac501',ramdisk_id='',reservation_id='r-0hyoaswl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-738772639',owner_user_name='tempest-DeleteServersTestJSON-738772639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:20:59Z,user_data=None,user_id='6b62270e2c254a888625c7e4491adf05',uuid=074896e5-8065-4b4a-b61a-653bc67718db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0a1c8e2-240f-45dc-bfcc-24902144caf8", "address": "fa:16:3e:9d:aa:23", "network": {"id": "7c5ce6d1-32c2-4fd9-a28f-234811470f19", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2073264016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc574e5ba43d43029c450e4fa80ac501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0a1c8e2-24", "ovs_interfaceid": "b0a1c8e2-240f-45dc-bfcc-24902144caf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:21:02 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Converting VIF {"id": "b0a1c8e2-240f-45dc-bfcc-24902144caf8", "address": "fa:16:3e:9d:aa:23", "network": {"id": "7c5ce6d1-32c2-4fd9-a28f-234811470f19", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2073264016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc574e5ba43d43029c450e4fa80ac501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0a1c8e2-24", "ovs_interfaceid": "b0a1c8e2-240f-45dc-bfcc-24902144caf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:21:02 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:aa:23,bridge_name='br-int',has_traffic_filtering=True,id=b0a1c8e2-240f-45dc-bfcc-24902144caf8,network=Network(7c5ce6d1-32c2-4fd9-a28f-234811470f19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0a1c8e2-24') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:21:02 user nova-compute[71229]: DEBUG os_vif [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:aa:23,bridge_name='br-int',has_traffic_filtering=True,id=b0a1c8e2-240f-45dc-bfcc-24902144caf8,network=Network(7c5ce6d1-32c2-4fd9-a28f-234811470f19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0a1c8e2-24') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:21:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Created schema index Interface.name {{(pid=71229) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 11 15:21:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Created schema index Port.name {{(pid=71229) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 11 15:21:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Created schema index Bridge.name {{(pid=71229) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 11 15:21:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 15:21:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [POLLOUT] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 15:21:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:21:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:21:02 user nova-compute[71229]: INFO oslo.privsep.daemon [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp4ho2v1zl/privsep.sock']
Apr 11 15:21:02 user sudo[79990]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp4ho2v1zl/privsep.sock
Apr 11 15:21:02 user sudo[79990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 11 15:21:03 user nova-compute[71229]: DEBUG nova.network.neutron [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Successfully updated port: 197ae974-459a-49ab-9d70-89bfaa073f50 {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:21:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "refresh_cache-de1a45fd-27be-4438-80a4-2f3a100643c9" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:21:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquired lock "refresh_cache-de1a45fd-27be-4438-80a4-2f3a100643c9" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:21:03 user nova-compute[71229]: DEBUG nova.network.neutron [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:21:03 user nova-compute[71229]: DEBUG nova.network.neutron [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:21:03 user nova-compute[71229]: DEBUG nova.compute.manager [req-0a63d9e8-6b7b-48a0-9cfd-f78a811c24b9 req-062d28fd-d557-46b5-935f-a179c7e13a71 service nova] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Received event network-changed-197ae974-459a-49ab-9d70-89bfaa073f50 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:21:03 user nova-compute[71229]: DEBUG nova.compute.manager [req-0a63d9e8-6b7b-48a0-9cfd-f78a811c24b9 req-062d28fd-d557-46b5-935f-a179c7e13a71 service nova] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Refreshing instance network info cache due to event network-changed-197ae974-459a-49ab-9d70-89bfaa073f50. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:21:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-0a63d9e8-6b7b-48a0-9cfd-f78a811c24b9 req-062d28fd-d557-46b5-935f-a179c7e13a71 service nova] Acquiring lock "refresh_cache-de1a45fd-27be-4438-80a4-2f3a100643c9" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:21:03 user nova-compute[71229]: DEBUG nova.network.neutron [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Updating instance_info_cache with network_info: [{"id": "197ae974-459a-49ab-9d70-89bfaa073f50", "address": "fa:16:3e:03:bb:91", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ae974-45", "ovs_interfaceid": "197ae974-459a-49ab-9d70-89bfaa073f50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:21:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Releasing lock "refresh_cache-de1a45fd-27be-4438-80a4-2f3a100643c9" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:21:03 user nova-compute[71229]: DEBUG nova.compute.manager [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Instance network_info: |[{"id": "197ae974-459a-49ab-9d70-89bfaa073f50", "address": "fa:16:3e:03:bb:91", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ae974-45", "ovs_interfaceid": "197ae974-459a-49ab-9d70-89bfaa073f50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 15:21:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-0a63d9e8-6b7b-48a0-9cfd-f78a811c24b9 req-062d28fd-d557-46b5-935f-a179c7e13a71 service nova] Acquired lock "refresh_cache-de1a45fd-27be-4438-80a4-2f3a100643c9" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:21:03 user nova-compute[71229]: DEBUG nova.network.neutron [req-0a63d9e8-6b7b-48a0-9cfd-f78a811c24b9 req-062d28fd-d557-46b5-935f-a179c7e13a71 service nova] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Refreshing network info cache for port 197ae974-459a-49ab-9d70-89bfaa073f50 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:21:03 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Start _get_guest_xml network_info=[{"id": "197ae974-459a-49ab-9d70-89bfaa073f50", "address": "fa:16:3e:03:bb:91", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ae974-45", "ovs_interfaceid": "197ae974-459a-49ab-9d70-89bfaa073f50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '52fe638c-5ada-47d5-b376-233bfa808a37'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:21:03 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:21:03 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:21:03 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:21:03 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:21:03 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:21:03 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:21:03 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:21:03 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:21:03 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:21:03 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:21:03 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:21:03 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:21:03 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:21:03 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:21:03 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:20:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1804245774',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1804245774',id=1,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ddc05e9bf5ab426982ccb3092ad596e4',ramdisk_id='',reservation_id='r-0s0qo2m2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1907753459',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:20:57Z,user_data=None,user_id='1d60ce27bfad4d7c9b976e834df35ad4',uuid=de1a45fd-27be-4438-80a4-2f3a100643c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "197ae974-459a-49ab-9d70-89bfaa073f50", "address": "fa:16:3e:03:bb:91", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ae974-45", "ovs_interfaceid": "197ae974-459a-49ab-9d70-89bfaa073f50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:21:03 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Converting VIF {"id": "197ae974-459a-49ab-9d70-89bfaa073f50", "address": "fa:16:3e:03:bb:91", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ae974-45", "ovs_interfaceid": "197ae974-459a-49ab-9d70-89bfaa073f50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:21:03 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:bb:91,bridge_name='br-int',has_traffic_filtering=True,id=197ae974-459a-49ab-9d70-89bfaa073f50,network=Network(1cf4cec3-ff08-4320-89e4-aa7e8cf75eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap197ae974-45') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:21:03 user nova-compute[71229]: DEBUG nova.objects.instance [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lazy-loading 'pci_devices' on Instance uuid de1a45fd-27be-4438-80a4-2f3a100643c9 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:21:03 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:21:03 user nova-compute[71229]:   <uuid>de1a45fd-27be-4438-80a4-2f3a100643c9</uuid>
Apr 11 15:21:03 user nova-compute[71229]:   <name>instance-00000001</name>
Apr 11 15:21:03 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:21:03 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:21:03 user nova-compute[71229]:   <metadata>
Apr 11 15:21:03 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:21:03 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:21:03 user nova-compute[71229]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1804245774</nova:name>
Apr 11 15:21:03 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:21:03</nova:creationTime>
Apr 11 15:21:03 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:21:03 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:21:03 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:21:03 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:21:03 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:21:03 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:21:03 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:21:03 user nova-compute[71229]:       <nova:owner>
Apr 11 15:21:03 user nova-compute[71229]:         <nova:user uuid="1d60ce27bfad4d7c9b976e834df35ad4">tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member</nova:user>
Apr 11 15:21:03 user nova-compute[71229]:         <nova:project uuid="ddc05e9bf5ab426982ccb3092ad596e4">tempest-ServerBootFromVolumeStableRescueTest-1907753459</nova:project>
Apr 11 15:21:03 user nova-compute[71229]:       </nova:owner>
Apr 11 15:21:03 user nova-compute[71229]:       <nova:root type="image" uuid="52fe638c-5ada-47d5-b376-233bfa808a37"/>
Apr 11 15:21:03 user nova-compute[71229]:       <nova:ports>
Apr 11 15:21:03 user nova-compute[71229]:         <nova:port uuid="197ae974-459a-49ab-9d70-89bfaa073f50">
Apr 11 15:21:03 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 11 15:21:03 user nova-compute[71229]:         </nova:port>
Apr 11 15:21:03 user nova-compute[71229]:       </nova:ports>
Apr 11 15:21:03 user nova-compute[71229]:     </nova:instance>
Apr 11 15:21:03 user nova-compute[71229]:   </metadata>
Apr 11 15:21:03 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:21:03 user nova-compute[71229]:     <system>
Apr 11 15:21:03 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:21:03 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:21:03 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:21:03 user nova-compute[71229]:       <entry name="serial">de1a45fd-27be-4438-80a4-2f3a100643c9</entry>
Apr 11 15:21:03 user nova-compute[71229]:       <entry name="uuid">de1a45fd-27be-4438-80a4-2f3a100643c9</entry>
Apr 11 15:21:03 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:21:03 user nova-compute[71229]:     </system>
Apr 11 15:21:03 user nova-compute[71229]:   </sysinfo>
Apr 11 15:21:03 user nova-compute[71229]:   <os>
Apr 11 15:21:03 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:21:03 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 15:21:03 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:21:03 user nova-compute[71229]:   </os>
Apr 11 15:21:03 user nova-compute[71229]:   <features>
Apr 11 15:21:03 user nova-compute[71229]:     <acpi/>
Apr 11 15:21:03 user nova-compute[71229]:     <apic/>
Apr 11 15:21:03 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:21:03 user nova-compute[71229]:   </features>
Apr 11 15:21:03 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:21:03 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:21:03 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:21:03 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:21:03 user nova-compute[71229]:   </clock>
Apr 11 15:21:03 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:21:03 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:21:03 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:21:03 user nova-compute[71229]:   </cpu>
Apr 11 15:21:03 user nova-compute[71229]:   <devices>
Apr 11 15:21:03 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 15:21:03 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 15:21:03 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk"/>
Apr 11 15:21:03 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:21:03 user nova-compute[71229]:     </disk>
Apr 11 15:21:03 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:21:03 user nova-compute[71229]:       <mac address="fa:16:3e:03:bb:91"/>
Apr 11 15:21:03 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:21:03 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:21:03 user nova-compute[71229]:       <target dev="tap197ae974-45"/>
Apr 11 15:21:03 user nova-compute[71229]:     </interface>
Apr 11 15:21:03 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:21:03 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/console.log" append="off"/>
Apr 11 15:21:03 user nova-compute[71229]:     </serial>
Apr 11 15:21:03 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:21:03 user nova-compute[71229]:     <video>
Apr 11 15:21:03 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:21:03 user nova-compute[71229]:     </video>
Apr 11 15:21:03 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:21:03 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:21:03 user nova-compute[71229]:     </rng>
Apr 11 15:21:03 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:21:03 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:21:03 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:21:03 user nova-compute[71229]:     </memballoon>
Apr 11 15:21:03 user nova-compute[71229]:   </devices>
Apr 11 15:21:03 user nova-compute[71229]: </domain>
Apr 11 15:21:03 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:21:03 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:20:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1804245774',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1804245774',id=1,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ddc05e9bf5ab426982ccb3092ad596e4',ramdisk_id='',reservation_id='r-0s0qo2m2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1907753459',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:20:57Z,user_data=None,user_id='1d60ce27bfad4d7c9b976e834df35ad4',uuid=de1a45fd-27be-4438-80a4-2f3a100643c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "197ae974-459a-49ab-9d70-89bfaa073f50", "address": "fa:16:3e:03:bb:91", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ae974-45", "ovs_interfaceid": "197ae974-459a-49ab-9d70-89bfaa073f50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:21:03 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Converting VIF {"id": "197ae974-459a-49ab-9d70-89bfaa073f50", "address": "fa:16:3e:03:bb:91", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ae974-45", "ovs_interfaceid": "197ae974-459a-49ab-9d70-89bfaa073f50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:21:03 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:bb:91,bridge_name='br-int',has_traffic_filtering=True,id=197ae974-459a-49ab-9d70-89bfaa073f50,network=Network(1cf4cec3-ff08-4320-89e4-aa7e8cf75eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap197ae974-45') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:21:03 user nova-compute[71229]: DEBUG os_vif [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:bb:91,bridge_name='br-int',has_traffic_filtering=True,id=197ae974-459a-49ab-9d70-89bfaa073f50,network=Network(1cf4cec3-ff08-4320-89e4-aa7e8cf75eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap197ae974-45') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:21:03 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:03 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:21:03 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:21:04 user nova-compute[71229]: DEBUG nova.network.neutron [req-e84d76d0-a1bf-4087-bb5f-fc05abd2a3f9 req-aa3212a3-dfe4-4722-a743-d65e4303b3c3 service nova] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Updated VIF entry in instance network info cache for port b0a1c8e2-240f-45dc-bfcc-24902144caf8. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:21:04 user nova-compute[71229]: DEBUG nova.network.neutron [req-e84d76d0-a1bf-4087-bb5f-fc05abd2a3f9 req-aa3212a3-dfe4-4722-a743-d65e4303b3c3 service nova] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Updating instance_info_cache with network_info: [{"id": "b0a1c8e2-240f-45dc-bfcc-24902144caf8", "address": "fa:16:3e:9d:aa:23", "network": {"id": "7c5ce6d1-32c2-4fd9-a28f-234811470f19", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2073264016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc574e5ba43d43029c450e4fa80ac501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0a1c8e2-24", "ovs_interfaceid": "b0a1c8e2-240f-45dc-bfcc-24902144caf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:21:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e84d76d0-a1bf-4087-bb5f-fc05abd2a3f9 req-aa3212a3-dfe4-4722-a743-d65e4303b3c3 service nova] Releasing lock "refresh_cache-074896e5-8065-4b4a-b61a-653bc67718db" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:21:04 user sudo[79990]: pam_unix(sudo:session): session closed for user root
Apr 11 15:21:04 user nova-compute[71229]: INFO oslo.privsep.daemon [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Spawned new privsep daemon via rootwrap
Apr 11 15:21:04 user nova-compute[71229]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 11 15:21:04 user nova-compute[71229]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 11 15:21:04 user nova-compute[71229]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Apr 11 15:21:04 user nova-compute[71229]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 79994
Apr 11 15:21:04 user nova-compute[71229]: WARNING oslo_privsep.priv_context [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] privsep daemon already running
Apr 11 15:21:04 user nova-compute[71229]: DEBUG nova.network.neutron [req-0a63d9e8-6b7b-48a0-9cfd-f78a811c24b9 req-062d28fd-d557-46b5-935f-a179c7e13a71 service nova] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Updated VIF entry in instance network info cache for port 197ae974-459a-49ab-9d70-89bfaa073f50. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:21:04 user nova-compute[71229]: DEBUG nova.network.neutron [req-0a63d9e8-6b7b-48a0-9cfd-f78a811c24b9 req-062d28fd-d557-46b5-935f-a179c7e13a71 service nova] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Updating instance_info_cache with network_info: [{"id": "197ae974-459a-49ab-9d70-89bfaa073f50", "address": "fa:16:3e:03:bb:91", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ae974-45", "ovs_interfaceid": "197ae974-459a-49ab-9d70-89bfaa073f50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:21:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-0a63d9e8-6b7b-48a0-9cfd-f78a811c24b9 req-062d28fd-d557-46b5-935f-a179c7e13a71 service nova] Releasing lock "refresh_cache-de1a45fd-27be-4438-80a4-2f3a100643c9" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:21:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap197ae974-45, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:21:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap197ae974-45, col_values=(('external_ids', {'iface-id': '197ae974-459a-49ab-9d70-89bfaa073f50', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:bb:91', 'vm-uuid': 'de1a45fd-27be-4438-80a4-2f3a100643c9'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:21:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:21:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:04 user nova-compute[71229]: INFO os_vif [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:bb:91,bridge_name='br-int',has_traffic_filtering=True,id=197ae974-459a-49ab-9d70-89bfaa073f50,network=Network(1cf4cec3-ff08-4320-89e4-aa7e8cf75eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap197ae974-45')
Apr 11 15:21:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb0a1c8e2-24, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:21:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb0a1c8e2-24, col_values=(('external_ids', {'iface-id': 'b0a1c8e2-240f-45dc-bfcc-24902144caf8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:aa:23', 'vm-uuid': '074896e5-8065-4b4a-b61a-653bc67718db'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:21:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:21:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:05 user nova-compute[71229]: INFO os_vif [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:aa:23,bridge_name='br-int',has_traffic_filtering=True,id=b0a1c8e2-240f-45dc-bfcc-24902144caf8,network=Network(7c5ce6d1-32c2-4fd9-a28f-234811470f19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0a1c8e2-24')
Apr 11 15:21:05 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:21:05 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] No VIF found with MAC fa:16:3e:03:bb:91, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:21:05 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:21:05 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] No VIF found with MAC fa:16:3e:9d:aa:23, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:21:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "6a805345-374c-4326-9e8f-39bfc7947a35" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "6a805345-374c-4326-9e8f-39bfc7947a35" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:05 user nova-compute[71229]: DEBUG nova.compute.manager [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Starting instance... {{(pid=71229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 15:21:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:06 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 15:21:06 user nova-compute[71229]: INFO nova.compute.claims [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Claim successful on node user
Apr 11 15:21:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:06 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:21:06 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:21:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.316s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:06 user nova-compute[71229]: DEBUG nova.compute.manager [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Start building networks asynchronously for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 15:21:06 user nova-compute[71229]: DEBUG nova.compute.manager [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Allocating IP information in the background. {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 15:21:06 user nova-compute[71229]: DEBUG nova.network.neutron [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] allocate_for_instance() {{(pid=71229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 15:21:06 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 15:21:06 user nova-compute[71229]: DEBUG nova.compute.manager [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Start building block device mappings for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 15:21:06 user nova-compute[71229]: DEBUG nova.compute.manager [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Start spawning the instance on the hypervisor. {{(pid=71229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 15:21:06 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Creating instance directory {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 15:21:06 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Creating image(s)
Apr 11 15:21:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "/opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "/opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "/opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.120s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:06 user nova-compute[71229]: DEBUG nova.policy [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '10720df0ac4f4e62a0a5c9883d600add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7660e8f76b471487136806ee9eec62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71229) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 15:21:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.123s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk 1073741824 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk 1073741824" returned: 0 in 0.041s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.168s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.150s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:07 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk. size=1073741824 {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 15:21:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:07 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Cannot resize image /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk to a smaller size. {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 15:21:07 user nova-compute[71229]: DEBUG nova.objects.instance [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lazy-loading 'migration_context' on Instance uuid 6a805345-374c-4326-9e8f-39bfc7947a35 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:21:07 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Created local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 15:21:07 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Ensure instance console log exists: /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 15:21:07 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:07 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:07 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:08 user nova-compute[71229]: DEBUG nova.compute.manager [req-d0f2f249-e0b3-4178-abf1-a6c5c343296e req-80aeba7d-4d3a-488f-a5d8-3e6ff653afc5 service nova] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Received event network-vif-plugged-b0a1c8e2-240f-45dc-bfcc-24902144caf8 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:21:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-d0f2f249-e0b3-4178-abf1-a6c5c343296e req-80aeba7d-4d3a-488f-a5d8-3e6ff653afc5 service nova] Acquiring lock "074896e5-8065-4b4a-b61a-653bc67718db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-d0f2f249-e0b3-4178-abf1-a6c5c343296e req-80aeba7d-4d3a-488f-a5d8-3e6ff653afc5 service nova] Lock "074896e5-8065-4b4a-b61a-653bc67718db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-d0f2f249-e0b3-4178-abf1-a6c5c343296e req-80aeba7d-4d3a-488f-a5d8-3e6ff653afc5 service nova] Lock "074896e5-8065-4b4a-b61a-653bc67718db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:08 user nova-compute[71229]: DEBUG nova.compute.manager [req-d0f2f249-e0b3-4178-abf1-a6c5c343296e req-80aeba7d-4d3a-488f-a5d8-3e6ff653afc5 service nova] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] No waiting events found dispatching network-vif-plugged-b0a1c8e2-240f-45dc-bfcc-24902144caf8 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:21:08 user nova-compute[71229]: WARNING nova.compute.manager [req-d0f2f249-e0b3-4178-abf1-a6c5c343296e req-80aeba7d-4d3a-488f-a5d8-3e6ff653afc5 service nova] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Received unexpected event network-vif-plugged-b0a1c8e2-240f-45dc-bfcc-24902144caf8 for instance with vm_state building and task_state spawning.
Apr 11 15:21:09 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681226469.6605332, de1a45fd-27be-4438-80a4-2f3a100643c9 => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:21:09 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] VM Resumed (Lifecycle Event)
Apr 11 15:21:09 user nova-compute[71229]: DEBUG nova.compute.manager [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 15:21:09 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Guest created on hypervisor {{(pid=71229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 15:21:09 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Instance spawned successfully.
Apr 11 15:21:09 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 15:21:09 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Found default for hw_cdrom_bus of ide {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:21:09 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Found default for hw_disk_bus of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:21:09 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Found default for hw_input_bus of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:21:09 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Found default for hw_pointer_model of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:21:09 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Found default for hw_video_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:21:09 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Found default for hw_vif_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:21:09 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:21:09 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:21:09 user nova-compute[71229]: DEBUG nova.compute.manager [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 15:21:09 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Guest created on hypervisor {{(pid=71229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 15:21:09 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Instance spawned successfully.
Apr 11 15:21:09 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 15:21:09 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:21:09 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681226469.6608722, de1a45fd-27be-4438-80a4-2f3a100643c9 => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:21:09 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] VM Started (Lifecycle Event)
Apr 11 15:21:09 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Found default for hw_cdrom_bus of ide {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:21:09 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Found default for hw_disk_bus of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:21:09 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Found default for hw_input_bus of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:21:09 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Found default for hw_pointer_model of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:21:09 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Found default for hw_video_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:21:09 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Found default for hw_vif_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:21:09 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:21:09 user nova-compute[71229]: INFO nova.compute.manager [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Took 13.28 seconds to spawn the instance on the hypervisor.
Apr 11 15:21:09 user nova-compute[71229]: DEBUG nova.compute.manager [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:21:09 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:21:09 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:09 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:09 user nova-compute[71229]: INFO nova.compute.manager [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Took 11.16 seconds to spawn the instance on the hypervisor.
Apr 11 15:21:09 user nova-compute[71229]: DEBUG nova.compute.manager [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:21:09 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:21:09 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681226469.7890635, 074896e5-8065-4b4a-b61a-653bc67718db => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:21:10 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] VM Resumed (Lifecycle Event)
Apr 11 15:21:10 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:21:10 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:21:10 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:21:10 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681226469.7904441, 074896e5-8065-4b4a-b61a-653bc67718db => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:21:10 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] VM Started (Lifecycle Event)
Apr 11 15:21:10 user nova-compute[71229]: INFO nova.compute.manager [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Took 14.36 seconds to build instance.
Apr 11 15:21:10 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:21:10 user nova-compute[71229]: INFO nova.compute.manager [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Took 11.94 seconds to build instance.
Apr 11 15:21:10 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:21:10 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-7a9a7a38-04ff-4d6c-ade8-a68bd4883c80 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "de1a45fd-27be-4438-80a4-2f3a100643c9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.551s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:10 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3e6418f8-4e67-43cb-ac2b-9f07c0ef6a5c tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "074896e5-8065-4b4a-b61a-653bc67718db" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.139s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:10 user nova-compute[71229]: DEBUG nova.network.neutron [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Successfully created port: d8c64197-b034-4f38-821d-ba030f1fca6b {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 15:21:10 user nova-compute[71229]: DEBUG nova.compute.manager [req-4ffdc735-ff60-4383-8bee-cc37139dad2c req-036c9c5c-0614-4508-be41-bdd7a8ff972a service nova] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Received event network-vif-plugged-b0a1c8e2-240f-45dc-bfcc-24902144caf8 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:21:10 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4ffdc735-ff60-4383-8bee-cc37139dad2c req-036c9c5c-0614-4508-be41-bdd7a8ff972a service nova] Acquiring lock "074896e5-8065-4b4a-b61a-653bc67718db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:10 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4ffdc735-ff60-4383-8bee-cc37139dad2c req-036c9c5c-0614-4508-be41-bdd7a8ff972a service nova] Lock "074896e5-8065-4b4a-b61a-653bc67718db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:10 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4ffdc735-ff60-4383-8bee-cc37139dad2c req-036c9c5c-0614-4508-be41-bdd7a8ff972a service nova] Lock "074896e5-8065-4b4a-b61a-653bc67718db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:10 user nova-compute[71229]: DEBUG nova.compute.manager [req-4ffdc735-ff60-4383-8bee-cc37139dad2c req-036c9c5c-0614-4508-be41-bdd7a8ff972a service nova] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] No waiting events found dispatching network-vif-plugged-b0a1c8e2-240f-45dc-bfcc-24902144caf8 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:21:10 user nova-compute[71229]: WARNING nova.compute.manager [req-4ffdc735-ff60-4383-8bee-cc37139dad2c req-036c9c5c-0614-4508-be41-bdd7a8ff972a service nova] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Received unexpected event network-vif-plugged-b0a1c8e2-240f-45dc-bfcc-24902144caf8 for instance with vm_state active and task_state None.
Apr 11 15:21:10 user nova-compute[71229]: DEBUG nova.compute.manager [req-4ffdc735-ff60-4383-8bee-cc37139dad2c req-036c9c5c-0614-4508-be41-bdd7a8ff972a service nova] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Received event network-vif-plugged-197ae974-459a-49ab-9d70-89bfaa073f50 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:21:10 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4ffdc735-ff60-4383-8bee-cc37139dad2c req-036c9c5c-0614-4508-be41-bdd7a8ff972a service nova] Acquiring lock "de1a45fd-27be-4438-80a4-2f3a100643c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:10 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4ffdc735-ff60-4383-8bee-cc37139dad2c req-036c9c5c-0614-4508-be41-bdd7a8ff972a service nova] Lock "de1a45fd-27be-4438-80a4-2f3a100643c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:10 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4ffdc735-ff60-4383-8bee-cc37139dad2c req-036c9c5c-0614-4508-be41-bdd7a8ff972a service nova] Lock "de1a45fd-27be-4438-80a4-2f3a100643c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:10 user nova-compute[71229]: DEBUG nova.compute.manager [req-4ffdc735-ff60-4383-8bee-cc37139dad2c req-036c9c5c-0614-4508-be41-bdd7a8ff972a service nova] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] No waiting events found dispatching network-vif-plugged-197ae974-459a-49ab-9d70-89bfaa073f50 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:21:10 user nova-compute[71229]: WARNING nova.compute.manager [req-4ffdc735-ff60-4383-8bee-cc37139dad2c req-036c9c5c-0614-4508-be41-bdd7a8ff972a service nova] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Received unexpected event network-vif-plugged-197ae974-459a-49ab-9d70-89bfaa073f50 for instance with vm_state active and task_state None.
Apr 11 15:21:10 user nova-compute[71229]: DEBUG nova.compute.manager [req-4ffdc735-ff60-4383-8bee-cc37139dad2c req-036c9c5c-0614-4508-be41-bdd7a8ff972a service nova] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Received event network-vif-plugged-197ae974-459a-49ab-9d70-89bfaa073f50 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:21:10 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4ffdc735-ff60-4383-8bee-cc37139dad2c req-036c9c5c-0614-4508-be41-bdd7a8ff972a service nova] Acquiring lock "de1a45fd-27be-4438-80a4-2f3a100643c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:10 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4ffdc735-ff60-4383-8bee-cc37139dad2c req-036c9c5c-0614-4508-be41-bdd7a8ff972a service nova] Lock "de1a45fd-27be-4438-80a4-2f3a100643c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:10 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4ffdc735-ff60-4383-8bee-cc37139dad2c req-036c9c5c-0614-4508-be41-bdd7a8ff972a service nova] Lock "de1a45fd-27be-4438-80a4-2f3a100643c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:10 user nova-compute[71229]: DEBUG nova.compute.manager [req-4ffdc735-ff60-4383-8bee-cc37139dad2c req-036c9c5c-0614-4508-be41-bdd7a8ff972a service nova] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] No waiting events found dispatching network-vif-plugged-197ae974-459a-49ab-9d70-89bfaa073f50 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:21:10 user nova-compute[71229]: WARNING nova.compute.manager [req-4ffdc735-ff60-4383-8bee-cc37139dad2c req-036c9c5c-0614-4508-be41-bdd7a8ff972a service nova] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Received unexpected event network-vif-plugged-197ae974-459a-49ab-9d70-89bfaa073f50 for instance with vm_state active and task_state None.
Apr 11 15:21:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:13 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:14 user nova-compute[71229]: DEBUG nova.network.neutron [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Successfully updated port: d8c64197-b034-4f38-821d-ba030f1fca6b {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:21:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "refresh_cache-6a805345-374c-4326-9e8f-39bfc7947a35" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:21:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquired lock "refresh_cache-6a805345-374c-4326-9e8f-39bfc7947a35" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:21:15 user nova-compute[71229]: DEBUG nova.network.neutron [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:21:15 user nova-compute[71229]: DEBUG nova.compute.manager [req-79627368-691b-4caa-92d0-9e54d0b45e6d req-e55a1bc2-8bf2-4f49-9800-92e5ba8724d3 service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Received event network-changed-d8c64197-b034-4f38-821d-ba030f1fca6b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:21:15 user nova-compute[71229]: DEBUG nova.compute.manager [req-79627368-691b-4caa-92d0-9e54d0b45e6d req-e55a1bc2-8bf2-4f49-9800-92e5ba8724d3 service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Refreshing instance network info cache due to event network-changed-d8c64197-b034-4f38-821d-ba030f1fca6b. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:21:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-79627368-691b-4caa-92d0-9e54d0b45e6d req-e55a1bc2-8bf2-4f49-9800-92e5ba8724d3 service nova] Acquiring lock "refresh_cache-6a805345-374c-4326-9e8f-39bfc7947a35" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:21:15 user nova-compute[71229]: DEBUG nova.network.neutron [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:21:15 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Acquiring lock "4b1dedd0-ae18-421b-b83a-a7b2c22c65d5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "4b1dedd0-ae18-421b-b83a-a7b2c22c65d5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:15 user nova-compute[71229]: DEBUG nova.compute.manager [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Starting instance... {{(pid=71229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 15:21:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:15 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 15:21:15 user nova-compute[71229]: INFO nova.compute.claims [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Claim successful on node user
Apr 11 15:21:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:16 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:21:16 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:21:16 user nova-compute[71229]: DEBUG nova.network.neutron [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Updating instance_info_cache with network_info: [{"id": "d8c64197-b034-4f38-821d-ba030f1fca6b", "address": "fa:16:3e:0f:f8:cb", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c64197-b0", "ovs_interfaceid": "d8c64197-b034-4f38-821d-ba030f1fca6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:21:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Releasing lock "refresh_cache-6a805345-374c-4326-9e8f-39bfc7947a35" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:21:16 user nova-compute[71229]: DEBUG nova.compute.manager [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Instance network_info: |[{"id": "d8c64197-b034-4f38-821d-ba030f1fca6b", "address": "fa:16:3e:0f:f8:cb", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c64197-b0", "ovs_interfaceid": "d8c64197-b034-4f38-821d-ba030f1fca6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 15:21:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.457s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:16 user nova-compute[71229]: DEBUG nova.compute.manager [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Start building networks asynchronously for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 15:21:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-79627368-691b-4caa-92d0-9e54d0b45e6d req-e55a1bc2-8bf2-4f49-9800-92e5ba8724d3 service nova] Acquired lock "refresh_cache-6a805345-374c-4326-9e8f-39bfc7947a35" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:21:16 user nova-compute[71229]: DEBUG nova.network.neutron [req-79627368-691b-4caa-92d0-9e54d0b45e6d req-e55a1bc2-8bf2-4f49-9800-92e5ba8724d3 service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Refreshing network info cache for port d8c64197-b034-4f38-821d-ba030f1fca6b {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:21:16 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Start _get_guest_xml network_info=[{"id": "d8c64197-b034-4f38-821d-ba030f1fca6b", "address": "fa:16:3e:0f:f8:cb", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c64197-b0", "ovs_interfaceid": "d8c64197-b034-4f38-821d-ba030f1fca6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '52fe638c-5ada-47d5-b376-233bfa808a37'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:21:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:16 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:21:16 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:21:16 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:21:16 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:21:16 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:21:16 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:21:16 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:21:16 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:21:16 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:21:16 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:21:16 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:21:16 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:21:16 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:21:16 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:21:16 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:21:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1386574519',display_name='tempest-ServerActionsTestJSON-server-1386574519',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1386574519',id=3,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfAJGQ+GOa8zW+jlKgD9Kz6/k6iEv9pZIOIjICzcstJ92AAS94+47mc3fRsqyx5FaTMV9P4lTsW4Fy7tKIAtMpRx0Sl7sa6ttQnPbPhlcYqfbdWbTqmmKi6+BuZpqSknA==',key_name='tempest-keypair-1137963694',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb7660e8f76b471487136806ee9eec62',ramdisk_id='',reservation_id='r-hmn5p3xn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1659503440',owner_user_name='tempest-ServerActionsTestJSON-1659503440-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:21:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10720df0ac4f4e62a0a5c9883d600add',uuid=6a805345-374c-4326-9e8f-39bfc7947a35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8c64197-b034-4f38-821d-ba030f1fca6b", "address": "fa:16:3e:0f:f8:cb", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c64197-b0", "ovs_interfaceid": "d8c64197-b034-4f38-821d-ba030f1fca6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:21:16 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Converting VIF {"id": "d8c64197-b034-4f38-821d-ba030f1fca6b", "address": "fa:16:3e:0f:f8:cb", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c64197-b0", "ovs_interfaceid": "d8c64197-b034-4f38-821d-ba030f1fca6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:21:16 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:f8:cb,bridge_name='br-int',has_traffic_filtering=True,id=d8c64197-b034-4f38-821d-ba030f1fca6b,network=Network(1bd215e8-0459-4dd2-893b-096b6e31ac08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c64197-b0') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:21:16 user nova-compute[71229]: DEBUG nova.objects.instance [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a805345-374c-4326-9e8f-39bfc7947a35 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:21:16 user nova-compute[71229]: DEBUG nova.compute.manager [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Allocating IP information in the background. {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 15:21:16 user nova-compute[71229]: DEBUG nova.network.neutron [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] allocate_for_instance() {{(pid=71229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 15:21:16 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:21:16 user nova-compute[71229]:   <uuid>6a805345-374c-4326-9e8f-39bfc7947a35</uuid>
Apr 11 15:21:16 user nova-compute[71229]:   <name>instance-00000003</name>
Apr 11 15:21:16 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:21:16 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:21:16 user nova-compute[71229]:   <metadata>
Apr 11 15:21:16 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:21:16 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:21:16 user nova-compute[71229]:       <nova:name>tempest-ServerActionsTestJSON-server-1386574519</nova:name>
Apr 11 15:21:16 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:21:16</nova:creationTime>
Apr 11 15:21:16 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:21:16 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:21:16 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:21:16 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:21:16 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:21:16 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:21:16 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:21:16 user nova-compute[71229]:       <nova:owner>
Apr 11 15:21:16 user nova-compute[71229]:         <nova:user uuid="10720df0ac4f4e62a0a5c9883d600add">tempest-ServerActionsTestJSON-1659503440-project-member</nova:user>
Apr 11 15:21:16 user nova-compute[71229]:         <nova:project uuid="bb7660e8f76b471487136806ee9eec62">tempest-ServerActionsTestJSON-1659503440</nova:project>
Apr 11 15:21:16 user nova-compute[71229]:       </nova:owner>
Apr 11 15:21:16 user nova-compute[71229]:       <nova:root type="image" uuid="52fe638c-5ada-47d5-b376-233bfa808a37"/>
Apr 11 15:21:16 user nova-compute[71229]:       <nova:ports>
Apr 11 15:21:16 user nova-compute[71229]:         <nova:port uuid="d8c64197-b034-4f38-821d-ba030f1fca6b">
Apr 11 15:21:16 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 11 15:21:16 user nova-compute[71229]:         </nova:port>
Apr 11 15:21:16 user nova-compute[71229]:       </nova:ports>
Apr 11 15:21:16 user nova-compute[71229]:     </nova:instance>
Apr 11 15:21:16 user nova-compute[71229]:   </metadata>
Apr 11 15:21:16 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:21:16 user nova-compute[71229]:     <system>
Apr 11 15:21:16 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:21:16 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:21:16 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:21:16 user nova-compute[71229]:       <entry name="serial">6a805345-374c-4326-9e8f-39bfc7947a35</entry>
Apr 11 15:21:16 user nova-compute[71229]:       <entry name="uuid">6a805345-374c-4326-9e8f-39bfc7947a35</entry>
Apr 11 15:21:16 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:21:16 user nova-compute[71229]:     </system>
Apr 11 15:21:16 user nova-compute[71229]:   </sysinfo>
Apr 11 15:21:16 user nova-compute[71229]:   <os>
Apr 11 15:21:16 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:21:16 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 15:21:16 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:21:16 user nova-compute[71229]:   </os>
Apr 11 15:21:16 user nova-compute[71229]:   <features>
Apr 11 15:21:16 user nova-compute[71229]:     <acpi/>
Apr 11 15:21:16 user nova-compute[71229]:     <apic/>
Apr 11 15:21:16 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:21:16 user nova-compute[71229]:   </features>
Apr 11 15:21:16 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:21:16 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:21:16 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:21:16 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:21:16 user nova-compute[71229]:   </clock>
Apr 11 15:21:16 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:21:16 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:21:16 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:21:16 user nova-compute[71229]:   </cpu>
Apr 11 15:21:16 user nova-compute[71229]:   <devices>
Apr 11 15:21:16 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 15:21:16 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 15:21:16 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk"/>
Apr 11 15:21:16 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:21:16 user nova-compute[71229]:     </disk>
Apr 11 15:21:16 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:21:16 user nova-compute[71229]:       <mac address="fa:16:3e:0f:f8:cb"/>
Apr 11 15:21:16 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:21:16 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:21:16 user nova-compute[71229]:       <target dev="tapd8c64197-b0"/>
Apr 11 15:21:16 user nova-compute[71229]:     </interface>
Apr 11 15:21:16 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:21:16 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/console.log" append="off"/>
Apr 11 15:21:16 user nova-compute[71229]:     </serial>
Apr 11 15:21:16 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:21:16 user nova-compute[71229]:     <video>
Apr 11 15:21:16 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:21:16 user nova-compute[71229]:     </video>
Apr 11 15:21:16 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:21:16 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:21:16 user nova-compute[71229]:     </rng>
Apr 11 15:21:16 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:21:16 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:21:16 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:21:16 user nova-compute[71229]:     </memballoon>
Apr 11 15:21:16 user nova-compute[71229]:   </devices>
Apr 11 15:21:16 user nova-compute[71229]: </domain>
Apr 11 15:21:16 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:21:16 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:21:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1386574519',display_name='tempest-ServerActionsTestJSON-server-1386574519',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1386574519',id=3,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfAJGQ+GOa8zW+jlKgD9Kz6/k6iEv9pZIOIjICzcstJ92AAS94+47mc3fRsqyx5FaTMV9P4lTsW4Fy7tKIAtMpRx0Sl7sa6ttQnPbPhlcYqfbdWbTqmmKi6+BuZpqSknA==',key_name='tempest-keypair-1137963694',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb7660e8f76b471487136806ee9eec62',ramdisk_id='',reservation_id='r-hmn5p3xn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1659503440',owner_user_name='tempest-ServerActionsTestJSON-1659503440-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:21:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10720df0ac4f4e62a0a5c9883d600add',uuid=6a805345-374c-4326-9e8f-39bfc7947a35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8c64197-b034-4f38-821d-ba030f1fca6b", "address": "fa:16:3e:0f:f8:cb", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c64197-b0", "ovs_interfaceid": "d8c64197-b034-4f38-821d-ba030f1fca6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:21:16 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Converting VIF {"id": "d8c64197-b034-4f38-821d-ba030f1fca6b", "address": "fa:16:3e:0f:f8:cb", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c64197-b0", "ovs_interfaceid": "d8c64197-b034-4f38-821d-ba030f1fca6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:21:16 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:f8:cb,bridge_name='br-int',has_traffic_filtering=True,id=d8c64197-b034-4f38-821d-ba030f1fca6b,network=Network(1bd215e8-0459-4dd2-893b-096b6e31ac08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c64197-b0') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:21:16 user nova-compute[71229]: DEBUG os_vif [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:f8:cb,bridge_name='br-int',has_traffic_filtering=True,id=d8c64197-b034-4f38-821d-ba030f1fca6b,network=Network(1bd215e8-0459-4dd2-893b-096b6e31ac08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c64197-b0') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:21:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:21:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:21:16 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 15:21:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd8c64197-b0, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:21:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd8c64197-b0, col_values=(('external_ids', {'iface-id': 'd8c64197-b034-4f38-821d-ba030f1fca6b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:f8:cb', 'vm-uuid': '6a805345-374c-4326-9e8f-39bfc7947a35'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:21:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:21:16 user nova-compute[71229]: DEBUG nova.compute.manager [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Start building block device mappings for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 15:21:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:16 user nova-compute[71229]: INFO os_vif [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:f8:cb,bridge_name='br-int',has_traffic_filtering=True,id=d8c64197-b034-4f38-821d-ba030f1fca6b,network=Network(1bd215e8-0459-4dd2-893b-096b6e31ac08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c64197-b0')
Apr 11 15:21:16 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:21:16 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] No VIF found with MAC fa:16:3e:0f:f8:cb, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:21:16 user nova-compute[71229]: DEBUG nova.policy [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'acc44d2042554ca0b0bde4b2de5b566a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a341ccfc0b4f08bb2e97083143dd40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71229) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 15:21:16 user nova-compute[71229]: DEBUG nova.compute.manager [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Start spawning the instance on the hypervisor. {{(pid=71229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 15:21:16 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Creating instance directory {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 15:21:16 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Creating image(s)
Apr 11 15:21:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b1dedd0-ae18-421b-b83a-a7b2c22c65d5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "/opt/stack/data/nova/instances/4b1dedd0-ae18-421b-b83a-a7b2c22c65d5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:17 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "/opt/stack/data/nova/instances/4b1dedd0-ae18-421b-b83a-a7b2c22c65d5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.209s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.170s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:17 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Acquiring lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:17 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.182s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/4b1dedd0-ae18-421b-b83a-a7b2c22c65d5/disk 1073741824 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/4b1dedd0-ae18-421b-b83a-a7b2c22c65d5/disk 1073741824" returned: 0 in 0.068s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:17 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.201s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:17 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4b1dedd0-ae18-421b-b83a-a7b2c22c65d5/disk. size=1073741824 {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 15:21:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b1dedd0-ae18-421b-b83a-a7b2c22c65d5/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:17 user nova-compute[71229]: DEBUG nova.network.neutron [req-79627368-691b-4caa-92d0-9e54d0b45e6d req-e55a1bc2-8bf2-4f49-9800-92e5ba8724d3 service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Updated VIF entry in instance network info cache for port d8c64197-b034-4f38-821d-ba030f1fca6b. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:21:17 user nova-compute[71229]: DEBUG nova.network.neutron [req-79627368-691b-4caa-92d0-9e54d0b45e6d req-e55a1bc2-8bf2-4f49-9800-92e5ba8724d3 service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Updating instance_info_cache with network_info: [{"id": "d8c64197-b034-4f38-821d-ba030f1fca6b", "address": "fa:16:3e:0f:f8:cb", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c64197-b0", "ovs_interfaceid": "d8c64197-b034-4f38-821d-ba030f1fca6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:21:17 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-79627368-691b-4caa-92d0-9e54d0b45e6d req-e55a1bc2-8bf2-4f49-9800-92e5ba8724d3 service nova] Releasing lock "refresh_cache-6a805345-374c-4326-9e8f-39bfc7947a35" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:21:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b1dedd0-ae18-421b-b83a-a7b2c22c65d5/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:17 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Cannot resize image /opt/stack/data/nova/instances/4b1dedd0-ae18-421b-b83a-a7b2c22c65d5/disk to a smaller size. {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 15:21:17 user nova-compute[71229]: DEBUG nova.objects.instance [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lazy-loading 'migration_context' on Instance uuid 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:21:17 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Created local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 15:21:17 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Ensure instance console log exists: /opt/stack/data/nova/instances/4b1dedd0-ae18-421b-b83a-a7b2c22c65d5/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 15:21:17 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:17 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:17 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:18 user nova-compute[71229]: DEBUG nova.network.neutron [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Successfully created port: e92694db-c1b5-4366-bf78-1f6340cab2fe {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 15:21:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:19 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:19 user nova-compute[71229]: DEBUG nova.compute.manager [req-fcb812d1-edd6-4701-ab50-6f2ccec1c243 req-c95d44be-9377-49a5-ba15-aeabac02ebf6 service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Received event network-vif-plugged-d8c64197-b034-4f38-821d-ba030f1fca6b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:21:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-fcb812d1-edd6-4701-ab50-6f2ccec1c243 req-c95d44be-9377-49a5-ba15-aeabac02ebf6 service nova] Acquiring lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-fcb812d1-edd6-4701-ab50-6f2ccec1c243 req-c95d44be-9377-49a5-ba15-aeabac02ebf6 service nova] Lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-fcb812d1-edd6-4701-ab50-6f2ccec1c243 req-c95d44be-9377-49a5-ba15-aeabac02ebf6 service nova] Lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:19 user nova-compute[71229]: DEBUG nova.compute.manager [req-fcb812d1-edd6-4701-ab50-6f2ccec1c243 req-c95d44be-9377-49a5-ba15-aeabac02ebf6 service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] No waiting events found dispatching network-vif-plugged-d8c64197-b034-4f38-821d-ba030f1fca6b {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:21:19 user nova-compute[71229]: WARNING nova.compute.manager [req-fcb812d1-edd6-4701-ab50-6f2ccec1c243 req-c95d44be-9377-49a5-ba15-aeabac02ebf6 service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Received unexpected event network-vif-plugged-d8c64197-b034-4f38-821d-ba030f1fca6b for instance with vm_state building and task_state spawning.
Apr 11 15:21:19 user nova-compute[71229]: DEBUG nova.network.neutron [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Successfully updated port: e92694db-c1b5-4366-bf78-1f6340cab2fe {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:21:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Acquiring lock "refresh_cache-4b1dedd0-ae18-421b-b83a-a7b2c22c65d5" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:21:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Acquired lock "refresh_cache-4b1dedd0-ae18-421b-b83a-a7b2c22c65d5" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:21:19 user nova-compute[71229]: DEBUG nova.network.neutron [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:21:20 user nova-compute[71229]: DEBUG nova.compute.manager [req-11476a04-9b73-41d6-8271-1606330f9b17 req-3fb2fd54-cec8-4644-98e1-8efb6ae868c6 service nova] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Received event network-changed-e92694db-c1b5-4366-bf78-1f6340cab2fe {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:21:20 user nova-compute[71229]: DEBUG nova.compute.manager [req-11476a04-9b73-41d6-8271-1606330f9b17 req-3fb2fd54-cec8-4644-98e1-8efb6ae868c6 service nova] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Refreshing instance network info cache due to event network-changed-e92694db-c1b5-4366-bf78-1f6340cab2fe. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:21:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-11476a04-9b73-41d6-8271-1606330f9b17 req-3fb2fd54-cec8-4644-98e1-8efb6ae868c6 service nova] Acquiring lock "refresh_cache-4b1dedd0-ae18-421b-b83a-a7b2c22c65d5" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:21:20 user nova-compute[71229]: DEBUG nova.network.neutron [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:21:20 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681226480.5776925, 6a805345-374c-4326-9e8f-39bfc7947a35 => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:21:20 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] VM Resumed (Lifecycle Event)
Apr 11 15:21:20 user nova-compute[71229]: DEBUG nova.compute.manager [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 15:21:20 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Guest created on hypervisor {{(pid=71229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 15:21:20 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Instance spawned successfully.
Apr 11 15:21:20 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 15:21:20 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:21:20 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:21:20 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Found default for hw_cdrom_bus of ide {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:21:20 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Found default for hw_disk_bus of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:21:20 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Found default for hw_input_bus of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:21:20 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Found default for hw_pointer_model of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:21:20 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Found default for hw_video_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:21:20 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Found default for hw_vif_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:21:20 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:21:20 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681226480.5809836, 6a805345-374c-4326-9e8f-39bfc7947a35 => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:21:20 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] VM Started (Lifecycle Event)
Apr 11 15:21:20 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:21:20 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:21:20 user nova-compute[71229]: DEBUG nova.network.neutron [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Updating instance_info_cache with network_info: [{"id": "e92694db-c1b5-4366-bf78-1f6340cab2fe", "address": "fa:16:3e:08:c1:ec", "network": {"id": "5b9dc948-4f8b-460a-bc87-04cf194f5c08", "bridge": "br-int", "label": "tempest-VolumesActionsTest-712454576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b4a341ccfc0b4f08bb2e97083143dd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape92694db-c1", "ovs_interfaceid": "e92694db-c1b5-4366-bf78-1f6340cab2fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:21:20 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:21:20 user nova-compute[71229]: INFO nova.compute.manager [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Took 14.09 seconds to spawn the instance on the hypervisor.
Apr 11 15:21:20 user nova-compute[71229]: DEBUG nova.compute.manager [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:21:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Releasing lock "refresh_cache-4b1dedd0-ae18-421b-b83a-a7b2c22c65d5" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:21:20 user nova-compute[71229]: DEBUG nova.compute.manager [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Instance network_info: |[{"id": "e92694db-c1b5-4366-bf78-1f6340cab2fe", "address": "fa:16:3e:08:c1:ec", "network": {"id": "5b9dc948-4f8b-460a-bc87-04cf194f5c08", "bridge": "br-int", "label": "tempest-VolumesActionsTest-712454576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b4a341ccfc0b4f08bb2e97083143dd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape92694db-c1", "ovs_interfaceid": "e92694db-c1b5-4366-bf78-1f6340cab2fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 15:21:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-11476a04-9b73-41d6-8271-1606330f9b17 req-3fb2fd54-cec8-4644-98e1-8efb6ae868c6 service nova] Acquired lock "refresh_cache-4b1dedd0-ae18-421b-b83a-a7b2c22c65d5" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:21:20 user nova-compute[71229]: DEBUG nova.network.neutron [req-11476a04-9b73-41d6-8271-1606330f9b17 req-3fb2fd54-cec8-4644-98e1-8efb6ae868c6 service nova] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Refreshing network info cache for port e92694db-c1b5-4366-bf78-1f6340cab2fe {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:21:20 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Start _get_guest_xml network_info=[{"id": "e92694db-c1b5-4366-bf78-1f6340cab2fe", "address": "fa:16:3e:08:c1:ec", "network": {"id": "5b9dc948-4f8b-460a-bc87-04cf194f5c08", "bridge": "br-int", "label": "tempest-VolumesActionsTest-712454576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b4a341ccfc0b4f08bb2e97083143dd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape92694db-c1", "ovs_interfaceid": "e92694db-c1b5-4366-bf78-1f6340cab2fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '52fe638c-5ada-47d5-b376-233bfa808a37'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:21:20 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:21:20 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:21:20 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:21:20 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:21:20 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:21:20 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:21:20 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:21:20 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:21:20 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:21:20 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:21:20 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:21:20 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:21:20 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:21:20 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:21:20 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:21:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-934769884',display_name='tempest-VolumesActionsTest-instance-934769884',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-934769884',id=4,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4a341ccfc0b4f08bb2e97083143dd40',ramdisk_id='',reservation_id='r-aldf7xge',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1278032672',owner_user_name='tempest-VolumesActionsTest-1278032672-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:21:17Z,user_data=None,user_id='acc44d2042554ca0b0bde4b2de5b566a',uuid=4b1dedd0-ae18-421b-b83a-a7b2c22c65d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e92694db-c1b5-4366-bf78-1f6340cab2fe", "address": "fa:16:3e:08:c1:ec", "network": {"id": "5b9dc948-4f8b-460a-bc87-04cf194f5c08", "bridge": "br-int", "label": "tempest-VolumesActionsTest-712454576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b4a341ccfc0b4f08bb2e97083143dd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape92694db-c1", "ovs_interfaceid": "e92694db-c1b5-4366-bf78-1f6340cab2fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:21:20 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Converting VIF {"id": "e92694db-c1b5-4366-bf78-1f6340cab2fe", "address": "fa:16:3e:08:c1:ec", "network": {"id": "5b9dc948-4f8b-460a-bc87-04cf194f5c08", "bridge": "br-int", "label": "tempest-VolumesActionsTest-712454576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b4a341ccfc0b4f08bb2e97083143dd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape92694db-c1", "ovs_interfaceid": "e92694db-c1b5-4366-bf78-1f6340cab2fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:21:20 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:c1:ec,bridge_name='br-int',has_traffic_filtering=True,id=e92694db-c1b5-4366-bf78-1f6340cab2fe,network=Network(5b9dc948-4f8b-460a-bc87-04cf194f5c08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape92694db-c1') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:21:20 user nova-compute[71229]: DEBUG nova.objects.instance [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:21:20 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:21:20 user nova-compute[71229]:   <uuid>4b1dedd0-ae18-421b-b83a-a7b2c22c65d5</uuid>
Apr 11 15:21:20 user nova-compute[71229]:   <name>instance-00000004</name>
Apr 11 15:21:20 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:21:20 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:21:20 user nova-compute[71229]:   <metadata>
Apr 11 15:21:20 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:21:20 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:21:20 user nova-compute[71229]:       <nova:name>tempest-VolumesActionsTest-instance-934769884</nova:name>
Apr 11 15:21:20 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:21:20</nova:creationTime>
Apr 11 15:21:20 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:21:20 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:21:20 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:21:20 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:21:20 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:21:20 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:21:20 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:21:20 user nova-compute[71229]:       <nova:owner>
Apr 11 15:21:20 user nova-compute[71229]:         <nova:user uuid="acc44d2042554ca0b0bde4b2de5b566a">tempest-VolumesActionsTest-1278032672-project-member</nova:user>
Apr 11 15:21:20 user nova-compute[71229]:         <nova:project uuid="b4a341ccfc0b4f08bb2e97083143dd40">tempest-VolumesActionsTest-1278032672</nova:project>
Apr 11 15:21:20 user nova-compute[71229]:       </nova:owner>
Apr 11 15:21:20 user nova-compute[71229]:       <nova:root type="image" uuid="52fe638c-5ada-47d5-b376-233bfa808a37"/>
Apr 11 15:21:20 user nova-compute[71229]:       <nova:ports>
Apr 11 15:21:20 user nova-compute[71229]:         <nova:port uuid="e92694db-c1b5-4366-bf78-1f6340cab2fe">
Apr 11 15:21:20 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.2" ipVersion="4"/>
Apr 11 15:21:20 user nova-compute[71229]:         </nova:port>
Apr 11 15:21:20 user nova-compute[71229]:       </nova:ports>
Apr 11 15:21:20 user nova-compute[71229]:     </nova:instance>
Apr 11 15:21:20 user nova-compute[71229]:   </metadata>
Apr 11 15:21:20 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:21:20 user nova-compute[71229]:     <system>
Apr 11 15:21:20 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:21:20 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:21:20 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:21:20 user nova-compute[71229]:       <entry name="serial">4b1dedd0-ae18-421b-b83a-a7b2c22c65d5</entry>
Apr 11 15:21:20 user nova-compute[71229]:       <entry name="uuid">4b1dedd0-ae18-421b-b83a-a7b2c22c65d5</entry>
Apr 11 15:21:20 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:21:20 user nova-compute[71229]:     </system>
Apr 11 15:21:20 user nova-compute[71229]:   </sysinfo>
Apr 11 15:21:20 user nova-compute[71229]:   <os>
Apr 11 15:21:20 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:21:20 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 15:21:20 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:21:20 user nova-compute[71229]:   </os>
Apr 11 15:21:20 user nova-compute[71229]:   <features>
Apr 11 15:21:20 user nova-compute[71229]:     <acpi/>
Apr 11 15:21:20 user nova-compute[71229]:     <apic/>
Apr 11 15:21:20 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:21:20 user nova-compute[71229]:   </features>
Apr 11 15:21:20 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:21:20 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:21:20 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:21:20 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:21:20 user nova-compute[71229]:   </clock>
Apr 11 15:21:20 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:21:20 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:21:20 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:21:20 user nova-compute[71229]:   </cpu>
Apr 11 15:21:20 user nova-compute[71229]:   <devices>
Apr 11 15:21:20 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 15:21:20 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 15:21:20 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/4b1dedd0-ae18-421b-b83a-a7b2c22c65d5/disk"/>
Apr 11 15:21:20 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:21:20 user nova-compute[71229]:     </disk>
Apr 11 15:21:20 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:21:20 user nova-compute[71229]:       <mac address="fa:16:3e:08:c1:ec"/>
Apr 11 15:21:20 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:21:20 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:21:20 user nova-compute[71229]:       <target dev="tape92694db-c1"/>
Apr 11 15:21:20 user nova-compute[71229]:     </interface>
Apr 11 15:21:20 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:21:20 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/4b1dedd0-ae18-421b-b83a-a7b2c22c65d5/console.log" append="off"/>
Apr 11 15:21:20 user nova-compute[71229]:     </serial>
Apr 11 15:21:20 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:21:20 user nova-compute[71229]:     <video>
Apr 11 15:21:20 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:21:20 user nova-compute[71229]:     </video>
Apr 11 15:21:20 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:21:20 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:21:20 user nova-compute[71229]:     </rng>
Apr 11 15:21:20 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:21:20 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:21:20 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:21:20 user nova-compute[71229]:     </memballoon>
Apr 11 15:21:20 user nova-compute[71229]:   </devices>
Apr 11 15:21:20 user nova-compute[71229]: </domain>
Apr 11 15:21:20 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:21:20 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:21:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-934769884',display_name='tempest-VolumesActionsTest-instance-934769884',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-934769884',id=4,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4a341ccfc0b4f08bb2e97083143dd40',ramdisk_id='',reservation_id='r-aldf7xge',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1278032672',owner_user_name='tempest-VolumesActionsTest-1278032672-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:21:17Z,user_data=None,user_id='acc44d2042554ca0b0bde4b2de5b566a',uuid=4b1dedd0-ae18-421b-b83a-a7b2c22c65d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e92694db-c1b5-4366-bf78-1f6340cab2fe", "address": "fa:16:3e:08:c1:ec", "network": {"id": "5b9dc948-4f8b-460a-bc87-04cf194f5c08", "bridge": "br-int", "label": "tempest-VolumesActionsTest-712454576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b4a341ccfc0b4f08bb2e97083143dd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape92694db-c1", "ovs_interfaceid": "e92694db-c1b5-4366-bf78-1f6340cab2fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:21:20 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Converting VIF {"id": "e92694db-c1b5-4366-bf78-1f6340cab2fe", "address": "fa:16:3e:08:c1:ec", "network": {"id": "5b9dc948-4f8b-460a-bc87-04cf194f5c08", "bridge": "br-int", "label": "tempest-VolumesActionsTest-712454576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b4a341ccfc0b4f08bb2e97083143dd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape92694db-c1", "ovs_interfaceid": "e92694db-c1b5-4366-bf78-1f6340cab2fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:21:20 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:c1:ec,bridge_name='br-int',has_traffic_filtering=True,id=e92694db-c1b5-4366-bf78-1f6340cab2fe,network=Network(5b9dc948-4f8b-460a-bc87-04cf194f5c08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape92694db-c1') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:21:20 user nova-compute[71229]: DEBUG os_vif [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:c1:ec,bridge_name='br-int',has_traffic_filtering=True,id=e92694db-c1b5-4366-bf78-1f6340cab2fe,network=Network(5b9dc948-4f8b-460a-bc87-04cf194f5c08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape92694db-c1') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:21:20 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:20 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:21:20 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:21:20 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:20 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape92694db-c1, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:21:20 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape92694db-c1, col_values=(('external_ids', {'iface-id': 'e92694db-c1b5-4366-bf78-1f6340cab2fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:c1:ec', 'vm-uuid': '4b1dedd0-ae18-421b-b83a-a7b2c22c65d5'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:21:20 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:20 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:20 user nova-compute[71229]: INFO os_vif [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:c1:ec,bridge_name='br-int',has_traffic_filtering=True,id=e92694db-c1b5-4366-bf78-1f6340cab2fe,network=Network(5b9dc948-4f8b-460a-bc87-04cf194f5c08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape92694db-c1')
Apr 11 15:21:20 user nova-compute[71229]: INFO nova.compute.manager [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Took 14.90 seconds to build instance.
Apr 11 15:21:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f63eb9eb-4565-4a97-a6aa-e0eb747a4ea2 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "6a805345-374c-4326-9e8f-39bfc7947a35" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.189s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:21:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] No VIF found with MAC fa:16:3e:08:c1:ec, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:21:21 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:21 user nova-compute[71229]: DEBUG nova.compute.manager [req-7a42968a-3801-4e12-9eae-a1701887dd1f req-df32e56e-9c45-4531-a68b-47b2fe76f2ed service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Received event network-vif-plugged-d8c64197-b034-4f38-821d-ba030f1fca6b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:21:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-7a42968a-3801-4e12-9eae-a1701887dd1f req-df32e56e-9c45-4531-a68b-47b2fe76f2ed service nova] Acquiring lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-7a42968a-3801-4e12-9eae-a1701887dd1f req-df32e56e-9c45-4531-a68b-47b2fe76f2ed service nova] Lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-7a42968a-3801-4e12-9eae-a1701887dd1f req-df32e56e-9c45-4531-a68b-47b2fe76f2ed service nova] Lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:21 user nova-compute[71229]: DEBUG nova.compute.manager [req-7a42968a-3801-4e12-9eae-a1701887dd1f req-df32e56e-9c45-4531-a68b-47b2fe76f2ed service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] No waiting events found dispatching network-vif-plugged-d8c64197-b034-4f38-821d-ba030f1fca6b {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:21:21 user nova-compute[71229]: WARNING nova.compute.manager [req-7a42968a-3801-4e12-9eae-a1701887dd1f req-df32e56e-9c45-4531-a68b-47b2fe76f2ed service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Received unexpected event network-vif-plugged-d8c64197-b034-4f38-821d-ba030f1fca6b for instance with vm_state active and task_state None.
Apr 11 15:21:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Acquiring lock "8d84862f-b710-48b1-9275-93fc799cf1f9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "8d84862f-b710-48b1-9275-93fc799cf1f9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:22 user nova-compute[71229]: DEBUG nova.compute.manager [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Starting instance... {{(pid=71229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 15:21:22 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:22 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:22 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 15:21:22 user nova-compute[71229]: INFO nova.compute.claims [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Claim successful on node user
Apr 11 15:21:22 user nova-compute[71229]: DEBUG nova.network.neutron [req-11476a04-9b73-41d6-8271-1606330f9b17 req-3fb2fd54-cec8-4644-98e1-8efb6ae868c6 service nova] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Updated VIF entry in instance network info cache for port e92694db-c1b5-4366-bf78-1f6340cab2fe. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:21:22 user nova-compute[71229]: DEBUG nova.network.neutron [req-11476a04-9b73-41d6-8271-1606330f9b17 req-3fb2fd54-cec8-4644-98e1-8efb6ae868c6 service nova] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Updating instance_info_cache with network_info: [{"id": "e92694db-c1b5-4366-bf78-1f6340cab2fe", "address": "fa:16:3e:08:c1:ec", "network": {"id": "5b9dc948-4f8b-460a-bc87-04cf194f5c08", "bridge": "br-int", "label": "tempest-VolumesActionsTest-712454576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b4a341ccfc0b4f08bb2e97083143dd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape92694db-c1", "ovs_interfaceid": "e92694db-c1b5-4366-bf78-1f6340cab2fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:21:22 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-11476a04-9b73-41d6-8271-1606330f9b17 req-3fb2fd54-cec8-4644-98e1-8efb6ae868c6 service nova] Releasing lock "refresh_cache-4b1dedd0-ae18-421b-b83a-a7b2c22c65d5" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:21:22 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:21:22 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:21:22 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.649s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:22 user nova-compute[71229]: DEBUG nova.compute.manager [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Start building networks asynchronously for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 15:21:23 user nova-compute[71229]: DEBUG nova.compute.manager [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Allocating IP information in the background. {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 15:21:23 user nova-compute[71229]: DEBUG nova.network.neutron [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] allocate_for_instance() {{(pid=71229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 15:21:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:23 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 15:21:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:23 user nova-compute[71229]: DEBUG nova.compute.manager [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Start building block device mappings for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 15:21:23 user nova-compute[71229]: DEBUG nova.policy [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a2ec75db561b4fec903a1a391c3d03e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c88bf2782342c8af04195140d6cd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71229) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 15:21:23 user nova-compute[71229]: DEBUG nova.compute.manager [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Start spawning the instance on the hypervisor. {{(pid=71229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 15:21:23 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Creating instance directory {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 15:21:23 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Creating image(s)
Apr 11 15:21:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Acquiring lock "/opt/stack/data/nova/instances/8d84862f-b710-48b1-9275-93fc799cf1f9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "/opt/stack/data/nova/instances/8d84862f-b710-48b1-9275-93fc799cf1f9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "/opt/stack/data/nova/instances/8d84862f-b710-48b1-9275-93fc799cf1f9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:23 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:23 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.240s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Acquiring lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:23 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:23 user nova-compute[71229]: DEBUG nova.compute.manager [req-086376fa-985a-4a3a-9c38-88e3e36b6932 req-ae48e5b5-9418-4ee8-9c9e-4fedd186e27a service nova] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Received event network-vif-plugged-e92694db-c1b5-4366-bf78-1f6340cab2fe {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:21:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-086376fa-985a-4a3a-9c38-88e3e36b6932 req-ae48e5b5-9418-4ee8-9c9e-4fedd186e27a service nova] Acquiring lock "4b1dedd0-ae18-421b-b83a-a7b2c22c65d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-086376fa-985a-4a3a-9c38-88e3e36b6932 req-ae48e5b5-9418-4ee8-9c9e-4fedd186e27a service nova] Lock "4b1dedd0-ae18-421b-b83a-a7b2c22c65d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-086376fa-985a-4a3a-9c38-88e3e36b6932 req-ae48e5b5-9418-4ee8-9c9e-4fedd186e27a service nova] Lock "4b1dedd0-ae18-421b-b83a-a7b2c22c65d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:23 user nova-compute[71229]: DEBUG nova.compute.manager [req-086376fa-985a-4a3a-9c38-88e3e36b6932 req-ae48e5b5-9418-4ee8-9c9e-4fedd186e27a service nova] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] No waiting events found dispatching network-vif-plugged-e92694db-c1b5-4366-bf78-1f6340cab2fe {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:21:23 user nova-compute[71229]: WARNING nova.compute.manager [req-086376fa-985a-4a3a-9c38-88e3e36b6932 req-ae48e5b5-9418-4ee8-9c9e-4fedd186e27a service nova] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Received unexpected event network-vif-plugged-e92694db-c1b5-4366-bf78-1f6340cab2fe for instance with vm_state building and task_state spawning.
Apr 11 15:21:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "f3a06747-0f43-4731-87e6-40629c382a6b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "f3a06747-0f43-4731-87e6-40629c382a6b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:23 user nova-compute[71229]: DEBUG nova.compute.manager [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Starting instance... {{(pid=71229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 15:21:23 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.169s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:23 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/8d84862f-b710-48b1-9275-93fc799cf1f9/disk 1073741824 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:24 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/8d84862f-b710-48b1-9275-93fc799cf1f9/disk 1073741824" returned: 0 in 0.094s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:24 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:24 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 15:21:24 user nova-compute[71229]: INFO nova.compute.claims [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Claim successful on node user
Apr 11 15:21:24 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.186s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:24 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8d84862f-b710-48b1-9275-93fc799cf1f9/disk. size=1073741824 {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 15:21:24 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d84862f-b710-48b1-9275-93fc799cf1f9/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:24 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d84862f-b710-48b1-9275-93fc799cf1f9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:24 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Cannot resize image /opt/stack/data/nova/instances/8d84862f-b710-48b1-9275-93fc799cf1f9/disk to a smaller size. {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 15:21:24 user nova-compute[71229]: DEBUG nova.objects.instance [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lazy-loading 'migration_context' on Instance uuid 8d84862f-b710-48b1-9275-93fc799cf1f9 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:21:24 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Created local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 15:21:24 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Ensure instance console log exists: /opt/stack/data/nova/instances/8d84862f-b710-48b1-9275-93fc799cf1f9/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 15:21:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:24 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:21:24 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:21:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.545s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:24 user nova-compute[71229]: DEBUG nova.compute.manager [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Start building networks asynchronously for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 15:21:24 user nova-compute[71229]: DEBUG nova.compute.manager [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Allocating IP information in the background. {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 15:21:24 user nova-compute[71229]: DEBUG nova.network.neutron [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] allocate_for_instance() {{(pid=71229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 15:21:24 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 15:21:24 user nova-compute[71229]: DEBUG nova.compute.manager [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Start building block device mappings for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 15:21:24 user nova-compute[71229]: DEBUG nova.network.neutron [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Successfully created port: bcba48c0-9931-4249-925c-57cb387499d1 {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 15:21:24 user nova-compute[71229]: DEBUG nova.policy [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2717e456dcc941899c48c3c973083bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da140971126a4d298ff718275e7a22ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71229) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 15:21:24 user nova-compute[71229]: DEBUG nova.compute.manager [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Start spawning the instance on the hypervisor. {{(pid=71229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 15:21:24 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Creating instance directory {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 15:21:24 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Creating image(s)
Apr 11 15:21:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "/opt/stack/data/nova/instances/f3a06747-0f43-4731-87e6-40629c382a6b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "/opt/stack/data/nova/instances/f3a06747-0f43-4731-87e6-40629c382a6b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "/opt/stack/data/nova/instances/f3a06747-0f43-4731-87e6-40629c382a6b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:24 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.166s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.252s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/f3a06747-0f43-4731-87e6-40629c382a6b/disk 1073741824 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/f3a06747-0f43-4731-87e6-40629c382a6b/disk 1073741824" returned: 0 in 0.068s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.337s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.186s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:25 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f3a06747-0f43-4731-87e6-40629c382a6b/disk. size=1073741824 {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 15:21:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a06747-0f43-4731-87e6-40629c382a6b/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:25 user nova-compute[71229]: DEBUG nova.compute.manager [req-42692eef-fe8d-416c-afb9-04db6b7fa634 req-e3ba58b1-e8fd-41c8-9928-6960b79ea6f2 service nova] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Received event network-vif-plugged-e92694db-c1b5-4366-bf78-1f6340cab2fe {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:21:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-42692eef-fe8d-416c-afb9-04db6b7fa634 req-e3ba58b1-e8fd-41c8-9928-6960b79ea6f2 service nova] Acquiring lock "4b1dedd0-ae18-421b-b83a-a7b2c22c65d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-42692eef-fe8d-416c-afb9-04db6b7fa634 req-e3ba58b1-e8fd-41c8-9928-6960b79ea6f2 service nova] Lock "4b1dedd0-ae18-421b-b83a-a7b2c22c65d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-42692eef-fe8d-416c-afb9-04db6b7fa634 req-e3ba58b1-e8fd-41c8-9928-6960b79ea6f2 service nova] Lock "4b1dedd0-ae18-421b-b83a-a7b2c22c65d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:25 user nova-compute[71229]: DEBUG nova.compute.manager [req-42692eef-fe8d-416c-afb9-04db6b7fa634 req-e3ba58b1-e8fd-41c8-9928-6960b79ea6f2 service nova] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] No waiting events found dispatching network-vif-plugged-e92694db-c1b5-4366-bf78-1f6340cab2fe {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:21:25 user nova-compute[71229]: WARNING nova.compute.manager [req-42692eef-fe8d-416c-afb9-04db6b7fa634 req-e3ba58b1-e8fd-41c8-9928-6960b79ea6f2 service nova] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Received unexpected event network-vif-plugged-e92694db-c1b5-4366-bf78-1f6340cab2fe for instance with vm_state building and task_state spawning.
Apr 11 15:21:25 user nova-compute[71229]: DEBUG nova.network.neutron [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Successfully updated port: bcba48c0-9931-4249-925c-57cb387499d1 {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:21:25 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681226485.9122117, 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5 => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:21:25 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] VM Resumed (Lifecycle Event)
Apr 11 15:21:25 user nova-compute[71229]: DEBUG nova.compute.manager [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 15:21:25 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Guest created on hypervisor {{(pid=71229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 15:21:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a06747-0f43-4731-87e6-40629c382a6b/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:25 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Cannot resize image /opt/stack/data/nova/instances/f3a06747-0f43-4731-87e6-40629c382a6b/disk to a smaller size. {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 15:21:25 user nova-compute[71229]: DEBUG nova.objects.instance [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lazy-loading 'migration_context' on Instance uuid f3a06747-0f43-4731-87e6-40629c382a6b {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:21:25 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:21:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Acquiring lock "refresh_cache-8d84862f-b710-48b1-9275-93fc799cf1f9" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:21:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Acquired lock "refresh_cache-8d84862f-b710-48b1-9275-93fc799cf1f9" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:21:25 user nova-compute[71229]: DEBUG nova.network.neutron [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:21:25 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Created local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 15:21:25 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Ensure instance console log exists: /opt/stack/data/nova/instances/f3a06747-0f43-4731-87e6-40629c382a6b/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 15:21:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:25 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Instance spawned successfully.
Apr 11 15:21:25 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 15:21:26 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:21:26 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Found default for hw_cdrom_bus of ide {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:21:26 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Found default for hw_disk_bus of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:21:26 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Found default for hw_input_bus of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:21:26 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Found default for hw_pointer_model of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:21:26 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Found default for hw_video_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:21:26 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Found default for hw_vif_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:21:26 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:21:26 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681226485.9124284, 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5 => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:21:26 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] VM Started (Lifecycle Event)
Apr 11 15:21:26 user nova-compute[71229]: DEBUG nova.network.neutron [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:21:26 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:21:26 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:21:26 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:21:26 user nova-compute[71229]: DEBUG nova.network.neutron [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Successfully created port: a7049f98-5ea1-4167-be7f-3206830f17c4 {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 15:21:26 user nova-compute[71229]: INFO nova.compute.manager [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Took 9.31 seconds to spawn the instance on the hypervisor.
Apr 11 15:21:26 user nova-compute[71229]: DEBUG nova.compute.manager [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:21:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:26 user nova-compute[71229]: INFO nova.compute.manager [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Took 10.38 seconds to build instance.
Apr 11 15:21:26 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ab35993d-b31e-467d-b817-72e26f0d1b85 tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "4b1dedd0-ae18-421b-b83a-a7b2c22c65d5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.579s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:26 user nova-compute[71229]: DEBUG nova.network.neutron [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Updating instance_info_cache with network_info: [{"id": "bcba48c0-9931-4249-925c-57cb387499d1", "address": "fa:16:3e:99:2a:86", "network": {"id": "d861c3b4-c929-43bb-83c3-e746f8119831", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2114528813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c88bf2782342c8af04195140d6cd0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcba48c0-99", "ovs_interfaceid": "bcba48c0-9931-4249-925c-57cb387499d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:21:26 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Releasing lock "refresh_cache-8d84862f-b710-48b1-9275-93fc799cf1f9" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:21:26 user nova-compute[71229]: DEBUG nova.compute.manager [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Instance network_info: |[{"id": "bcba48c0-9931-4249-925c-57cb387499d1", "address": "fa:16:3e:99:2a:86", "network": {"id": "d861c3b4-c929-43bb-83c3-e746f8119831", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2114528813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c88bf2782342c8af04195140d6cd0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcba48c0-99", "ovs_interfaceid": "bcba48c0-9931-4249-925c-57cb387499d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 15:21:26 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Start _get_guest_xml network_info=[{"id": "bcba48c0-9931-4249-925c-57cb387499d1", "address": "fa:16:3e:99:2a:86", "network": {"id": "d861c3b4-c929-43bb-83c3-e746f8119831", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2114528813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c88bf2782342c8af04195140d6cd0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcba48c0-99", "ovs_interfaceid": "bcba48c0-9931-4249-925c-57cb387499d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '52fe638c-5ada-47d5-b376-233bfa808a37'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:21:26 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:21:26 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:21:26 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:21:26 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:21:26 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:21:26 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:21:26 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:21:26 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:21:26 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:21:26 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:21:26 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:21:26 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:21:26 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:21:26 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:21:26 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:21:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1927487601',display_name='tempest-TestVolumeSwap-server-1927487601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1927487601',id=5,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXe2oYf9bHTZuGSH+I98VCNh4n8J86bhrRtZei09K0Pc1rXzA6ZGLlg6dYTh2vwT7HQFXKOvrkAxNKF8kQZmFeBvV71cpVJ8itjkiYcKvNJUpIPXBRA/2eZnMt0gU1MDg==',key_name='tempest-keypair-445229818',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7c88bf2782342c8af04195140d6cd0e',ramdisk_id='',reservation_id='r-1x8pfb2q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1716929011',owner_user_name='tempest-TestVolumeSwap-1716929011-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:21:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2ec75db561b4fec903a1a391c3d03e3',uuid=8d84862f-b710-48b1-9275-93fc799cf1f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bcba48c0-9931-4249-925c-57cb387499d1", "address": "fa:16:3e:99:2a:86", "network": {"id": "d861c3b4-c929-43bb-83c3-e746f8119831", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2114528813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c88bf2782342c8af04195140d6cd0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcba48c0-99", "ovs_interfaceid": "bcba48c0-9931-4249-925c-57cb387499d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:21:26 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Converting VIF {"id": "bcba48c0-9931-4249-925c-57cb387499d1", "address": "fa:16:3e:99:2a:86", "network": {"id": "d861c3b4-c929-43bb-83c3-e746f8119831", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2114528813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c88bf2782342c8af04195140d6cd0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcba48c0-99", "ovs_interfaceid": "bcba48c0-9931-4249-925c-57cb387499d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:21:26 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:2a:86,bridge_name='br-int',has_traffic_filtering=True,id=bcba48c0-9931-4249-925c-57cb387499d1,network=Network(d861c3b4-c929-43bb-83c3-e746f8119831),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcba48c0-99') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:21:26 user nova-compute[71229]: DEBUG nova.objects.instance [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d84862f-b710-48b1-9275-93fc799cf1f9 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:21:26 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:21:26 user nova-compute[71229]:   <uuid>8d84862f-b710-48b1-9275-93fc799cf1f9</uuid>
Apr 11 15:21:26 user nova-compute[71229]:   <name>instance-00000005</name>
Apr 11 15:21:26 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:21:26 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:21:26 user nova-compute[71229]:   <metadata>
Apr 11 15:21:26 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:21:26 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:21:26 user nova-compute[71229]:       <nova:name>tempest-TestVolumeSwap-server-1927487601</nova:name>
Apr 11 15:21:26 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:21:26</nova:creationTime>
Apr 11 15:21:26 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:21:26 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:21:26 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:21:26 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:21:26 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:21:26 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:21:26 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:21:26 user nova-compute[71229]:       <nova:owner>
Apr 11 15:21:26 user nova-compute[71229]:         <nova:user uuid="a2ec75db561b4fec903a1a391c3d03e3">tempest-TestVolumeSwap-1716929011-project-member</nova:user>
Apr 11 15:21:26 user nova-compute[71229]:         <nova:project uuid="f7c88bf2782342c8af04195140d6cd0e">tempest-TestVolumeSwap-1716929011</nova:project>
Apr 11 15:21:26 user nova-compute[71229]:       </nova:owner>
Apr 11 15:21:26 user nova-compute[71229]:       <nova:root type="image" uuid="52fe638c-5ada-47d5-b376-233bfa808a37"/>
Apr 11 15:21:26 user nova-compute[71229]:       <nova:ports>
Apr 11 15:21:26 user nova-compute[71229]:         <nova:port uuid="bcba48c0-9931-4249-925c-57cb387499d1">
Apr 11 15:21:26 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 11 15:21:26 user nova-compute[71229]:         </nova:port>
Apr 11 15:21:26 user nova-compute[71229]:       </nova:ports>
Apr 11 15:21:26 user nova-compute[71229]:     </nova:instance>
Apr 11 15:21:26 user nova-compute[71229]:   </metadata>
Apr 11 15:21:26 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:21:26 user nova-compute[71229]:     <system>
Apr 11 15:21:26 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:21:26 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:21:26 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:21:26 user nova-compute[71229]:       <entry name="serial">8d84862f-b710-48b1-9275-93fc799cf1f9</entry>
Apr 11 15:21:26 user nova-compute[71229]:       <entry name="uuid">8d84862f-b710-48b1-9275-93fc799cf1f9</entry>
Apr 11 15:21:26 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:21:26 user nova-compute[71229]:     </system>
Apr 11 15:21:26 user nova-compute[71229]:   </sysinfo>
Apr 11 15:21:26 user nova-compute[71229]:   <os>
Apr 11 15:21:26 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:21:26 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 15:21:26 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:21:26 user nova-compute[71229]:   </os>
Apr 11 15:21:26 user nova-compute[71229]:   <features>
Apr 11 15:21:26 user nova-compute[71229]:     <acpi/>
Apr 11 15:21:26 user nova-compute[71229]:     <apic/>
Apr 11 15:21:26 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:21:26 user nova-compute[71229]:   </features>
Apr 11 15:21:26 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:21:26 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:21:26 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:21:26 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:21:26 user nova-compute[71229]:   </clock>
Apr 11 15:21:26 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:21:26 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:21:26 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:21:26 user nova-compute[71229]:   </cpu>
Apr 11 15:21:26 user nova-compute[71229]:   <devices>
Apr 11 15:21:26 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 15:21:26 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 15:21:26 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/8d84862f-b710-48b1-9275-93fc799cf1f9/disk"/>
Apr 11 15:21:26 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:21:26 user nova-compute[71229]:     </disk>
Apr 11 15:21:26 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:21:26 user nova-compute[71229]:       <mac address="fa:16:3e:99:2a:86"/>
Apr 11 15:21:26 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:21:26 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:21:26 user nova-compute[71229]:       <target dev="tapbcba48c0-99"/>
Apr 11 15:21:26 user nova-compute[71229]:     </interface>
Apr 11 15:21:26 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:21:26 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/8d84862f-b710-48b1-9275-93fc799cf1f9/console.log" append="off"/>
Apr 11 15:21:26 user nova-compute[71229]:     </serial>
Apr 11 15:21:26 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:21:26 user nova-compute[71229]:     <video>
Apr 11 15:21:26 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:21:26 user nova-compute[71229]:     </video>
Apr 11 15:21:26 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:21:26 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:21:26 user nova-compute[71229]:     </rng>
Apr 11 15:21:26 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:21:26 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:21:26 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:21:26 user nova-compute[71229]:     </memballoon>
Apr 11 15:21:26 user nova-compute[71229]:   </devices>
Apr 11 15:21:26 user nova-compute[71229]: </domain>
Apr 11 15:21:26 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:21:26 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:21:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1927487601',display_name='tempest-TestVolumeSwap-server-1927487601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1927487601',id=5,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXe2oYf9bHTZuGSH+I98VCNh4n8J86bhrRtZei09K0Pc1rXzA6ZGLlg6dYTh2vwT7HQFXKOvrkAxNKF8kQZmFeBvV71cpVJ8itjkiYcKvNJUpIPXBRA/2eZnMt0gU1MDg==',key_name='tempest-keypair-445229818',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7c88bf2782342c8af04195140d6cd0e',ramdisk_id='',reservation_id='r-1x8pfb2q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1716929011',owner_user_name='tempest-TestVolumeSwap-1716929011-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:21:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2ec75db561b4fec903a1a391c3d03e3',uuid=8d84862f-b710-48b1-9275-93fc799cf1f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bcba48c0-9931-4249-925c-57cb387499d1", "address": "fa:16:3e:99:2a:86", "network": {"id": "d861c3b4-c929-43bb-83c3-e746f8119831", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2114528813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c88bf2782342c8af04195140d6cd0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcba48c0-99", "ovs_interfaceid": "bcba48c0-9931-4249-925c-57cb387499d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:21:26 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Converting VIF {"id": "bcba48c0-9931-4249-925c-57cb387499d1", "address": "fa:16:3e:99:2a:86", "network": {"id": "d861c3b4-c929-43bb-83c3-e746f8119831", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2114528813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c88bf2782342c8af04195140d6cd0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcba48c0-99", "ovs_interfaceid": "bcba48c0-9931-4249-925c-57cb387499d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:21:26 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:2a:86,bridge_name='br-int',has_traffic_filtering=True,id=bcba48c0-9931-4249-925c-57cb387499d1,network=Network(d861c3b4-c929-43bb-83c3-e746f8119831),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcba48c0-99') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:21:26 user nova-compute[71229]: DEBUG os_vif [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:2a:86,bridge_name='br-int',has_traffic_filtering=True,id=bcba48c0-9931-4249-925c-57cb387499d1,network=Network(d861c3b4-c929-43bb-83c3-e746f8119831),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcba48c0-99') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:21:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:21:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:21:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbcba48c0-99, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:21:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbcba48c0-99, col_values=(('external_ids', {'iface-id': 'bcba48c0-9931-4249-925c-57cb387499d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:2a:86', 'vm-uuid': '8d84862f-b710-48b1-9275-93fc799cf1f9'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:21:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:21:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:26 user nova-compute[71229]: INFO os_vif [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:2a:86,bridge_name='br-int',has_traffic_filtering=True,id=bcba48c0-9931-4249-925c-57cb387499d1,network=Network(d861c3b4-c929-43bb-83c3-e746f8119831),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcba48c0-99')
Apr 11 15:21:26 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:21:26 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] No VIF found with MAC fa:16:3e:99:2a:86, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:21:27 user nova-compute[71229]: DEBUG nova.network.neutron [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Successfully updated port: a7049f98-5ea1-4167-be7f-3206830f17c4 {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:21:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "refresh_cache-f3a06747-0f43-4731-87e6-40629c382a6b" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:21:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquired lock "refresh_cache-f3a06747-0f43-4731-87e6-40629c382a6b" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:21:27 user nova-compute[71229]: DEBUG nova.network.neutron [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:21:27 user nova-compute[71229]: DEBUG nova.compute.manager [req-f74d660c-0ea7-46c6-a228-1558f1256ae1 req-f850db52-2db2-43de-8512-fe1320ce30e0 service nova] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Received event network-changed-a7049f98-5ea1-4167-be7f-3206830f17c4 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:21:27 user nova-compute[71229]: DEBUG nova.compute.manager [req-f74d660c-0ea7-46c6-a228-1558f1256ae1 req-f850db52-2db2-43de-8512-fe1320ce30e0 service nova] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Refreshing instance network info cache due to event network-changed-a7049f98-5ea1-4167-be7f-3206830f17c4. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:21:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-f74d660c-0ea7-46c6-a228-1558f1256ae1 req-f850db52-2db2-43de-8512-fe1320ce30e0 service nova] Acquiring lock "refresh_cache-f3a06747-0f43-4731-87e6-40629c382a6b" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:21:27 user nova-compute[71229]: DEBUG nova.network.neutron [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:21:27 user nova-compute[71229]: DEBUG nova.compute.manager [req-7eb30856-b9d7-477b-9b97-07908a6005ea req-e26b84f2-3a9c-401a-b1f6-17734bc28b27 service nova] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Received event network-changed-bcba48c0-9931-4249-925c-57cb387499d1 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:21:27 user nova-compute[71229]: DEBUG nova.compute.manager [req-7eb30856-b9d7-477b-9b97-07908a6005ea req-e26b84f2-3a9c-401a-b1f6-17734bc28b27 service nova] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Refreshing instance network info cache due to event network-changed-bcba48c0-9931-4249-925c-57cb387499d1. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:21:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-7eb30856-b9d7-477b-9b97-07908a6005ea req-e26b84f2-3a9c-401a-b1f6-17734bc28b27 service nova] Acquiring lock "refresh_cache-8d84862f-b710-48b1-9275-93fc799cf1f9" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:21:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-7eb30856-b9d7-477b-9b97-07908a6005ea req-e26b84f2-3a9c-401a-b1f6-17734bc28b27 service nova] Acquired lock "refresh_cache-8d84862f-b710-48b1-9275-93fc799cf1f9" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:21:27 user nova-compute[71229]: DEBUG nova.network.neutron [req-7eb30856-b9d7-477b-9b97-07908a6005ea req-e26b84f2-3a9c-401a-b1f6-17734bc28b27 service nova] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Refreshing network info cache for port bcba48c0-9931-4249-925c-57cb387499d1 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG nova.network.neutron [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Updating instance_info_cache with network_info: [{"id": "a7049f98-5ea1-4167-be7f-3206830f17c4", "address": "fa:16:3e:74:02:c7", "network": {"id": "f52bd4a9-1843-408b-85af-c2124ad01be7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-593462205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da140971126a4d298ff718275e7a22ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7049f98-5e", "ovs_interfaceid": "a7049f98-5ea1-4167-be7f-3206830f17c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Releasing lock "refresh_cache-f3a06747-0f43-4731-87e6-40629c382a6b" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG nova.compute.manager [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Instance network_info: |[{"id": "a7049f98-5ea1-4167-be7f-3206830f17c4", "address": "fa:16:3e:74:02:c7", "network": {"id": "f52bd4a9-1843-408b-85af-c2124ad01be7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-593462205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da140971126a4d298ff718275e7a22ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7049f98-5e", "ovs_interfaceid": "a7049f98-5ea1-4167-be7f-3206830f17c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-f74d660c-0ea7-46c6-a228-1558f1256ae1 req-f850db52-2db2-43de-8512-fe1320ce30e0 service nova] Acquired lock "refresh_cache-f3a06747-0f43-4731-87e6-40629c382a6b" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG nova.network.neutron [req-f74d660c-0ea7-46c6-a228-1558f1256ae1 req-f850db52-2db2-43de-8512-fe1320ce30e0 service nova] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Refreshing network info cache for port a7049f98-5ea1-4167-be7f-3206830f17c4 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Start _get_guest_xml network_info=[{"id": "a7049f98-5ea1-4167-be7f-3206830f17c4", "address": "fa:16:3e:74:02:c7", "network": {"id": "f52bd4a9-1843-408b-85af-c2124ad01be7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-593462205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da140971126a4d298ff718275e7a22ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7049f98-5e", "ovs_interfaceid": "a7049f98-5ea1-4167-be7f-3206830f17c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '52fe638c-5ada-47d5-b376-233bfa808a37'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:21:28 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:21:28 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:21:28 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:21:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-299929658',display_name='tempest-VolumesAdminNegativeTest-server-299929658',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-299929658',id=6,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7+kKApk4z8FCEvSKm9HfkBqfdxWArp+jnXBl4IzRHHwFU8PNMf4o+BnC57wgCpXRd4hoyh/vOZAwA+9ZsLsFmqPY0D3TlKuGhbcr3CvY7kzHuI+987FATt2twOLazm+w==',key_name='tempest-keypair-1249294022',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da140971126a4d298ff718275e7a22ec',ramdisk_id='',reservation_id='r-4bm6ve02',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2033224639',owner_user_name='tempest-VolumesAdminNegativeTest-2033224639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:21:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2717e456dcc941899c48c3c973083bd4',uuid=f3a06747-0f43-4731-87e6-40629c382a6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7049f98-5ea1-4167-be7f-3206830f17c4", "address": "fa:16:3e:74:02:c7", "network": {"id": "f52bd4a9-1843-408b-85af-c2124ad01be7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-593462205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da140971126a4d298ff718275e7a22ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7049f98-5e", "ovs_interfaceid": "a7049f98-5ea1-4167-be7f-3206830f17c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Converting VIF {"id": "a7049f98-5ea1-4167-be7f-3206830f17c4", "address": "fa:16:3e:74:02:c7", "network": {"id": "f52bd4a9-1843-408b-85af-c2124ad01be7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-593462205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da140971126a4d298ff718275e7a22ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7049f98-5e", "ovs_interfaceid": "a7049f98-5ea1-4167-be7f-3206830f17c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:02:c7,bridge_name='br-int',has_traffic_filtering=True,id=a7049f98-5ea1-4167-be7f-3206830f17c4,network=Network(f52bd4a9-1843-408b-85af-c2124ad01be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7049f98-5e') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG nova.objects.instance [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lazy-loading 'pci_devices' on Instance uuid f3a06747-0f43-4731-87e6-40629c382a6b {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:21:28 user nova-compute[71229]:   <uuid>f3a06747-0f43-4731-87e6-40629c382a6b</uuid>
Apr 11 15:21:28 user nova-compute[71229]:   <name>instance-00000006</name>
Apr 11 15:21:28 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:21:28 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:21:28 user nova-compute[71229]:   <metadata>
Apr 11 15:21:28 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:21:28 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:21:28 user nova-compute[71229]:       <nova:name>tempest-VolumesAdminNegativeTest-server-299929658</nova:name>
Apr 11 15:21:28 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:21:28</nova:creationTime>
Apr 11 15:21:28 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:21:28 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:21:28 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:21:28 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:21:28 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:21:28 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:21:28 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:21:28 user nova-compute[71229]:       <nova:owner>
Apr 11 15:21:28 user nova-compute[71229]:         <nova:user uuid="2717e456dcc941899c48c3c973083bd4">tempest-VolumesAdminNegativeTest-2033224639-project-member</nova:user>
Apr 11 15:21:28 user nova-compute[71229]:         <nova:project uuid="da140971126a4d298ff718275e7a22ec">tempest-VolumesAdminNegativeTest-2033224639</nova:project>
Apr 11 15:21:28 user nova-compute[71229]:       </nova:owner>
Apr 11 15:21:28 user nova-compute[71229]:       <nova:root type="image" uuid="52fe638c-5ada-47d5-b376-233bfa808a37"/>
Apr 11 15:21:28 user nova-compute[71229]:       <nova:ports>
Apr 11 15:21:28 user nova-compute[71229]:         <nova:port uuid="a7049f98-5ea1-4167-be7f-3206830f17c4">
Apr 11 15:21:28 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 11 15:21:28 user nova-compute[71229]:         </nova:port>
Apr 11 15:21:28 user nova-compute[71229]:       </nova:ports>
Apr 11 15:21:28 user nova-compute[71229]:     </nova:instance>
Apr 11 15:21:28 user nova-compute[71229]:   </metadata>
Apr 11 15:21:28 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:21:28 user nova-compute[71229]:     <system>
Apr 11 15:21:28 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:21:28 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:21:28 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:21:28 user nova-compute[71229]:       <entry name="serial">f3a06747-0f43-4731-87e6-40629c382a6b</entry>
Apr 11 15:21:28 user nova-compute[71229]:       <entry name="uuid">f3a06747-0f43-4731-87e6-40629c382a6b</entry>
Apr 11 15:21:28 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:21:28 user nova-compute[71229]:     </system>
Apr 11 15:21:28 user nova-compute[71229]:   </sysinfo>
Apr 11 15:21:28 user nova-compute[71229]:   <os>
Apr 11 15:21:28 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:21:28 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 15:21:28 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:21:28 user nova-compute[71229]:   </os>
Apr 11 15:21:28 user nova-compute[71229]:   <features>
Apr 11 15:21:28 user nova-compute[71229]:     <acpi/>
Apr 11 15:21:28 user nova-compute[71229]:     <apic/>
Apr 11 15:21:28 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:21:28 user nova-compute[71229]:   </features>
Apr 11 15:21:28 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:21:28 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:21:28 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:21:28 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:21:28 user nova-compute[71229]:   </clock>
Apr 11 15:21:28 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:21:28 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:21:28 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:21:28 user nova-compute[71229]:   </cpu>
Apr 11 15:21:28 user nova-compute[71229]:   <devices>
Apr 11 15:21:28 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 15:21:28 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 15:21:28 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/f3a06747-0f43-4731-87e6-40629c382a6b/disk"/>
Apr 11 15:21:28 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:21:28 user nova-compute[71229]:     </disk>
Apr 11 15:21:28 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:21:28 user nova-compute[71229]:       <mac address="fa:16:3e:74:02:c7"/>
Apr 11 15:21:28 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:21:28 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:21:28 user nova-compute[71229]:       <target dev="tapa7049f98-5e"/>
Apr 11 15:21:28 user nova-compute[71229]:     </interface>
Apr 11 15:21:28 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:21:28 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/f3a06747-0f43-4731-87e6-40629c382a6b/console.log" append="off"/>
Apr 11 15:21:28 user nova-compute[71229]:     </serial>
Apr 11 15:21:28 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:21:28 user nova-compute[71229]:     <video>
Apr 11 15:21:28 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:21:28 user nova-compute[71229]:     </video>
Apr 11 15:21:28 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:21:28 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:21:28 user nova-compute[71229]:     </rng>
Apr 11 15:21:28 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:21:28 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:21:28 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:21:28 user nova-compute[71229]:     </memballoon>
Apr 11 15:21:28 user nova-compute[71229]:   </devices>
Apr 11 15:21:28 user nova-compute[71229]: </domain>
Apr 11 15:21:28 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:21:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-299929658',display_name='tempest-VolumesAdminNegativeTest-server-299929658',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-299929658',id=6,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7+kKApk4z8FCEvSKm9HfkBqfdxWArp+jnXBl4IzRHHwFU8PNMf4o+BnC57wgCpXRd4hoyh/vOZAwA+9ZsLsFmqPY0D3TlKuGhbcr3CvY7kzHuI+987FATt2twOLazm+w==',key_name='tempest-keypair-1249294022',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da140971126a4d298ff718275e7a22ec',ramdisk_id='',reservation_id='r-4bm6ve02',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2033224639',owner_user_name='tempest-VolumesAdminNegativeTest-2033224639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:21:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2717e456dcc941899c48c3c973083bd4',uuid=f3a06747-0f43-4731-87e6-40629c382a6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7049f98-5ea1-4167-be7f-3206830f17c4", "address": "fa:16:3e:74:02:c7", "network": {"id": "f52bd4a9-1843-408b-85af-c2124ad01be7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-593462205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da140971126a4d298ff718275e7a22ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7049f98-5e", "ovs_interfaceid": "a7049f98-5ea1-4167-be7f-3206830f17c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Converting VIF {"id": "a7049f98-5ea1-4167-be7f-3206830f17c4", "address": "fa:16:3e:74:02:c7", "network": {"id": "f52bd4a9-1843-408b-85af-c2124ad01be7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-593462205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da140971126a4d298ff718275e7a22ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7049f98-5e", "ovs_interfaceid": "a7049f98-5ea1-4167-be7f-3206830f17c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:02:c7,bridge_name='br-int',has_traffic_filtering=True,id=a7049f98-5ea1-4167-be7f-3206830f17c4,network=Network(f52bd4a9-1843-408b-85af-c2124ad01be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7049f98-5e') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG os_vif [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:02:c7,bridge_name='br-int',has_traffic_filtering=True,id=a7049f98-5ea1-4167-be7f-3206830f17c4,network=Network(f52bd4a9-1843-408b-85af-c2124ad01be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7049f98-5e') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa7049f98-5e, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa7049f98-5e, col_values=(('external_ids', {'iface-id': 'a7049f98-5ea1-4167-be7f-3206830f17c4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:02:c7', 'vm-uuid': 'f3a06747-0f43-4731-87e6-40629c382a6b'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:28 user nova-compute[71229]: INFO os_vif [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:02:c7,bridge_name='br-int',has_traffic_filtering=True,id=a7049f98-5ea1-4167-be7f-3206830f17c4,network=Network(f52bd4a9-1843-408b-85af-c2124ad01be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7049f98-5e')
Apr 11 15:21:28 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] No VIF found with MAC fa:16:3e:74:02:c7, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG nova.compute.manager [req-7ba74311-13ee-43a2-bd26-217be0aa95e4 req-20fc7a71-f3db-4d6f-9bd7-920d6f4e33c8 service nova] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Received event network-vif-plugged-bcba48c0-9931-4249-925c-57cb387499d1 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-7ba74311-13ee-43a2-bd26-217be0aa95e4 req-20fc7a71-f3db-4d6f-9bd7-920d6f4e33c8 service nova] Acquiring lock "8d84862f-b710-48b1-9275-93fc799cf1f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-7ba74311-13ee-43a2-bd26-217be0aa95e4 req-20fc7a71-f3db-4d6f-9bd7-920d6f4e33c8 service nova] Lock "8d84862f-b710-48b1-9275-93fc799cf1f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-7ba74311-13ee-43a2-bd26-217be0aa95e4 req-20fc7a71-f3db-4d6f-9bd7-920d6f4e33c8 service nova] Lock "8d84862f-b710-48b1-9275-93fc799cf1f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG nova.compute.manager [req-7ba74311-13ee-43a2-bd26-217be0aa95e4 req-20fc7a71-f3db-4d6f-9bd7-920d6f4e33c8 service nova] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] No waiting events found dispatching network-vif-plugged-bcba48c0-9931-4249-925c-57cb387499d1 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:21:28 user nova-compute[71229]: WARNING nova.compute.manager [req-7ba74311-13ee-43a2-bd26-217be0aa95e4 req-20fc7a71-f3db-4d6f-9bd7-920d6f4e33c8 service nova] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Received unexpected event network-vif-plugged-bcba48c0-9931-4249-925c-57cb387499d1 for instance with vm_state building and task_state spawning.
Apr 11 15:21:28 user nova-compute[71229]: DEBUG nova.network.neutron [req-7eb30856-b9d7-477b-9b97-07908a6005ea req-e26b84f2-3a9c-401a-b1f6-17734bc28b27 service nova] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Updated VIF entry in instance network info cache for port bcba48c0-9931-4249-925c-57cb387499d1. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG nova.network.neutron [req-7eb30856-b9d7-477b-9b97-07908a6005ea req-e26b84f2-3a9c-401a-b1f6-17734bc28b27 service nova] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Updating instance_info_cache with network_info: [{"id": "bcba48c0-9931-4249-925c-57cb387499d1", "address": "fa:16:3e:99:2a:86", "network": {"id": "d861c3b4-c929-43bb-83c3-e746f8119831", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2114528813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c88bf2782342c8af04195140d6cd0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcba48c0-99", "ovs_interfaceid": "bcba48c0-9931-4249-925c-57cb387499d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-7eb30856-b9d7-477b-9b97-07908a6005ea req-e26b84f2-3a9c-401a-b1f6-17734bc28b27 service nova] Releasing lock "refresh_cache-8d84862f-b710-48b1-9275-93fc799cf1f9" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG nova.network.neutron [req-f74d660c-0ea7-46c6-a228-1558f1256ae1 req-f850db52-2db2-43de-8512-fe1320ce30e0 service nova] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Updated VIF entry in instance network info cache for port a7049f98-5ea1-4167-be7f-3206830f17c4. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG nova.network.neutron [req-f74d660c-0ea7-46c6-a228-1558f1256ae1 req-f850db52-2db2-43de-8512-fe1320ce30e0 service nova] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Updating instance_info_cache with network_info: [{"id": "a7049f98-5ea1-4167-be7f-3206830f17c4", "address": "fa:16:3e:74:02:c7", "network": {"id": "f52bd4a9-1843-408b-85af-c2124ad01be7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-593462205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da140971126a4d298ff718275e7a22ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7049f98-5e", "ovs_interfaceid": "a7049f98-5ea1-4167-be7f-3206830f17c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-f74d660c-0ea7-46c6-a228-1558f1256ae1 req-f850db52-2db2-43de-8512-fe1320ce30e0 service nova] Releasing lock "refresh_cache-f3a06747-0f43-4731-87e6-40629c382a6b" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Acquiring lock "2b2c294d-49b2-41bf-89d0-17a560e7741f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "2b2c294d-49b2-41bf-89d0-17a560e7741f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:28 user nova-compute[71229]: DEBUG nova.compute.manager [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Starting instance... {{(pid=71229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 15:21:29 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:29 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:29 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:29 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:29 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 15:21:29 user nova-compute[71229]: INFO nova.compute.claims [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Claim successful on node user
Apr 11 15:21:29 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:30 user nova-compute[71229]: DEBUG nova.compute.manager [req-37f050b8-de7f-4e58-bd0b-10e86bf168e7 req-7fde8fde-c53c-46fe-be98-868b6f2785c8 service nova] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Received event network-vif-plugged-a7049f98-5ea1-4167-be7f-3206830f17c4 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:21:30 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-37f050b8-de7f-4e58-bd0b-10e86bf168e7 req-7fde8fde-c53c-46fe-be98-868b6f2785c8 service nova] Acquiring lock "f3a06747-0f43-4731-87e6-40629c382a6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:30 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-37f050b8-de7f-4e58-bd0b-10e86bf168e7 req-7fde8fde-c53c-46fe-be98-868b6f2785c8 service nova] Lock "f3a06747-0f43-4731-87e6-40629c382a6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:30 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-37f050b8-de7f-4e58-bd0b-10e86bf168e7 req-7fde8fde-c53c-46fe-be98-868b6f2785c8 service nova] Lock "f3a06747-0f43-4731-87e6-40629c382a6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:30 user nova-compute[71229]: DEBUG nova.compute.manager [req-37f050b8-de7f-4e58-bd0b-10e86bf168e7 req-7fde8fde-c53c-46fe-be98-868b6f2785c8 service nova] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] No waiting events found dispatching network-vif-plugged-a7049f98-5ea1-4167-be7f-3206830f17c4 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:21:30 user nova-compute[71229]: WARNING nova.compute.manager [req-37f050b8-de7f-4e58-bd0b-10e86bf168e7 req-7fde8fde-c53c-46fe-be98-868b6f2785c8 service nova] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Received unexpected event network-vif-plugged-a7049f98-5ea1-4167-be7f-3206830f17c4 for instance with vm_state building and task_state spawning.
Apr 11 15:21:30 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:21:30 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:21:30 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.204s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:30 user nova-compute[71229]: DEBUG nova.compute.manager [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Start building networks asynchronously for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 15:21:30 user nova-compute[71229]: DEBUG nova.compute.manager [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Allocating IP information in the background. {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 15:21:30 user nova-compute[71229]: DEBUG nova.network.neutron [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] allocate_for_instance() {{(pid=71229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 15:21:30 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Apr 11 15:21:30 user nova-compute[71229]: DEBUG nova.compute.manager [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Start building block device mappings for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 15:21:30 user nova-compute[71229]: DEBUG nova.policy [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cab8ba2ebb8643a59d3a8a821cd1c2f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e67f7203b1849c0af305f88ad8284f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71229) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 15:21:30 user nova-compute[71229]: DEBUG nova.compute.manager [req-84f9e764-e387-4aee-a2cc-68b6e3aa1e93 req-552b0f46-89f0-48da-b9a1-a01e007fd784 service nova] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Received event network-vif-plugged-bcba48c0-9931-4249-925c-57cb387499d1 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:21:30 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-84f9e764-e387-4aee-a2cc-68b6e3aa1e93 req-552b0f46-89f0-48da-b9a1-a01e007fd784 service nova] Acquiring lock "8d84862f-b710-48b1-9275-93fc799cf1f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:30 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-84f9e764-e387-4aee-a2cc-68b6e3aa1e93 req-552b0f46-89f0-48da-b9a1-a01e007fd784 service nova] Lock "8d84862f-b710-48b1-9275-93fc799cf1f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:30 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-84f9e764-e387-4aee-a2cc-68b6e3aa1e93 req-552b0f46-89f0-48da-b9a1-a01e007fd784 service nova] Lock "8d84862f-b710-48b1-9275-93fc799cf1f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:30 user nova-compute[71229]: DEBUG nova.compute.manager [req-84f9e764-e387-4aee-a2cc-68b6e3aa1e93 req-552b0f46-89f0-48da-b9a1-a01e007fd784 service nova] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] No waiting events found dispatching network-vif-plugged-bcba48c0-9931-4249-925c-57cb387499d1 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:21:30 user nova-compute[71229]: WARNING nova.compute.manager [req-84f9e764-e387-4aee-a2cc-68b6e3aa1e93 req-552b0f46-89f0-48da-b9a1-a01e007fd784 service nova] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Received unexpected event network-vif-plugged-bcba48c0-9931-4249-925c-57cb387499d1 for instance with vm_state building and task_state spawning.
Apr 11 15:21:31 user nova-compute[71229]: DEBUG nova.compute.manager [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Start spawning the instance on the hypervisor. {{(pid=71229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 15:21:31 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Creating instance directory {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 15:21:31 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Creating image(s)
Apr 11 15:21:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Acquiring lock "/opt/stack/data/nova/instances/2b2c294d-49b2-41bf-89d0-17a560e7741f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "/opt/stack/data/nova/instances/2b2c294d-49b2-41bf-89d0-17a560e7741f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "/opt/stack/data/nova/instances/2b2c294d-49b2-41bf-89d0-17a560e7741f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Acquiring lock "0ea4f4863ec734d876b497d439f2cc84b2ac8ad6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "0ea4f4863ec734d876b497d439f2cc84b2ac8ad6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:31 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ea4f4863ec734d876b497d439f2cc84b2ac8ad6.part --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:31 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ea4f4863ec734d876b497d439f2cc84b2ac8ad6.part --force-share --output=json" returned: 0 in 0.145s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:31 user nova-compute[71229]: DEBUG nova.virt.images [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] 3e614d46-369e-4f7d-9d40-f3e9759f60f3 was qcow2, converting to raw {{(pid=71229) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 15:21:31 user nova-compute[71229]: DEBUG nova.privsep.utils [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71229) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 15:21:31 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0ea4f4863ec734d876b497d439f2cc84b2ac8ad6.part /opt/stack/data/nova/instances/_base/0ea4f4863ec734d876b497d439f2cc84b2ac8ad6.converted {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:31 user nova-compute[71229]: DEBUG nova.network.neutron [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Successfully created port: 41b19aaa-a4cf-494a-97e9-c3a081d24d80 {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 15:21:31 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0ea4f4863ec734d876b497d439f2cc84b2ac8ad6.part /opt/stack/data/nova/instances/_base/0ea4f4863ec734d876b497d439f2cc84b2ac8ad6.converted" returned: 0 in 0.169s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:31 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ea4f4863ec734d876b497d439f2cc84b2ac8ad6.converted --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ea4f4863ec734d876b497d439f2cc84b2ac8ad6.converted --force-share --output=json" returned: 0 in 0.423s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "0ea4f4863ec734d876b497d439f2cc84b2ac8ad6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.177s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ea4f4863ec734d876b497d439f2cc84b2ac8ad6 --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ea4f4863ec734d876b497d439f2cc84b2ac8ad6 --force-share --output=json" returned: 0 in 0.175s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Acquiring lock "0ea4f4863ec734d876b497d439f2cc84b2ac8ad6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "0ea4f4863ec734d876b497d439f2cc84b2ac8ad6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ea4f4863ec734d876b497d439f2cc84b2ac8ad6 --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ea4f4863ec734d876b497d439f2cc84b2ac8ad6 --force-share --output=json" returned: 0 in 0.167s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0ea4f4863ec734d876b497d439f2cc84b2ac8ad6,backing_fmt=raw /opt/stack/data/nova/instances/2b2c294d-49b2-41bf-89d0-17a560e7741f/disk 1073741824 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:32 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681226492.5905817, 8d84862f-b710-48b1-9275-93fc799cf1f9 => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:21:32 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] VM Resumed (Lifecycle Event)
Apr 11 15:21:32 user nova-compute[71229]: DEBUG nova.compute.manager [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 15:21:32 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Guest created on hypervisor {{(pid=71229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 15:21:32 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Instance spawned successfully.
Apr 11 15:21:32 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 15:21:32 user nova-compute[71229]: DEBUG nova.compute.manager [req-c07f1845-7a90-4906-85ad-b730bebc21ec req-00e070f5-ec0d-4c80-9631-cc02bc51a084 service nova] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Received event network-vif-plugged-a7049f98-5ea1-4167-be7f-3206830f17c4 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:21:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c07f1845-7a90-4906-85ad-b730bebc21ec req-00e070f5-ec0d-4c80-9631-cc02bc51a084 service nova] Acquiring lock "f3a06747-0f43-4731-87e6-40629c382a6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c07f1845-7a90-4906-85ad-b730bebc21ec req-00e070f5-ec0d-4c80-9631-cc02bc51a084 service nova] Lock "f3a06747-0f43-4731-87e6-40629c382a6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c07f1845-7a90-4906-85ad-b730bebc21ec req-00e070f5-ec0d-4c80-9631-cc02bc51a084 service nova] Lock "f3a06747-0f43-4731-87e6-40629c382a6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:32 user nova-compute[71229]: DEBUG nova.compute.manager [req-c07f1845-7a90-4906-85ad-b730bebc21ec req-00e070f5-ec0d-4c80-9631-cc02bc51a084 service nova] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] No waiting events found dispatching network-vif-plugged-a7049f98-5ea1-4167-be7f-3206830f17c4 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:21:32 user nova-compute[71229]: WARNING nova.compute.manager [req-c07f1845-7a90-4906-85ad-b730bebc21ec req-00e070f5-ec0d-4c80-9631-cc02bc51a084 service nova] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Received unexpected event network-vif-plugged-a7049f98-5ea1-4167-be7f-3206830f17c4 for instance with vm_state building and task_state spawning.
Apr 11 15:21:32 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:21:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0ea4f4863ec734d876b497d439f2cc84b2ac8ad6,backing_fmt=raw /opt/stack/data/nova/instances/2b2c294d-49b2-41bf-89d0-17a560e7741f/disk 1073741824" returned: 0 in 0.110s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "0ea4f4863ec734d876b497d439f2cc84b2ac8ad6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ea4f4863ec734d876b497d439f2cc84b2ac8ad6 --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:32 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:21:32 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Found default for hw_cdrom_bus of ide {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:21:32 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Found default for hw_disk_bus of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:21:32 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Found default for hw_input_bus of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:21:32 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Found default for hw_pointer_model of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:21:32 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Found default for hw_video_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:21:32 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Found default for hw_vif_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:21:32 user nova-compute[71229]: DEBUG nova.network.neutron [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Successfully updated port: 41b19aaa-a4cf-494a-97e9-c3a081d24d80 {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:21:32 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:21:32 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681226492.6074426, 8d84862f-b710-48b1-9275-93fc799cf1f9 => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:21:32 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] VM Started (Lifecycle Event)
Apr 11 15:21:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Acquiring lock "refresh_cache-2b2c294d-49b2-41bf-89d0-17a560e7741f" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:21:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Acquired lock "refresh_cache-2b2c294d-49b2-41bf-89d0-17a560e7741f" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:21:32 user nova-compute[71229]: DEBUG nova.network.neutron [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:21:32 user nova-compute[71229]: DEBUG nova.compute.manager [req-869a8f13-942c-4b37-b8b0-d0567a3f1210 req-08fea766-cad4-48df-ba24-67dffd59c348 service nova] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Received event network-changed-41b19aaa-a4cf-494a-97e9-c3a081d24d80 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:21:32 user nova-compute[71229]: DEBUG nova.compute.manager [req-869a8f13-942c-4b37-b8b0-d0567a3f1210 req-08fea766-cad4-48df-ba24-67dffd59c348 service nova] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Refreshing instance network info cache due to event network-changed-41b19aaa-a4cf-494a-97e9-c3a081d24d80. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:21:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-869a8f13-942c-4b37-b8b0-d0567a3f1210 req-08fea766-cad4-48df-ba24-67dffd59c348 service nova] Acquiring lock "refresh_cache-2b2c294d-49b2-41bf-89d0-17a560e7741f" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:21:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ea4f4863ec734d876b497d439f2cc84b2ac8ad6 --force-share --output=json" returned: 0 in 0.137s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:32 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2b2c294d-49b2-41bf-89d0-17a560e7741f/disk. size=1073741824 {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 15:21:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2c294d-49b2-41bf-89d0-17a560e7741f/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:32 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:21:32 user nova-compute[71229]: INFO nova.compute.manager [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Took 9.39 seconds to spawn the instance on the hypervisor.
Apr 11 15:21:32 user nova-compute[71229]: DEBUG nova.compute.manager [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:21:32 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:21:32 user nova-compute[71229]: DEBUG nova.network.neutron [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:21:32 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:21:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2c294d-49b2-41bf-89d0-17a560e7741f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Cannot resize image /opt/stack/data/nova/instances/2b2c294d-49b2-41bf-89d0-17a560e7741f/disk to a smaller size. {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG nova.objects.instance [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lazy-loading 'migration_context' on Instance uuid 2b2c294d-49b2-41bf-89d0-17a560e7741f {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Created local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Ensure instance console log exists: /opt/stack/data/nova/instances/2b2c294d-49b2-41bf-89d0-17a560e7741f/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:33 user nova-compute[71229]: INFO nova.compute.manager [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Took 11.00 seconds to build instance.
Apr 11 15:21:33 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681226493.1673667, f3a06747-0f43-4731-87e6-40629c382a6b => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:21:33 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] VM Resumed (Lifecycle Event)
Apr 11 15:21:33 user nova-compute[71229]: DEBUG nova.compute.manager [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Guest created on hypervisor {{(pid=71229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c12efb9c-9c9e-487d-a365-0093e492fbd3 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "8d84862f-b710-48b1-9275-93fc799cf1f9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.204s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:33 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Instance spawned successfully.
Apr 11 15:21:33 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Found default for hw_cdrom_bus of ide {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Found default for hw_disk_bus of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Found default for hw_input_bus of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Found default for hw_pointer_model of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Found default for hw_video_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Found default for hw_vif_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:21:33 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:21:33 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681226493.1798205, f3a06747-0f43-4731-87e6-40629c382a6b => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:21:33 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] VM Started (Lifecycle Event)
Apr 11 15:21:33 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:21:33 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:21:33 user nova-compute[71229]: INFO nova.compute.manager [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Took 8.40 seconds to spawn the instance on the hypervisor.
Apr 11 15:21:33 user nova-compute[71229]: DEBUG nova.compute.manager [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:21:33 user nova-compute[71229]: INFO nova.compute.manager [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Took 9.52 seconds to build instance.
Apr 11 15:21:33 user nova-compute[71229]: DEBUG nova.network.neutron [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Updating instance_info_cache with network_info: [{"id": "41b19aaa-a4cf-494a-97e9-c3a081d24d80", "address": "fa:16:3e:ce:80:c4", "network": {"id": "5709c284-0131-449d-869b-bfcf88bbe239", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-578269461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e67f7203b1849c0af305f88ad8284f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41b19aaa-a4", "ovs_interfaceid": "41b19aaa-a4cf-494a-97e9-c3a081d24d80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1dca08b7-89b3-4809-a107-df8048e7a0f9 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "f3a06747-0f43-4731-87e6-40629c382a6b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.695s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Releasing lock "refresh_cache-2b2c294d-49b2-41bf-89d0-17a560e7741f" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG nova.compute.manager [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Instance network_info: |[{"id": "41b19aaa-a4cf-494a-97e9-c3a081d24d80", "address": "fa:16:3e:ce:80:c4", "network": {"id": "5709c284-0131-449d-869b-bfcf88bbe239", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-578269461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e67f7203b1849c0af305f88ad8284f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41b19aaa-a4", "ovs_interfaceid": "41b19aaa-a4cf-494a-97e9-c3a081d24d80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-869a8f13-942c-4b37-b8b0-d0567a3f1210 req-08fea766-cad4-48df-ba24-67dffd59c348 service nova] Acquired lock "refresh_cache-2b2c294d-49b2-41bf-89d0-17a560e7741f" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG nova.network.neutron [req-869a8f13-942c-4b37-b8b0-d0567a3f1210 req-08fea766-cad4-48df-ba24-67dffd59c348 service nova] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Refreshing network info cache for port 41b19aaa-a4cf-494a-97e9-c3a081d24d80 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Start _get_guest_xml network_info=[{"id": "41b19aaa-a4cf-494a-97e9-c3a081d24d80", "address": "fa:16:3e:ce:80:c4", "network": {"id": "5709c284-0131-449d-869b-bfcf88bbe239", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-578269461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e67f7203b1849c0af305f88ad8284f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41b19aaa-a4", "ovs_interfaceid": "41b19aaa-a4cf-494a-97e9-c3a081d24d80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:21:21Z,direct_url=<?>,disk_format='qcow2',id=3e614d46-369e-4f7d-9d40-f3e9759f60f3,min_disk=0,min_ram=0,name='',owner='1f4ada61c0b1431a82d389d5768ead19',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:21:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'scsi', 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/sda', 'device_type': 'disk', 'size': 0, 'image_id': '3e614d46-369e-4f7d-9d40-f3e9759f60f3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:21:33 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:21:33 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:21:33 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:21:21Z,direct_url=<?>,disk_format='qcow2',id=3e614d46-369e-4f7d-9d40-f3e9759f60f3,min_disk=0,min_ram=0,name='',owner='1f4ada61c0b1431a82d389d5768ead19',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:21:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T15:21:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1731751351',display_name='tempest-AttachSCSIVolumeTestJSON-server-1731751351',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1731751351',id=7,image_ref='3e614d46-369e-4f7d-9d40-f3e9759f60f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFG+zxkXnTpf+p02vM4Xm045ubcRVkYMQB82y2IimhiNqNrzMiV7JBv5D8QDKrCrIsbmJVrkWShxDADZaCrqirBShJpvYeU0v7+/LyAPe6u+e6K/qaIcS7cSvQZjtrOk2A==',key_name='tempest-keypair-1093697918',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e67f7203b1849c0af305f88ad8284f9',ramdisk_id='',reservation_id='r-fwwk8bcs',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3e614d46-369e-4f7d-9d40-f3e9759f60f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-19713134',owner_user_name='tempest-AttachSCSIVolumeTestJSON-19713134-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:21:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cab8ba2ebb8643a59d3a8a821cd1c2f1',uuid=2b2c294d-49b2-41bf-89d0-17a560e7741f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41b19aaa-a4cf-494a-97e9-c3a081d24d80", "address": "fa:16:3e:ce:80:c4", "network": {"id": "5709c284-0131-449d-869b-bfcf88bbe239", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-578269461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e67f7203b1849c0af305f88ad8284f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41b19aaa-a4", "ovs_interfaceid": "41b19aaa-a4cf-494a-97e9-c3a081d24d80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Converting VIF {"id": "41b19aaa-a4cf-494a-97e9-c3a081d24d80", "address": "fa:16:3e:ce:80:c4", "network": {"id": "5709c284-0131-449d-869b-bfcf88bbe239", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-578269461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e67f7203b1849c0af305f88ad8284f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41b19aaa-a4", "ovs_interfaceid": "41b19aaa-a4cf-494a-97e9-c3a081d24d80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:80:c4,bridge_name='br-int',has_traffic_filtering=True,id=41b19aaa-a4cf-494a-97e9-c3a081d24d80,network=Network(5709c284-0131-449d-869b-bfcf88bbe239),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41b19aaa-a4') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG nova.objects.instance [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lazy-loading 'pci_devices' on Instance uuid 2b2c294d-49b2-41bf-89d0-17a560e7741f {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:21:33 user nova-compute[71229]:   <uuid>2b2c294d-49b2-41bf-89d0-17a560e7741f</uuid>
Apr 11 15:21:33 user nova-compute[71229]:   <name>instance-00000007</name>
Apr 11 15:21:33 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:21:33 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:21:33 user nova-compute[71229]:   <metadata>
Apr 11 15:21:33 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:21:33 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:21:33 user nova-compute[71229]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1731751351</nova:name>
Apr 11 15:21:33 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:21:33</nova:creationTime>
Apr 11 15:21:33 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:21:33 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:21:33 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:21:33 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:21:33 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:21:33 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:21:33 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:21:33 user nova-compute[71229]:       <nova:owner>
Apr 11 15:21:33 user nova-compute[71229]:         <nova:user uuid="cab8ba2ebb8643a59d3a8a821cd1c2f1">tempest-AttachSCSIVolumeTestJSON-19713134-project-member</nova:user>
Apr 11 15:21:33 user nova-compute[71229]:         <nova:project uuid="7e67f7203b1849c0af305f88ad8284f9">tempest-AttachSCSIVolumeTestJSON-19713134</nova:project>
Apr 11 15:21:33 user nova-compute[71229]:       </nova:owner>
Apr 11 15:21:33 user nova-compute[71229]:       <nova:root type="image" uuid="3e614d46-369e-4f7d-9d40-f3e9759f60f3"/>
Apr 11 15:21:33 user nova-compute[71229]:       <nova:ports>
Apr 11 15:21:33 user nova-compute[71229]:         <nova:port uuid="41b19aaa-a4cf-494a-97e9-c3a081d24d80">
Apr 11 15:21:33 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 11 15:21:33 user nova-compute[71229]:         </nova:port>
Apr 11 15:21:33 user nova-compute[71229]:       </nova:ports>
Apr 11 15:21:33 user nova-compute[71229]:     </nova:instance>
Apr 11 15:21:33 user nova-compute[71229]:   </metadata>
Apr 11 15:21:33 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:21:33 user nova-compute[71229]:     <system>
Apr 11 15:21:33 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:21:33 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:21:33 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:21:33 user nova-compute[71229]:       <entry name="serial">2b2c294d-49b2-41bf-89d0-17a560e7741f</entry>
Apr 11 15:21:33 user nova-compute[71229]:       <entry name="uuid">2b2c294d-49b2-41bf-89d0-17a560e7741f</entry>
Apr 11 15:21:33 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:21:33 user nova-compute[71229]:     </system>
Apr 11 15:21:33 user nova-compute[71229]:   </sysinfo>
Apr 11 15:21:33 user nova-compute[71229]:   <os>
Apr 11 15:21:33 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:21:33 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 15:21:33 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:21:33 user nova-compute[71229]:   </os>
Apr 11 15:21:33 user nova-compute[71229]:   <features>
Apr 11 15:21:33 user nova-compute[71229]:     <acpi/>
Apr 11 15:21:33 user nova-compute[71229]:     <apic/>
Apr 11 15:21:33 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:21:33 user nova-compute[71229]:   </features>
Apr 11 15:21:33 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:21:33 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:21:33 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:21:33 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:21:33 user nova-compute[71229]:   </clock>
Apr 11 15:21:33 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:21:33 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:21:33 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:21:33 user nova-compute[71229]:   </cpu>
Apr 11 15:21:33 user nova-compute[71229]:   <devices>
Apr 11 15:21:33 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 15:21:33 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 15:21:33 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/2b2c294d-49b2-41bf-89d0-17a560e7741f/disk"/>
Apr 11 15:21:33 user nova-compute[71229]:       <target dev="sda" bus="scsi"/>
Apr 11 15:21:33 user nova-compute[71229]:       <address type="drive" controller="0" unit="0"/>
Apr 11 15:21:33 user nova-compute[71229]:     </disk>
Apr 11 15:21:33 user nova-compute[71229]:     <disk type="file" device="cdrom">
Apr 11 15:21:33 user nova-compute[71229]:       <driver name="qemu" type="raw" cache="none"/>
Apr 11 15:21:33 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/2b2c294d-49b2-41bf-89d0-17a560e7741f/disk.config"/>
Apr 11 15:21:33 user nova-compute[71229]:       <target dev="sdb" bus="scsi"/>
Apr 11 15:21:33 user nova-compute[71229]:       <address type="drive" controller="0" unit="1"/>
Apr 11 15:21:33 user nova-compute[71229]:     </disk>
Apr 11 15:21:33 user nova-compute[71229]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Apr 11 15:21:33 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:21:33 user nova-compute[71229]:       <mac address="fa:16:3e:ce:80:c4"/>
Apr 11 15:21:33 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:21:33 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:21:33 user nova-compute[71229]:       <target dev="tap41b19aaa-a4"/>
Apr 11 15:21:33 user nova-compute[71229]:     </interface>
Apr 11 15:21:33 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:21:33 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/2b2c294d-49b2-41bf-89d0-17a560e7741f/console.log" append="off"/>
Apr 11 15:21:33 user nova-compute[71229]:     </serial>
Apr 11 15:21:33 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:21:33 user nova-compute[71229]:     <video>
Apr 11 15:21:33 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:21:33 user nova-compute[71229]:     </video>
Apr 11 15:21:33 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:21:33 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:21:33 user nova-compute[71229]:     </rng>
Apr 11 15:21:33 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:21:33 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:21:33 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:21:33 user nova-compute[71229]:     </memballoon>
Apr 11 15:21:33 user nova-compute[71229]:   </devices>
Apr 11 15:21:33 user nova-compute[71229]: </domain>
Apr 11 15:21:33 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T15:21:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1731751351',display_name='tempest-AttachSCSIVolumeTestJSON-server-1731751351',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1731751351',id=7,image_ref='3e614d46-369e-4f7d-9d40-f3e9759f60f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFG+zxkXnTpf+p02vM4Xm045ubcRVkYMQB82y2IimhiNqNrzMiV7JBv5D8QDKrCrIsbmJVrkWShxDADZaCrqirBShJpvYeU0v7+/LyAPe6u+e6K/qaIcS7cSvQZjtrOk2A==',key_name='tempest-keypair-1093697918',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e67f7203b1849c0af305f88ad8284f9',ramdisk_id='',reservation_id='r-fwwk8bcs',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3e614d46-369e-4f7d-9d40-f3e9759f60f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-19713134',owner_user_name='tempest-AttachSCSIVolumeTestJSON-19713134-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:21:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cab8ba2ebb8643a59d3a8a821cd1c2f1',uuid=2b2c294d-49b2-41bf-89d0-17a560e7741f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41b19aaa-a4cf-494a-97e9-c3a081d24d80", "address": "fa:16:3e:ce:80:c4", "network": {"id": "5709c284-0131-449d-869b-bfcf88bbe239", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-578269461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e67f7203b1849c0af305f88ad8284f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41b19aaa-a4", "ovs_interfaceid": "41b19aaa-a4cf-494a-97e9-c3a081d24d80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Converting VIF {"id": "41b19aaa-a4cf-494a-97e9-c3a081d24d80", "address": "fa:16:3e:ce:80:c4", "network": {"id": "5709c284-0131-449d-869b-bfcf88bbe239", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-578269461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e67f7203b1849c0af305f88ad8284f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41b19aaa-a4", "ovs_interfaceid": "41b19aaa-a4cf-494a-97e9-c3a081d24d80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:80:c4,bridge_name='br-int',has_traffic_filtering=True,id=41b19aaa-a4cf-494a-97e9-c3a081d24d80,network=Network(5709c284-0131-449d-869b-bfcf88bbe239),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41b19aaa-a4') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG os_vif [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:80:c4,bridge_name='br-int',has_traffic_filtering=True,id=41b19aaa-a4cf-494a-97e9-c3a081d24d80,network=Network(5709c284-0131-449d-869b-bfcf88bbe239),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41b19aaa-a4') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap41b19aaa-a4, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap41b19aaa-a4, col_values=(('external_ids', {'iface-id': '41b19aaa-a4cf-494a-97e9-c3a081d24d80', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:80:c4', 'vm-uuid': '2b2c294d-49b2-41bf-89d0-17a560e7741f'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:33 user nova-compute[71229]: INFO os_vif [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:80:c4,bridge_name='br-int',has_traffic_filtering=True,id=41b19aaa-a4cf-494a-97e9-c3a081d24d80,network=Network(5709c284-0131-449d-869b-bfcf88bbe239),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41b19aaa-a4')
Apr 11 15:21:33 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] No BDM found with device name sda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] No VIF found with MAC fa:16:3e:ce:80:c4, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:21:33 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Using config drive
Apr 11 15:21:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Acquiring lock "3bd4e3ea-2df2-48f8-96bd-8f8219c73bea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Lock "3bd4e3ea-2df2-48f8-96bd-8f8219c73bea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG nova.compute.manager [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Starting instance... {{(pid=71229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 15:21:33 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Creating config drive at /opt/stack/data/nova/instances/2b2c294d-49b2-41bf-89d0-17a560e7741f/disk.config
Apr 11 15:21:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2b2c294d-49b2-41bf-89d0-17a560e7741f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpec20oxwx {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2b2c294d-49b2-41bf-89d0-17a560e7741f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpec20oxwx" returned: 0 in 0.070s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:34 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 15:21:34 user nova-compute[71229]: INFO nova.compute.claims [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Claim successful on node user
Apr 11 15:21:34 user nova-compute[71229]: DEBUG nova.network.neutron [req-869a8f13-942c-4b37-b8b0-d0567a3f1210 req-08fea766-cad4-48df-ba24-67dffd59c348 service nova] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Updated VIF entry in instance network info cache for port 41b19aaa-a4cf-494a-97e9-c3a081d24d80. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:21:34 user nova-compute[71229]: DEBUG nova.network.neutron [req-869a8f13-942c-4b37-b8b0-d0567a3f1210 req-08fea766-cad4-48df-ba24-67dffd59c348 service nova] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Updating instance_info_cache with network_info: [{"id": "41b19aaa-a4cf-494a-97e9-c3a081d24d80", "address": "fa:16:3e:ce:80:c4", "network": {"id": "5709c284-0131-449d-869b-bfcf88bbe239", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-578269461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e67f7203b1849c0af305f88ad8284f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41b19aaa-a4", "ovs_interfaceid": "41b19aaa-a4cf-494a-97e9-c3a081d24d80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:21:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-869a8f13-942c-4b37-b8b0-d0567a3f1210 req-08fea766-cad4-48df-ba24-67dffd59c348 service nova] Releasing lock "refresh_cache-2b2c294d-49b2-41bf-89d0-17a560e7741f" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:21:34 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:21:34 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:21:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.607s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:34 user nova-compute[71229]: DEBUG nova.compute.manager [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Start building networks asynchronously for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 15:21:34 user nova-compute[71229]: DEBUG nova.compute.manager [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Allocating IP information in the background. {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 15:21:34 user nova-compute[71229]: DEBUG nova.network.neutron [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] allocate_for_instance() {{(pid=71229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 15:21:34 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 15:21:34 user nova-compute[71229]: DEBUG nova.compute.manager [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Start building block device mappings for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 15:21:34 user nova-compute[71229]: DEBUG nova.compute.manager [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Start spawning the instance on the hypervisor. {{(pid=71229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 15:21:34 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Creating instance directory {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 15:21:34 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Creating image(s)
Apr 11 15:21:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Acquiring lock "/opt/stack/data/nova/instances/3bd4e3ea-2df2-48f8-96bd-8f8219c73bea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Lock "/opt/stack/data/nova/instances/3bd4e3ea-2df2-48f8-96bd-8f8219c73bea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Lock "/opt/stack/data/nova/instances/3bd4e3ea-2df2-48f8-96bd-8f8219c73bea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:34 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:35 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.169s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Acquiring lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:35 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:35 user nova-compute[71229]: DEBUG nova.policy [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dacdf9131d93415596e40cb8a5416137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6abbfac8ab124b919978b9085a958d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71229) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 15:21:35 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.168s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:35 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/3bd4e3ea-2df2-48f8-96bd-8f8219c73bea/disk 1073741824 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:35 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/3bd4e3ea-2df2-48f8-96bd-8f8219c73bea/disk 1073741824" returned: 0 in 0.071s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:35 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:35 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:35 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:35 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.217s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:35 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3bd4e3ea-2df2-48f8-96bd-8f8219c73bea/disk. size=1073741824 {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 15:21:35 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bd4e3ea-2df2-48f8-96bd-8f8219c73bea/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:35 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bd4e3ea-2df2-48f8-96bd-8f8219c73bea/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:35 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Cannot resize image /opt/stack/data/nova/instances/3bd4e3ea-2df2-48f8-96bd-8f8219c73bea/disk to a smaller size. {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 15:21:35 user nova-compute[71229]: DEBUG nova.objects.instance [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Lazy-loading 'migration_context' on Instance uuid 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:21:35 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Created local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 15:21:35 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Ensure instance console log exists: /opt/stack/data/nova/instances/3bd4e3ea-2df2-48f8-96bd-8f8219c73bea/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 15:21:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:36 user nova-compute[71229]: DEBUG nova.compute.manager [req-fcd5c44e-73a1-4ddc-91ed-7aa1ceb8ac40 req-35270663-ff6e-4e52-818e-027676c3c332 service nova] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Received event network-vif-plugged-41b19aaa-a4cf-494a-97e9-c3a081d24d80 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:21:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-fcd5c44e-73a1-4ddc-91ed-7aa1ceb8ac40 req-35270663-ff6e-4e52-818e-027676c3c332 service nova] Acquiring lock "2b2c294d-49b2-41bf-89d0-17a560e7741f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-fcd5c44e-73a1-4ddc-91ed-7aa1ceb8ac40 req-35270663-ff6e-4e52-818e-027676c3c332 service nova] Lock "2b2c294d-49b2-41bf-89d0-17a560e7741f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-fcd5c44e-73a1-4ddc-91ed-7aa1ceb8ac40 req-35270663-ff6e-4e52-818e-027676c3c332 service nova] Lock "2b2c294d-49b2-41bf-89d0-17a560e7741f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:36 user nova-compute[71229]: DEBUG nova.compute.manager [req-fcd5c44e-73a1-4ddc-91ed-7aa1ceb8ac40 req-35270663-ff6e-4e52-818e-027676c3c332 service nova] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] No waiting events found dispatching network-vif-plugged-41b19aaa-a4cf-494a-97e9-c3a081d24d80 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:21:36 user nova-compute[71229]: WARNING nova.compute.manager [req-fcd5c44e-73a1-4ddc-91ed-7aa1ceb8ac40 req-35270663-ff6e-4e52-818e-027676c3c332 service nova] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Received unexpected event network-vif-plugged-41b19aaa-a4cf-494a-97e9-c3a081d24d80 for instance with vm_state building and task_state spawning.
Apr 11 15:21:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:36 user nova-compute[71229]: DEBUG nova.network.neutron [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Successfully created port: 6c658c02-f85a-49aa-aaab-5aa3552ddb63 {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 15:21:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:37 user nova-compute[71229]: DEBUG nova.network.neutron [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Successfully updated port: 6c658c02-f85a-49aa-aaab-5aa3552ddb63 {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:21:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Acquiring lock "refresh_cache-3bd4e3ea-2df2-48f8-96bd-8f8219c73bea" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:21:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Acquired lock "refresh_cache-3bd4e3ea-2df2-48f8-96bd-8f8219c73bea" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:21:37 user nova-compute[71229]: DEBUG nova.network.neutron [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:21:37 user nova-compute[71229]: DEBUG nova.network.neutron [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG nova.compute.manager [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Guest created on hypervisor {{(pid=71229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681226498.039432, 2b2c294d-49b2-41bf-89d0-17a560e7741f => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:21:38 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] VM Resumed (Lifecycle Event)
Apr 11 15:21:38 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Instance spawned successfully.
Apr 11 15:21:38 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG nova.compute.manager [req-49f11c86-2207-406c-85e2-1502f28b6fed req-5ab4206a-de5c-4334-ba1e-b307aed4299b service nova] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Received event network-vif-plugged-41b19aaa-a4cf-494a-97e9-c3a081d24d80 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-49f11c86-2207-406c-85e2-1502f28b6fed req-5ab4206a-de5c-4334-ba1e-b307aed4299b service nova] Acquiring lock "2b2c294d-49b2-41bf-89d0-17a560e7741f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-49f11c86-2207-406c-85e2-1502f28b6fed req-5ab4206a-de5c-4334-ba1e-b307aed4299b service nova] Lock "2b2c294d-49b2-41bf-89d0-17a560e7741f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-49f11c86-2207-406c-85e2-1502f28b6fed req-5ab4206a-de5c-4334-ba1e-b307aed4299b service nova] Lock "2b2c294d-49b2-41bf-89d0-17a560e7741f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG nova.compute.manager [req-49f11c86-2207-406c-85e2-1502f28b6fed req-5ab4206a-de5c-4334-ba1e-b307aed4299b service nova] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] No waiting events found dispatching network-vif-plugged-41b19aaa-a4cf-494a-97e9-c3a081d24d80 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:21:38 user nova-compute[71229]: WARNING nova.compute.manager [req-49f11c86-2207-406c-85e2-1502f28b6fed req-5ab4206a-de5c-4334-ba1e-b307aed4299b service nova] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Received unexpected event network-vif-plugged-41b19aaa-a4cf-494a-97e9-c3a081d24d80 for instance with vm_state building and task_state spawning.
Apr 11 15:21:38 user nova-compute[71229]: DEBUG nova.compute.manager [req-49f11c86-2207-406c-85e2-1502f28b6fed req-5ab4206a-de5c-4334-ba1e-b307aed4299b service nova] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Received event network-changed-6c658c02-f85a-49aa-aaab-5aa3552ddb63 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG nova.compute.manager [req-49f11c86-2207-406c-85e2-1502f28b6fed req-5ab4206a-de5c-4334-ba1e-b307aed4299b service nova] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Refreshing instance network info cache due to event network-changed-6c658c02-f85a-49aa-aaab-5aa3552ddb63. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-49f11c86-2207-406c-85e2-1502f28b6fed req-5ab4206a-de5c-4334-ba1e-b307aed4299b service nova] Acquiring lock "refresh_cache-3bd4e3ea-2df2-48f8-96bd-8f8219c73bea" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Found default for hw_input_bus of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Found default for hw_pointer_model of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Found default for hw_video_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Found default for hw_vif_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG nova.network.neutron [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Updating instance_info_cache with network_info: [{"id": "6c658c02-f85a-49aa-aaab-5aa3552ddb63", "address": "fa:16:3e:05:bb:c4", "network": {"id": "aa9e8d0b-ed9a-44fd-b934-5461808630c5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "da25b23996564e4b84947ca5a81d90ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c658c02-f8", "ovs_interfaceid": "6c658c02-f85a-49aa-aaab-5aa3552ddb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:21:38 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:21:38 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681226498.040728, 2b2c294d-49b2-41bf-89d0-17a560e7741f => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:21:38 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] VM Started (Lifecycle Event)
Apr 11 15:21:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Releasing lock "refresh_cache-3bd4e3ea-2df2-48f8-96bd-8f8219c73bea" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG nova.compute.manager [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Instance network_info: |[{"id": "6c658c02-f85a-49aa-aaab-5aa3552ddb63", "address": "fa:16:3e:05:bb:c4", "network": {"id": "aa9e8d0b-ed9a-44fd-b934-5461808630c5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "da25b23996564e4b84947ca5a81d90ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c658c02-f8", "ovs_interfaceid": "6c658c02-f85a-49aa-aaab-5aa3552ddb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-49f11c86-2207-406c-85e2-1502f28b6fed req-5ab4206a-de5c-4334-ba1e-b307aed4299b service nova] Acquired lock "refresh_cache-3bd4e3ea-2df2-48f8-96bd-8f8219c73bea" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG nova.network.neutron [req-49f11c86-2207-406c-85e2-1502f28b6fed req-5ab4206a-de5c-4334-ba1e-b307aed4299b service nova] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Refreshing network info cache for port 6c658c02-f85a-49aa-aaab-5aa3552ddb63 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Start _get_guest_xml network_info=[{"id": "6c658c02-f85a-49aa-aaab-5aa3552ddb63", "address": "fa:16:3e:05:bb:c4", "network": {"id": "aa9e8d0b-ed9a-44fd-b934-5461808630c5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "da25b23996564e4b84947ca5a81d90ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c658c02-f8", "ovs_interfaceid": "6c658c02-f85a-49aa-aaab-5aa3552ddb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '52fe638c-5ada-47d5-b376-233bfa808a37'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:21:38 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:21:38 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:21:38 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:21:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-120628292',display_name='tempest-VolumesNegativeTest-instance-120628292',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-120628292',id=8,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6abbfac8ab124b919978b9085a958d4b',ramdisk_id='',reservation_id='r-ugn569my',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1341935232',owner_user_name='tempest-VolumesNegativeTest-1341935232-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:21:35Z,user_data=None,user_id='dacdf9131d93415596e40cb8a5416137',uuid=3bd4e3ea-2df2-48f8-96bd-8f8219c73bea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c658c02-f85a-49aa-aaab-5aa3552ddb63", "address": "fa:16:3e:05:bb:c4", "network": {"id": "aa9e8d0b-ed9a-44fd-b934-5461808630c5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "da25b23996564e4b84947ca5a81d90ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c658c02-f8", "ovs_interfaceid": "6c658c02-f85a-49aa-aaab-5aa3552ddb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Converting VIF {"id": "6c658c02-f85a-49aa-aaab-5aa3552ddb63", "address": "fa:16:3e:05:bb:c4", "network": {"id": "aa9e8d0b-ed9a-44fd-b934-5461808630c5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "da25b23996564e4b84947ca5a81d90ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c658c02-f8", "ovs_interfaceid": "6c658c02-f85a-49aa-aaab-5aa3552ddb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:bb:c4,bridge_name='br-int',has_traffic_filtering=True,id=6c658c02-f85a-49aa-aaab-5aa3552ddb63,network=Network(aa9e8d0b-ed9a-44fd-b934-5461808630c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c658c02-f8') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG nova.objects.instance [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Lazy-loading 'pci_devices' on Instance uuid 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:21:38 user nova-compute[71229]: INFO nova.compute.manager [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Took 7.23 seconds to spawn the instance on the hypervisor.
Apr 11 15:21:38 user nova-compute[71229]: DEBUG nova.compute.manager [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:21:38 user nova-compute[71229]:   <uuid>3bd4e3ea-2df2-48f8-96bd-8f8219c73bea</uuid>
Apr 11 15:21:38 user nova-compute[71229]:   <name>instance-00000008</name>
Apr 11 15:21:38 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:21:38 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:21:38 user nova-compute[71229]:   <metadata>
Apr 11 15:21:38 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:21:38 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:21:38 user nova-compute[71229]:       <nova:name>tempest-VolumesNegativeTest-instance-120628292</nova:name>
Apr 11 15:21:38 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:21:38</nova:creationTime>
Apr 11 15:21:38 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:21:38 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:21:38 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:21:38 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:21:38 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:21:38 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:21:38 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:21:38 user nova-compute[71229]:       <nova:owner>
Apr 11 15:21:38 user nova-compute[71229]:         <nova:user uuid="dacdf9131d93415596e40cb8a5416137">tempest-VolumesNegativeTest-1341935232-project-member</nova:user>
Apr 11 15:21:38 user nova-compute[71229]:         <nova:project uuid="6abbfac8ab124b919978b9085a958d4b">tempest-VolumesNegativeTest-1341935232</nova:project>
Apr 11 15:21:38 user nova-compute[71229]:       </nova:owner>
Apr 11 15:21:38 user nova-compute[71229]:       <nova:root type="image" uuid="52fe638c-5ada-47d5-b376-233bfa808a37"/>
Apr 11 15:21:38 user nova-compute[71229]:       <nova:ports>
Apr 11 15:21:38 user nova-compute[71229]:         <nova:port uuid="6c658c02-f85a-49aa-aaab-5aa3552ddb63">
Apr 11 15:21:38 user nova-compute[71229]:           <nova:ip type="fixed" address="192.168.233.98" ipVersion="4"/>
Apr 11 15:21:38 user nova-compute[71229]:         </nova:port>
Apr 11 15:21:38 user nova-compute[71229]:       </nova:ports>
Apr 11 15:21:38 user nova-compute[71229]:     </nova:instance>
Apr 11 15:21:38 user nova-compute[71229]:   </metadata>
Apr 11 15:21:38 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:21:38 user nova-compute[71229]:     <system>
Apr 11 15:21:38 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:21:38 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:21:38 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:21:38 user nova-compute[71229]:       <entry name="serial">3bd4e3ea-2df2-48f8-96bd-8f8219c73bea</entry>
Apr 11 15:21:38 user nova-compute[71229]:       <entry name="uuid">3bd4e3ea-2df2-48f8-96bd-8f8219c73bea</entry>
Apr 11 15:21:38 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:21:38 user nova-compute[71229]:     </system>
Apr 11 15:21:38 user nova-compute[71229]:   </sysinfo>
Apr 11 15:21:38 user nova-compute[71229]:   <os>
Apr 11 15:21:38 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:21:38 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 15:21:38 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:21:38 user nova-compute[71229]:   </os>
Apr 11 15:21:38 user nova-compute[71229]:   <features>
Apr 11 15:21:38 user nova-compute[71229]:     <acpi/>
Apr 11 15:21:38 user nova-compute[71229]:     <apic/>
Apr 11 15:21:38 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:21:38 user nova-compute[71229]:   </features>
Apr 11 15:21:38 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:21:38 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:21:38 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:21:38 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:21:38 user nova-compute[71229]:   </clock>
Apr 11 15:21:38 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:21:38 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:21:38 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:21:38 user nova-compute[71229]:   </cpu>
Apr 11 15:21:38 user nova-compute[71229]:   <devices>
Apr 11 15:21:38 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 15:21:38 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 15:21:38 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/3bd4e3ea-2df2-48f8-96bd-8f8219c73bea/disk"/>
Apr 11 15:21:38 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:21:38 user nova-compute[71229]:     </disk>
Apr 11 15:21:38 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:21:38 user nova-compute[71229]:       <mac address="fa:16:3e:05:bb:c4"/>
Apr 11 15:21:38 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:21:38 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:21:38 user nova-compute[71229]:       <target dev="tap6c658c02-f8"/>
Apr 11 15:21:38 user nova-compute[71229]:     </interface>
Apr 11 15:21:38 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:21:38 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/3bd4e3ea-2df2-48f8-96bd-8f8219c73bea/console.log" append="off"/>
Apr 11 15:21:38 user nova-compute[71229]:     </serial>
Apr 11 15:21:38 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:21:38 user nova-compute[71229]:     <video>
Apr 11 15:21:38 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:21:38 user nova-compute[71229]:     </video>
Apr 11 15:21:38 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:21:38 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:21:38 user nova-compute[71229]:     </rng>
Apr 11 15:21:38 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:21:38 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:21:38 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:21:38 user nova-compute[71229]:     </memballoon>
Apr 11 15:21:38 user nova-compute[71229]:   </devices>
Apr 11 15:21:38 user nova-compute[71229]: </domain>
Apr 11 15:21:38 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:21:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-120628292',display_name='tempest-VolumesNegativeTest-instance-120628292',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-120628292',id=8,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6abbfac8ab124b919978b9085a958d4b',ramdisk_id='',reservation_id='r-ugn569my',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1341935232',owner_user_name='tempest-VolumesNegativeTest-1341935232-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:21:35Z,user_data=None,user_id='dacdf9131d93415596e40cb8a5416137',uuid=3bd4e3ea-2df2-48f8-96bd-8f8219c73bea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c658c02-f85a-49aa-aaab-5aa3552ddb63", "address": "fa:16:3e:05:bb:c4", "network": {"id": "aa9e8d0b-ed9a-44fd-b934-5461808630c5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "da25b23996564e4b84947ca5a81d90ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c658c02-f8", "ovs_interfaceid": "6c658c02-f85a-49aa-aaab-5aa3552ddb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Converting VIF {"id": "6c658c02-f85a-49aa-aaab-5aa3552ddb63", "address": "fa:16:3e:05:bb:c4", "network": {"id": "aa9e8d0b-ed9a-44fd-b934-5461808630c5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "da25b23996564e4b84947ca5a81d90ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c658c02-f8", "ovs_interfaceid": "6c658c02-f85a-49aa-aaab-5aa3552ddb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:bb:c4,bridge_name='br-int',has_traffic_filtering=True,id=6c658c02-f85a-49aa-aaab-5aa3552ddb63,network=Network(aa9e8d0b-ed9a-44fd-b934-5461808630c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c658c02-f8') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG os_vif [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:bb:c4,bridge_name='br-int',has_traffic_filtering=True,id=6c658c02-f85a-49aa-aaab-5aa3552ddb63,network=Network(aa9e8d0b-ed9a-44fd-b934-5461808630c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c658c02-f8') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6c658c02-f8, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6c658c02-f8, col_values=(('external_ids', {'iface-id': '6c658c02-f85a-49aa-aaab-5aa3552ddb63', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:bb:c4', 'vm-uuid': '3bd4e3ea-2df2-48f8-96bd-8f8219c73bea'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:38 user nova-compute[71229]: INFO os_vif [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:bb:c4,bridge_name='br-int',has_traffic_filtering=True,id=6c658c02-f85a-49aa-aaab-5aa3552ddb63,network=Network(aa9e8d0b-ed9a-44fd-b934-5461808630c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c658c02-f8')
Apr 11 15:21:38 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:21:38 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] No VIF found with MAC fa:16:3e:05:bb:c4, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:21:38 user nova-compute[71229]: INFO nova.compute.manager [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Took 9.05 seconds to build instance.
Apr 11 15:21:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8cf2bfc6-cf1e-4bad-a322-1575ec2b6e7d tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "2b2c294d-49b2-41bf-89d0-17a560e7741f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.522s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG nova.network.neutron [req-49f11c86-2207-406c-85e2-1502f28b6fed req-5ab4206a-de5c-4334-ba1e-b307aed4299b service nova] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Updated VIF entry in instance network info cache for port 6c658c02-f85a-49aa-aaab-5aa3552ddb63. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG nova.network.neutron [req-49f11c86-2207-406c-85e2-1502f28b6fed req-5ab4206a-de5c-4334-ba1e-b307aed4299b service nova] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Updating instance_info_cache with network_info: [{"id": "6c658c02-f85a-49aa-aaab-5aa3552ddb63", "address": "fa:16:3e:05:bb:c4", "network": {"id": "aa9e8d0b-ed9a-44fd-b934-5461808630c5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "da25b23996564e4b84947ca5a81d90ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c658c02-f8", "ovs_interfaceid": "6c658c02-f85a-49aa-aaab-5aa3552ddb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:21:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-49f11c86-2207-406c-85e2-1502f28b6fed req-5ab4206a-de5c-4334-ba1e-b307aed4299b service nova] Releasing lock "refresh_cache-3bd4e3ea-2df2-48f8-96bd-8f8219c73bea" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:21:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:40 user nova-compute[71229]: DEBUG nova.compute.manager [req-442f8dcb-576c-4258-8f08-4bd83c3c9b17 req-c408e4f3-90f8-44ac-85b7-cc5f90e8fc91 service nova] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Received event network-vif-plugged-6c658c02-f85a-49aa-aaab-5aa3552ddb63 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:21:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-442f8dcb-576c-4258-8f08-4bd83c3c9b17 req-c408e4f3-90f8-44ac-85b7-cc5f90e8fc91 service nova] Acquiring lock "3bd4e3ea-2df2-48f8-96bd-8f8219c73bea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-442f8dcb-576c-4258-8f08-4bd83c3c9b17 req-c408e4f3-90f8-44ac-85b7-cc5f90e8fc91 service nova] Lock "3bd4e3ea-2df2-48f8-96bd-8f8219c73bea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-442f8dcb-576c-4258-8f08-4bd83c3c9b17 req-c408e4f3-90f8-44ac-85b7-cc5f90e8fc91 service nova] Lock "3bd4e3ea-2df2-48f8-96bd-8f8219c73bea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:40 user nova-compute[71229]: DEBUG nova.compute.manager [req-442f8dcb-576c-4258-8f08-4bd83c3c9b17 req-c408e4f3-90f8-44ac-85b7-cc5f90e8fc91 service nova] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] No waiting events found dispatching network-vif-plugged-6c658c02-f85a-49aa-aaab-5aa3552ddb63 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:21:40 user nova-compute[71229]: WARNING nova.compute.manager [req-442f8dcb-576c-4258-8f08-4bd83c3c9b17 req-c408e4f3-90f8-44ac-85b7-cc5f90e8fc91 service nova] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Received unexpected event network-vif-plugged-6c658c02-f85a-49aa-aaab-5aa3552ddb63 for instance with vm_state building and task_state spawning.
Apr 11 15:21:40 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:40 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:40 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:42 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681226502.27408, 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:21:42 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] VM Resumed (Lifecycle Event)
Apr 11 15:21:42 user nova-compute[71229]: DEBUG nova.compute.manager [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 15:21:42 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Guest created on hypervisor {{(pid=71229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 15:21:42 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Instance spawned successfully.
Apr 11 15:21:42 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 15:21:42 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:21:42 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:21:42 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Found default for hw_cdrom_bus of ide {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:21:42 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Found default for hw_disk_bus of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:21:42 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Found default for hw_input_bus of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:21:42 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Found default for hw_pointer_model of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:21:42 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Found default for hw_video_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:21:42 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Found default for hw_vif_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:21:42 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:21:42 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681226502.2759054, 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:21:42 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] VM Started (Lifecycle Event)
Apr 11 15:21:42 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:21:42 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:21:42 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:21:42 user nova-compute[71229]: INFO nova.compute.manager [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Took 7.55 seconds to spawn the instance on the hypervisor.
Apr 11 15:21:42 user nova-compute[71229]: DEBUG nova.compute.manager [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:21:42 user nova-compute[71229]: DEBUG nova.compute.manager [req-7cf1a612-2220-4a68-a58d-9ef9998a7811 req-bbd6e30e-eec7-42e0-8ccf-7611af7cfc06 service nova] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Received event network-vif-plugged-6c658c02-f85a-49aa-aaab-5aa3552ddb63 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:21:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-7cf1a612-2220-4a68-a58d-9ef9998a7811 req-bbd6e30e-eec7-42e0-8ccf-7611af7cfc06 service nova] Acquiring lock "3bd4e3ea-2df2-48f8-96bd-8f8219c73bea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-7cf1a612-2220-4a68-a58d-9ef9998a7811 req-bbd6e30e-eec7-42e0-8ccf-7611af7cfc06 service nova] Lock "3bd4e3ea-2df2-48f8-96bd-8f8219c73bea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-7cf1a612-2220-4a68-a58d-9ef9998a7811 req-bbd6e30e-eec7-42e0-8ccf-7611af7cfc06 service nova] Lock "3bd4e3ea-2df2-48f8-96bd-8f8219c73bea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:42 user nova-compute[71229]: DEBUG nova.compute.manager [req-7cf1a612-2220-4a68-a58d-9ef9998a7811 req-bbd6e30e-eec7-42e0-8ccf-7611af7cfc06 service nova] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] No waiting events found dispatching network-vif-plugged-6c658c02-f85a-49aa-aaab-5aa3552ddb63 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:21:42 user nova-compute[71229]: WARNING nova.compute.manager [req-7cf1a612-2220-4a68-a58d-9ef9998a7811 req-bbd6e30e-eec7-42e0-8ccf-7611af7cfc06 service nova] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Received unexpected event network-vif-plugged-6c658c02-f85a-49aa-aaab-5aa3552ddb63 for instance with vm_state building and task_state spawning.
Apr 11 15:21:42 user nova-compute[71229]: INFO nova.compute.manager [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Took 8.61 seconds to build instance.
Apr 11 15:21:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-444ac75c-3c0e-41d0-a65c-96ce3e153070 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Lock "3bd4e3ea-2df2-48f8-96bd-8f8219c73bea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.798s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:43 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:46 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:21:46 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Cleaning up deleted instances {{(pid=71229) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 15:21:46 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] There are 0 instances to clean {{(pid=71229) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 15:21:46 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:21:46 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71229) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 15:21:46 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:21:48 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:49 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:21:49 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:21:49 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 15:21:49 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Rebuilding the list of instances to heal {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 15:21:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "refresh_cache-de1a45fd-27be-4438-80a4-2f3a100643c9" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:21:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquired lock "refresh_cache-de1a45fd-27be-4438-80a4-2f3a100643c9" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:21:49 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Forcefully refreshing network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 15:21:49 user nova-compute[71229]: DEBUG nova.objects.instance [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lazy-loading 'info_cache' on Instance uuid de1a45fd-27be-4438-80a4-2f3a100643c9 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:21:50 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Updating instance_info_cache with network_info: [{"id": "197ae974-459a-49ab-9d70-89bfaa073f50", "address": "fa:16:3e:03:bb:91", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ae974-45", "ovs_interfaceid": "197ae974-459a-49ab-9d70-89bfaa073f50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:21:50 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Releasing lock "refresh_cache-de1a45fd-27be-4438-80a4-2f3a100643c9" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:21:50 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Updated the network info_cache for instance {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 15:21:50 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:21:50 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:21:50 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:21:50 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:21:51 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:51 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:21:51 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:21:51 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 15:21:51 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:21:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:51 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 15:21:51 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/074896e5-8065-4b4a-b61a-653bc67718db/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/074896e5-8065-4b4a-b61a-653bc67718db/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/074896e5-8065-4b4a-b61a-653bc67718db/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/074896e5-8065-4b4a-b61a-653bc67718db/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b1dedd0-ae18-421b-b83a-a7b2c22c65d5/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b1dedd0-ae18-421b-b83a-a7b2c22c65d5/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b1dedd0-ae18-421b-b83a-a7b2c22c65d5/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b1dedd0-ae18-421b-b83a-a7b2c22c65d5/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d84862f-b710-48b1-9275-93fc799cf1f9/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d84862f-b710-48b1-9275-93fc799cf1f9/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d84862f-b710-48b1-9275-93fc799cf1f9/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d84862f-b710-48b1-9275-93fc799cf1f9/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2c294d-49b2-41bf-89d0-17a560e7741f/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:53 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2c294d-49b2-41bf-89d0-17a560e7741f/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2c294d-49b2-41bf-89d0-17a560e7741f/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:53 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Acquiring lock "cda43d26-e2f7-4e86-b850-b914957c9b57" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:53 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:53 user nova-compute[71229]: DEBUG nova.compute.manager [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Starting instance... {{(pid=71229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 15:21:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2c294d-49b2-41bf-89d0-17a560e7741f/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:53 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:53 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:53 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 15:21:53 user nova-compute[71229]: INFO nova.compute.claims [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Claim successful on node user
Apr 11 15:21:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a06747-0f43-4731-87e6-40629c382a6b/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a06747-0f43-4731-87e6-40629c382a6b/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a06747-0f43-4731-87e6-40629c382a6b/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:54 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:21:54 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:21:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a06747-0f43-4731-87e6-40629c382a6b/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.544s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:54 user nova-compute[71229]: DEBUG nova.compute.manager [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Start building networks asynchronously for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 15:21:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bd4e3ea-2df2-48f8-96bd-8f8219c73bea/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:54 user nova-compute[71229]: DEBUG nova.compute.manager [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Allocating IP information in the background. {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 15:21:54 user nova-compute[71229]: DEBUG nova.network.neutron [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] allocate_for_instance() {{(pid=71229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 15:21:54 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 15:21:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bd4e3ea-2df2-48f8-96bd-8f8219c73bea/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bd4e3ea-2df2-48f8-96bd-8f8219c73bea/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:54 user nova-compute[71229]: DEBUG nova.compute.manager [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Start building block device mappings for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 15:21:54 user nova-compute[71229]: INFO nova.virt.block_device [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Booting with volume 25935fb7-f8be-4263-8b3b-42330253644d at /dev/vda
Apr 11 15:21:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bd4e3ea-2df2-48f8-96bd-8f8219c73bea/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:55 user nova-compute[71229]: DEBUG nova.policy [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '31d206ed111842fd95ce5eb5b3835a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e64015226c19441d87f3a6999a3a8db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71229) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 15:21:55 user nova-compute[71229]: DEBUG os_brick.utils [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:21:55 user nova-compute[71229]: INFO oslo.privsep.daemon [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpp928z77v/privsep.sock']
Apr 11 15:21:55 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:21:55 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:21:55 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=7796MB free_disk=26.405017852783203GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 15:21:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:21:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:21:55 user sudo[81305]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpp928z77v/privsep.sock
Apr 11 15:21:55 user sudo[81305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 11 15:21:55 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance de1a45fd-27be-4438-80a4-2f3a100643c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:21:55 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 074896e5-8065-4b4a-b61a-653bc67718db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:21:55 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 6a805345-374c-4326-9e8f-39bfc7947a35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:21:55 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:21:55 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 8d84862f-b710-48b1-9275-93fc799cf1f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:21:55 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance f3a06747-0f43-4731-87e6-40629c382a6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:21:55 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 2b2c294d-49b2-41bf-89d0-17a560e7741f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:21:55 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:21:55 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance cda43d26-e2f7-4e86-b850-b914957c9b57 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:21:55 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 15:21:55 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 15:21:55 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:21:55 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:21:56 user nova-compute[71229]: DEBUG nova.network.neutron [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Successfully created port: ee21c1bf-90da-44fe-b6f2-26132b87c5ed {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 15:21:56 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 15:21:56 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.024s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:21:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:56 user nova-compute[71229]: DEBUG nova.network.neutron [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Successfully created port: 65d1d6cb-a27f-4eae-822e-459770a9a587 {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 15:21:56 user sudo[81305]: pam_unix(sudo:session): session closed for user root
Apr 11 15:21:56 user nova-compute[71229]: INFO oslo.privsep.daemon [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Spawned new privsep daemon via rootwrap
Apr 11 15:21:56 user nova-compute[71229]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 11 15:21:56 user nova-compute[71229]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 11 15:21:56 user nova-compute[71229]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Apr 11 15:21:56 user nova-compute[71229]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81310
Apr 11 15:21:56 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b38368-a687-460c-877e-3b0e69791c04]: (2,) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:21:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:57 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b44dc1e-d5b0-495a-b8a4-e20893107283]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d55e24a97c90\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:21:57 user nova-compute[71229]: WARNING os_brick.initiator.connectors.nvmeof [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Apr 11 15:21:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:57 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac21644b-9d36-4b41-9ea9-5f3454df03c0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:21:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:21:57 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa67a5e0-3513-45c2-99e9-ff7e1cbb48f4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:21:57 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fef92b1-a991-446d-9fb1-4fe848ef2a86]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:21:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Running cmd (subprocess): nvme version {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] 'nvme version' failed. Not Retrying. {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:21:57 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] nvme not present on system {{(pid=71229) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 15:21:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:21:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:21:57 user nova-compute[71229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 15:21:57 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b96ede-bf84-4be1-8f32-997925d109be]: (4, '') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:21:57 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71229) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 15:21:57 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 15:21:57 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] LIGHTOS: no hostnqn found. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 15:21:57 user nova-compute[71229]: DEBUG os_brick.utils [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] <== get_connector_properties: return (2029ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d55e24a97c90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:21:57 user nova-compute[71229]: DEBUG nova.virt.block_device [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Updating existing volume attachment record: fee88e93-607a-4d05-a072-70905d3a3e1d {{(pid=71229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 15:21:57 user nova-compute[71229]: DEBUG nova.network.neutron [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Successfully created port: d9f2f28e-bb0a-4d1b-a831-e2c493521408 {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 15:21:58 user nova-compute[71229]: DEBUG nova.network.neutron [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Successfully created port: 6d794bc3-2136-4b88-92e5-4703eb113b6d {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 15:21:58 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:21:58 user nova-compute[71229]: DEBUG nova.network.neutron [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Successfully created port: e9f0f991-6f64-45e6-9ce7-3f279f5ce31f {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 15:21:59 user nova-compute[71229]: DEBUG nova.network.neutron [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Successfully updated port: ee21c1bf-90da-44fe-b6f2-26132b87c5ed {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:21:59 user nova-compute[71229]: DEBUG nova.compute.manager [req-bc740b4c-a433-4b79-a504-09da06bb17f6 req-a75a7b3d-1655-45fe-8bd7-f2b4c9708da4 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received event network-changed-ee21c1bf-90da-44fe-b6f2-26132b87c5ed {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:21:59 user nova-compute[71229]: DEBUG nova.compute.manager [req-bc740b4c-a433-4b79-a504-09da06bb17f6 req-a75a7b3d-1655-45fe-8bd7-f2b4c9708da4 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Refreshing instance network info cache due to event network-changed-ee21c1bf-90da-44fe-b6f2-26132b87c5ed. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:21:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-bc740b4c-a433-4b79-a504-09da06bb17f6 req-a75a7b3d-1655-45fe-8bd7-f2b4c9708da4 service nova] Acquiring lock "refresh_cache-cda43d26-e2f7-4e86-b850-b914957c9b57" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:21:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-bc740b4c-a433-4b79-a504-09da06bb17f6 req-a75a7b3d-1655-45fe-8bd7-f2b4c9708da4 service nova] Acquired lock "refresh_cache-cda43d26-e2f7-4e86-b850-b914957c9b57" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:21:59 user nova-compute[71229]: DEBUG nova.network.neutron [req-bc740b4c-a433-4b79-a504-09da06bb17f6 req-a75a7b3d-1655-45fe-8bd7-f2b4c9708da4 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Refreshing network info cache for port ee21c1bf-90da-44fe-b6f2-26132b87c5ed {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:21:59 user nova-compute[71229]: DEBUG nova.network.neutron [req-bc740b4c-a433-4b79-a504-09da06bb17f6 req-a75a7b3d-1655-45fe-8bd7-f2b4c9708da4 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:22:00 user nova-compute[71229]: DEBUG nova.network.neutron [req-bc740b4c-a433-4b79-a504-09da06bb17f6 req-a75a7b3d-1655-45fe-8bd7-f2b4c9708da4 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:22:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-bc740b4c-a433-4b79-a504-09da06bb17f6 req-a75a7b3d-1655-45fe-8bd7-f2b4c9708da4 service nova] Releasing lock "refresh_cache-cda43d26-e2f7-4e86-b850-b914957c9b57" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:22:00 user nova-compute[71229]: DEBUG nova.network.neutron [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Successfully updated port: 2ac99ade-56b1-4865-b997-a9f8ef0a760b {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:22:01 user nova-compute[71229]: DEBUG nova.network.neutron [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Successfully updated port: 097c3cb1-bc8f-42c3-be49-73d500fdbc39 {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:22:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:01 user nova-compute[71229]: INFO nova.virt.block_device [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Booting with volume f9255f82-4f06-40f7-8c74-41549e0ae487 at /dev/vdb
Apr 11 15:22:01 user nova-compute[71229]: DEBUG os_brick.utils [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:22:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:01 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f5dd75-4bcc-4551-aae2-d578a846cf82]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d55e24a97c90\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:01 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a41ab4-e597-4ab7-a6bf-f548be087add]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:01 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6011911-4116-4a34-8f1f-7a3d80858b40]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:01 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e11bb0-dbcd-478a-8674-ec5e745635a1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Running cmd (subprocess): nvme version {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] 'nvme version' failed. Not Retrying. {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:22:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] nvme not present on system {{(pid=71229) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 15:22:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:01 user nova-compute[71229]: DEBUG nova.compute.manager [req-77f7550d-c067-43dd-be9d-cd2cb56a9124 req-be806f50-4dda-4b67-bae8-e007975359d5 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received event network-changed-2ac99ade-56b1-4865-b997-a9f8ef0a760b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:22:01 user nova-compute[71229]: DEBUG nova.compute.manager [req-77f7550d-c067-43dd-be9d-cd2cb56a9124 req-be806f50-4dda-4b67-bae8-e007975359d5 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Refreshing instance network info cache due to event network-changed-2ac99ade-56b1-4865-b997-a9f8ef0a760b. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:22:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-77f7550d-c067-43dd-be9d-cd2cb56a9124 req-be806f50-4dda-4b67-bae8-e007975359d5 service nova] Acquiring lock "refresh_cache-cda43d26-e2f7-4e86-b850-b914957c9b57" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:22:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-77f7550d-c067-43dd-be9d-cd2cb56a9124 req-be806f50-4dda-4b67-bae8-e007975359d5 service nova] Acquired lock "refresh_cache-cda43d26-e2f7-4e86-b850-b914957c9b57" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:22:01 user nova-compute[71229]: DEBUG nova.network.neutron [req-77f7550d-c067-43dd-be9d-cd2cb56a9124 req-be806f50-4dda-4b67-bae8-e007975359d5 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Refreshing network info cache for port 2ac99ade-56b1-4865-b997-a9f8ef0a760b {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:22:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:22:01 user nova-compute[71229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 15:22:01 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a864c300-3bf3-4ce6-a577-179133ebf617]: (4, '') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71229) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 15:22:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 15:22:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] LIGHTOS: no hostnqn found. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 15:22:01 user nova-compute[71229]: DEBUG os_brick.utils [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d55e24a97c90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:22:01 user nova-compute[71229]: DEBUG nova.virt.block_device [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Updating existing volume attachment record: 867c7148-32b4-4011-a5e5-d98f56d5373d {{(pid=71229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 15:22:01 user nova-compute[71229]: DEBUG nova.network.neutron [req-77f7550d-c067-43dd-be9d-cd2cb56a9124 req-be806f50-4dda-4b67-bae8-e007975359d5 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:22:01 user nova-compute[71229]: DEBUG nova.network.neutron [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Successfully updated port: 65d1d6cb-a27f-4eae-822e-459770a9a587 {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:22:02 user nova-compute[71229]: DEBUG nova.network.neutron [req-77f7550d-c067-43dd-be9d-cd2cb56a9124 req-be806f50-4dda-4b67-bae8-e007975359d5 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:22:02 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-77f7550d-c067-43dd-be9d-cd2cb56a9124 req-be806f50-4dda-4b67-bae8-e007975359d5 service nova] Releasing lock "refresh_cache-cda43d26-e2f7-4e86-b850-b914957c9b57" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:22:02 user nova-compute[71229]: DEBUG nova.compute.manager [req-77f7550d-c067-43dd-be9d-cd2cb56a9124 req-be806f50-4dda-4b67-bae8-e007975359d5 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received event network-changed-097c3cb1-bc8f-42c3-be49-73d500fdbc39 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:22:02 user nova-compute[71229]: DEBUG nova.compute.manager [req-77f7550d-c067-43dd-be9d-cd2cb56a9124 req-be806f50-4dda-4b67-bae8-e007975359d5 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Refreshing instance network info cache due to event network-changed-097c3cb1-bc8f-42c3-be49-73d500fdbc39. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:22:02 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-77f7550d-c067-43dd-be9d-cd2cb56a9124 req-be806f50-4dda-4b67-bae8-e007975359d5 service nova] Acquiring lock "refresh_cache-cda43d26-e2f7-4e86-b850-b914957c9b57" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:22:02 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-77f7550d-c067-43dd-be9d-cd2cb56a9124 req-be806f50-4dda-4b67-bae8-e007975359d5 service nova] Acquired lock "refresh_cache-cda43d26-e2f7-4e86-b850-b914957c9b57" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:22:02 user nova-compute[71229]: DEBUG nova.network.neutron [req-77f7550d-c067-43dd-be9d-cd2cb56a9124 req-be806f50-4dda-4b67-bae8-e007975359d5 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Refreshing network info cache for port 097c3cb1-bc8f-42c3-be49-73d500fdbc39 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:22:02 user nova-compute[71229]: DEBUG nova.network.neutron [req-77f7550d-c067-43dd-be9d-cd2cb56a9124 req-be806f50-4dda-4b67-bae8-e007975359d5 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:22:02 user nova-compute[71229]: DEBUG nova.network.neutron [req-77f7550d-c067-43dd-be9d-cd2cb56a9124 req-be806f50-4dda-4b67-bae8-e007975359d5 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:22:02 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-77f7550d-c067-43dd-be9d-cd2cb56a9124 req-be806f50-4dda-4b67-bae8-e007975359d5 service nova] Releasing lock "refresh_cache-cda43d26-e2f7-4e86-b850-b914957c9b57" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:22:02 user nova-compute[71229]: DEBUG nova.network.neutron [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Successfully updated port: d9f2f28e-bb0a-4d1b-a831-e2c493521408 {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:22:03 user nova-compute[71229]: DEBUG nova.network.neutron [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Successfully updated port: 6d794bc3-2136-4b88-92e5-4703eb113b6d {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:22:03 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:03 user nova-compute[71229]: DEBUG nova.compute.manager [req-a809975f-ec3f-4a2f-8006-3a7e45f753b7 req-70036aa4-2088-4da3-9dc7-022898b5d388 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received event network-changed-65d1d6cb-a27f-4eae-822e-459770a9a587 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:22:03 user nova-compute[71229]: DEBUG nova.compute.manager [req-a809975f-ec3f-4a2f-8006-3a7e45f753b7 req-70036aa4-2088-4da3-9dc7-022898b5d388 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Refreshing instance network info cache due to event network-changed-65d1d6cb-a27f-4eae-822e-459770a9a587. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:22:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a809975f-ec3f-4a2f-8006-3a7e45f753b7 req-70036aa4-2088-4da3-9dc7-022898b5d388 service nova] Acquiring lock "refresh_cache-cda43d26-e2f7-4e86-b850-b914957c9b57" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:22:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a809975f-ec3f-4a2f-8006-3a7e45f753b7 req-70036aa4-2088-4da3-9dc7-022898b5d388 service nova] Acquired lock "refresh_cache-cda43d26-e2f7-4e86-b850-b914957c9b57" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:22:03 user nova-compute[71229]: DEBUG nova.network.neutron [req-a809975f-ec3f-4a2f-8006-3a7e45f753b7 req-70036aa4-2088-4da3-9dc7-022898b5d388 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Refreshing network info cache for port 65d1d6cb-a27f-4eae-822e-459770a9a587 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:22:03 user nova-compute[71229]: DEBUG nova.network.neutron [req-a809975f-ec3f-4a2f-8006-3a7e45f753b7 req-70036aa4-2088-4da3-9dc7-022898b5d388 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:22:03 user nova-compute[71229]: DEBUG nova.network.neutron [req-a809975f-ec3f-4a2f-8006-3a7e45f753b7 req-70036aa4-2088-4da3-9dc7-022898b5d388 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:22:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a809975f-ec3f-4a2f-8006-3a7e45f753b7 req-70036aa4-2088-4da3-9dc7-022898b5d388 service nova] Releasing lock "refresh_cache-cda43d26-e2f7-4e86-b850-b914957c9b57" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:22:03 user nova-compute[71229]: DEBUG nova.compute.manager [req-a809975f-ec3f-4a2f-8006-3a7e45f753b7 req-70036aa4-2088-4da3-9dc7-022898b5d388 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received event network-changed-d9f2f28e-bb0a-4d1b-a831-e2c493521408 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:22:03 user nova-compute[71229]: DEBUG nova.compute.manager [req-a809975f-ec3f-4a2f-8006-3a7e45f753b7 req-70036aa4-2088-4da3-9dc7-022898b5d388 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Refreshing instance network info cache due to event network-changed-d9f2f28e-bb0a-4d1b-a831-e2c493521408. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:22:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a809975f-ec3f-4a2f-8006-3a7e45f753b7 req-70036aa4-2088-4da3-9dc7-022898b5d388 service nova] Acquiring lock "refresh_cache-cda43d26-e2f7-4e86-b850-b914957c9b57" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:22:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a809975f-ec3f-4a2f-8006-3a7e45f753b7 req-70036aa4-2088-4da3-9dc7-022898b5d388 service nova] Acquired lock "refresh_cache-cda43d26-e2f7-4e86-b850-b914957c9b57" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:22:03 user nova-compute[71229]: DEBUG nova.network.neutron [req-a809975f-ec3f-4a2f-8006-3a7e45f753b7 req-70036aa4-2088-4da3-9dc7-022898b5d388 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Refreshing network info cache for port d9f2f28e-bb0a-4d1b-a831-e2c493521408 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:22:03 user nova-compute[71229]: DEBUG nova.network.neutron [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Successfully updated port: e9f0f991-6f64-45e6-9ce7-3f279f5ce31f {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:22:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Acquiring lock "refresh_cache-cda43d26-e2f7-4e86-b850-b914957c9b57" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:22:04 user nova-compute[71229]: DEBUG nova.network.neutron [req-a809975f-ec3f-4a2f-8006-3a7e45f753b7 req-70036aa4-2088-4da3-9dc7-022898b5d388 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:22:04 user nova-compute[71229]: DEBUG nova.network.neutron [req-a809975f-ec3f-4a2f-8006-3a7e45f753b7 req-70036aa4-2088-4da3-9dc7-022898b5d388 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:22:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a809975f-ec3f-4a2f-8006-3a7e45f753b7 req-70036aa4-2088-4da3-9dc7-022898b5d388 service nova] Releasing lock "refresh_cache-cda43d26-e2f7-4e86-b850-b914957c9b57" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:22:04 user nova-compute[71229]: DEBUG nova.compute.manager [req-a809975f-ec3f-4a2f-8006-3a7e45f753b7 req-70036aa4-2088-4da3-9dc7-022898b5d388 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received event network-changed-6d794bc3-2136-4b88-92e5-4703eb113b6d {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:22:04 user nova-compute[71229]: DEBUG nova.compute.manager [req-a809975f-ec3f-4a2f-8006-3a7e45f753b7 req-70036aa4-2088-4da3-9dc7-022898b5d388 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Refreshing instance network info cache due to event network-changed-6d794bc3-2136-4b88-92e5-4703eb113b6d. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:22:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a809975f-ec3f-4a2f-8006-3a7e45f753b7 req-70036aa4-2088-4da3-9dc7-022898b5d388 service nova] Acquiring lock "refresh_cache-cda43d26-e2f7-4e86-b850-b914957c9b57" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:22:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a809975f-ec3f-4a2f-8006-3a7e45f753b7 req-70036aa4-2088-4da3-9dc7-022898b5d388 service nova] Acquired lock "refresh_cache-cda43d26-e2f7-4e86-b850-b914957c9b57" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:22:04 user nova-compute[71229]: DEBUG nova.network.neutron [req-a809975f-ec3f-4a2f-8006-3a7e45f753b7 req-70036aa4-2088-4da3-9dc7-022898b5d388 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Refreshing network info cache for port 6d794bc3-2136-4b88-92e5-4703eb113b6d {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:22:04 user nova-compute[71229]: DEBUG nova.network.neutron [req-a809975f-ec3f-4a2f-8006-3a7e45f753b7 req-70036aa4-2088-4da3-9dc7-022898b5d388 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:22:04 user nova-compute[71229]: DEBUG nova.network.neutron [req-a809975f-ec3f-4a2f-8006-3a7e45f753b7 req-70036aa4-2088-4da3-9dc7-022898b5d388 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:22:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a809975f-ec3f-4a2f-8006-3a7e45f753b7 req-70036aa4-2088-4da3-9dc7-022898b5d388 service nova] Releasing lock "refresh_cache-cda43d26-e2f7-4e86-b850-b914957c9b57" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:22:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Acquired lock "refresh_cache-cda43d26-e2f7-4e86-b850-b914957c9b57" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:22:04 user nova-compute[71229]: DEBUG nova.network.neutron [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:22:04 user nova-compute[71229]: DEBUG nova.network.neutron [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:22:05 user nova-compute[71229]: DEBUG nova.compute.manager [req-a000a101-5f80-40e1-ab98-83045677a6dd req-88a47cb2-277c-491d-bb4a-79d89280772c service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received event network-changed-e9f0f991-6f64-45e6-9ce7-3f279f5ce31f {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:22:05 user nova-compute[71229]: DEBUG nova.compute.manager [req-a000a101-5f80-40e1-ab98-83045677a6dd req-88a47cb2-277c-491d-bb4a-79d89280772c service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Refreshing instance network info cache due to event network-changed-e9f0f991-6f64-45e6-9ce7-3f279f5ce31f. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:22:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a000a101-5f80-40e1-ab98-83045677a6dd req-88a47cb2-277c-491d-bb4a-79d89280772c service nova] Acquiring lock "refresh_cache-cda43d26-e2f7-4e86-b850-b914957c9b57" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:22:05 user nova-compute[71229]: INFO nova.virt.block_device [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Booting with volume f8e39010-7dc1-43ac-8b13-222b2f4e824c at /dev/vdc
Apr 11 15:22:06 user nova-compute[71229]: DEBUG os_brick.utils [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:22:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:06 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[00650966-e0c4-41cf-9dbc-3bee8a417d2a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d55e24a97c90\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:06 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[263470a5-ef00-4687-a70a-a2b2ccb30c64]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:06 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0b042e-7279-4373-8089-df9405d93656]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:06 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[87964e9b-cec1-4c87-99ff-56582d970feb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Running cmd (subprocess): nvme version {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] 'nvme version' failed. Not Retrying. {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:22:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] nvme not present on system {{(pid=71229) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 15:22:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:22:06 user nova-compute[71229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 15:22:06 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d42524d-3fd4-4343-853b-38d83648a11a]: (4, '') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71229) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 15:22:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 15:22:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] LIGHTOS: no hostnqn found. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 15:22:06 user nova-compute[71229]: DEBUG os_brick.utils [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d55e24a97c90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:22:06 user nova-compute[71229]: DEBUG nova.virt.block_device [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Updating existing volume attachment record: 4b630f2c-75d2-4f28-83ff-e5cc9e272904 {{(pid=71229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 15:22:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:06 user nova-compute[71229]: DEBUG nova.network.neutron [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Updating instance_info_cache with network_info: [{"id": "ee21c1bf-90da-44fe-b6f2-26132b87c5ed", "address": "fa:16:3e:3b:86:be", "network": {"id": "f10dfc9b-ad09-4bc9-9240-e6696b8f1b0e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-603478497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee21c1bf-90", "ovs_interfaceid": "ee21c1bf-90da-44fe-b6f2-26132b87c5ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2ac99ade-56b1-4865-b997-a9f8ef0a760b", "address": "fa:16:3e:b5:b8:ec", "network": {"id": "69cdc817-44c9-4420-acb7-e8aebab58bcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-667852060", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac99ade-56", "ovs_interfaceid": "2ac99ade-56b1-4865-b997-a9f8ef0a760b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "097c3cb1-bc8f-42c3-be49-73d500fdbc39", "address": "fa:16:3e:2b:4b:c2", "network": {"id": "69cdc817-44c9-4420-acb7-e8aebab58bcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-667852060", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap097c3cb1-bc", "ovs_interfaceid": "097c3cb1-bc8f-42c3-be49-73d500fdbc39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "65d1d6cb-a27f-4eae-822e-459770a9a587", "address": "fa:16:3e:02:0d:ff", "network": {"id": "69cdc817-44c9-4420-acb7-e8aebab58bcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-667852060", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d1d6cb-a2", "ovs_interfaceid": "65d1d6cb-a27f-4eae-822e-459770a9a587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9f2f28e-bb0a-4d1b-a831-e2c493521408", "address": "fa:16:3e:75:c7:7f", "network": {"id": "69cdc817-44c9-4420-acb7-e8aebab58bcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-667852060", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f2f28e-bb", "ovs_interfaceid": "d9f2f28e-bb0a-4d1b-a831-e2c493521408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6d794bc3-2136-4b88-92e5-4703eb113b6d", "address": "fa:16:3e:b0:b7:48", "network": {"id": "0065e8ee-5334-4ab3-8c58-6a2e6f9954f2", "bridge": "br-int", "label": "tempest-device-tagging-net2-447570772", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d794bc3-21", "ovs_interfaceid": "6d794bc3-2136-4b88-92e5-4703eb113b6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e9f0f991-6f64-45e6-9ce7-3f279f5ce31f", "address": "fa:16:3e:41:d4:9a", "network": {"id": "0065e8ee-5334-4ab3-8c58-6a2e6f9954f2", "bridge": "br-int", "label": "tempest-device-tagging-net2-447570772", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9f0f991-6f", "ovs_interfaceid": "e9f0f991-6f64-45e6-9ce7-3f279f5ce31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:22:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Releasing lock "refresh_cache-cda43d26-e2f7-4e86-b850-b914957c9b57" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:22:06 user nova-compute[71229]: DEBUG nova.compute.manager [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Instance network_info: |[{"id": "ee21c1bf-90da-44fe-b6f2-26132b87c5ed", "address": "fa:16:3e:3b:86:be", "network": {"id": "f10dfc9b-ad09-4bc9-9240-e6696b8f1b0e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-603478497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee21c1bf-90", "ovs_interfaceid": "ee21c1bf-90da-44fe-b6f2-26132b87c5ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2ac99ade-56b1-4865-b997-a9f8ef0a760b", "address": "fa:16:3e:b5:b8:ec", "network": {"id": "69cdc817-44c9-4420-acb7-e8aebab58bcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-667852060", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac99ade-56", "ovs_interfaceid": "2ac99ade-56b1-4865-b997-a9f8ef0a760b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "097c3cb1-bc8f-42c3-be49-73d500fdbc39", "address": "fa:16:3e:2b:4b:c2", "network": {"id": "69cdc817-44c9-4420-acb7-e8aebab58bcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-667852060", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap097c3cb1-bc", "ovs_interfaceid": "097c3cb1-bc8f-42c3-be49-73d500fdbc39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "65d1d6cb-a27f-4eae-822e-459770a9a587", "address": "fa:16:3e:02:0d:ff", "network": {"id": "69cdc817-44c9-4420-acb7-e8aebab58bcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-667852060", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d1d6cb-a2", "ovs_interfaceid": "65d1d6cb-a27f-4eae-822e-459770a9a587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9f2f28e-bb0a-4d1b-a831-e2c493521408", "address": "fa:16:3e:75:c7:7f", "network": {"id": "69cdc817-44c9-4420-acb7-e8aebab58bcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-667852060", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f2f28e-bb", "ovs_interfaceid": "d9f2f28e-bb0a-4d1b-a831-e2c493521408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6d794bc3-2136-4b88-92e5-4703eb113b6d", "address": "fa:16:3e:b0:b7:48", "network": {"id": "0065e8ee-5334-4ab3-8c58-6a2e6f9954f2", "bridge": "br-int", "label": "tempest-device-tagging-net2-447570772", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d794bc3-21", "ovs_interfaceid": "6d794bc3-2136-4b88-92e5-4703eb113b6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e9f0f991-6f64-45e6-9ce7-3f279f5ce31f", "address": "fa:16:3e:41:d4:9a", "network": {"id": "0065e8ee-5334-4ab3-8c58-6a2e6f9954f2", "bridge": "br-int", "label": "tempest-device-tagging-net2-447570772", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9f0f991-6f", "ovs_interfaceid": "e9f0f991-6f64-45e6-9ce7-3f279f5ce31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 15:22:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a000a101-5f80-40e1-ab98-83045677a6dd req-88a47cb2-277c-491d-bb4a-79d89280772c service nova] Acquired lock "refresh_cache-cda43d26-e2f7-4e86-b850-b914957c9b57" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:22:06 user nova-compute[71229]: DEBUG nova.network.neutron [req-a000a101-5f80-40e1-ab98-83045677a6dd req-88a47cb2-277c-491d-bb4a-79d89280772c service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Refreshing network info cache for port e9f0f991-6f64-45e6-9ce7-3f279f5ce31f {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:22:07 user nova-compute[71229]: DEBUG nova.network.neutron [req-a000a101-5f80-40e1-ab98-83045677a6dd req-88a47cb2-277c-491d-bb4a-79d89280772c service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Updated VIF entry in instance network info cache for port e9f0f991-6f64-45e6-9ce7-3f279f5ce31f. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:22:07 user nova-compute[71229]: DEBUG nova.network.neutron [req-a000a101-5f80-40e1-ab98-83045677a6dd req-88a47cb2-277c-491d-bb4a-79d89280772c service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Updating instance_info_cache with network_info: [{"id": "ee21c1bf-90da-44fe-b6f2-26132b87c5ed", "address": "fa:16:3e:3b:86:be", "network": {"id": "f10dfc9b-ad09-4bc9-9240-e6696b8f1b0e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-603478497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee21c1bf-90", "ovs_interfaceid": "ee21c1bf-90da-44fe-b6f2-26132b87c5ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2ac99ade-56b1-4865-b997-a9f8ef0a760b", "address": "fa:16:3e:b5:b8:ec", "network": {"id": "69cdc817-44c9-4420-acb7-e8aebab58bcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-667852060", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac99ade-56", "ovs_interfaceid": "2ac99ade-56b1-4865-b997-a9f8ef0a760b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "097c3cb1-bc8f-42c3-be49-73d500fdbc39", "address": "fa:16:3e:2b:4b:c2", "network": {"id": "69cdc817-44c9-4420-acb7-e8aebab58bcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-667852060", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap097c3cb1-bc", "ovs_interfaceid": "097c3cb1-bc8f-42c3-be49-73d500fdbc39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "65d1d6cb-a27f-4eae-822e-459770a9a587", "address": "fa:16:3e:02:0d:ff", "network": {"id": "69cdc817-44c9-4420-acb7-e8aebab58bcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-667852060", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d1d6cb-a2", "ovs_interfaceid": "65d1d6cb-a27f-4eae-822e-459770a9a587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9f2f28e-bb0a-4d1b-a831-e2c493521408", "address": "fa:16:3e:75:c7:7f", "network": {"id": "69cdc817-44c9-4420-acb7-e8aebab58bcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-667852060", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f2f28e-bb", "ovs_interfaceid": "d9f2f28e-bb0a-4d1b-a831-e2c493521408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6d794bc3-2136-4b88-92e5-4703eb113b6d", "address": "fa:16:3e:b0:b7:48", "network": {"id": "0065e8ee-5334-4ab3-8c58-6a2e6f9954f2", "bridge": "br-int", "label": "tempest-device-tagging-net2-447570772", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d794bc3-21", "ovs_interfaceid": "6d794bc3-2136-4b88-92e5-4703eb113b6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e9f0f991-6f64-45e6-9ce7-3f279f5ce31f", "address": "fa:16:3e:41:d4:9a", "network": {"id": "0065e8ee-5334-4ab3-8c58-6a2e6f9954f2", "bridge": "br-int", "label": "tempest-device-tagging-net2-447570772", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9f0f991-6f", "ovs_interfaceid": "e9f0f991-6f64-45e6-9ce7-3f279f5ce31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:22:07 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a000a101-5f80-40e1-ab98-83045677a6dd req-88a47cb2-277c-491d-bb4a-79d89280772c service nova] Releasing lock "refresh_cache-cda43d26-e2f7-4e86-b850-b914957c9b57" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:22:08 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG nova.compute.manager [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Start spawning the instance on the hypervisor. {{(pid=71229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Creating instance directory {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 15:22:10 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Creating image(s)
Apr 11 15:22:10 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Did not create local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Ensure instance console log exists: /opt/stack/data/nova/instances/cda43d26-e2f7-4e86-b850-b914957c9b57/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Start _get_guest_xml network_info=[{"id": "ee21c1bf-90da-44fe-b6f2-26132b87c5ed", "address": "fa:16:3e:3b:86:be", "network": {"id": "f10dfc9b-ad09-4bc9-9240-e6696b8f1b0e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-603478497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee21c1bf-90", "ovs_interfaceid": "ee21c1bf-90da-44fe-b6f2-26132b87c5ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2ac99ade-56b1-4865-b997-a9f8ef0a760b", "address": "fa:16:3e:b5:b8:ec", "network": {"id": "69cdc817-44c9-4420-acb7-e8aebab58bcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-667852060", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac99ade-56", "ovs_interfaceid": "2ac99ade-56b1-4865-b997-a9f8ef0a760b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "097c3cb1-bc8f-42c3-be49-73d500fdbc39", "address": "fa:16:3e:2b:4b:c2", "network": {"id": "69cdc817-44c9-4420-acb7-e8aebab58bcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-667852060", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap097c3cb1-bc", "ovs_interfaceid": "097c3cb1-bc8f-42c3-be49-73d500fdbc39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "65d1d6cb-a27f-4eae-822e-459770a9a587", "address": "fa:16:3e:02:0d:ff", "network": {"id": "69cdc817-44c9-4420-acb7-e8aebab58bcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-667852060", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d1d6cb-a2", "ovs_interfaceid": "65d1d6cb-a27f-4eae-822e-459770a9a587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9f2f28e-bb0a-4d1b-a831-e2c493521408", "address": "fa:16:3e:75:c7:7f", "network": {"id": "69cdc817-44c9-4420-acb7-e8aebab58bcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-667852060", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f2f28e-bb", "ovs_interfaceid": "d9f2f28e-bb0a-4d1b-a831-e2c493521408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6d794bc3-2136-4b88-92e5-4703eb113b6d", "address": "fa:16:3e:b0:b7:48", "network": {"id": "0065e8ee-5334-4ab3-8c58-6a2e6f9954f2", "bridge": "br-int", "label": "tempest-device-tagging-net2-447570772", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d794bc3-21", "ovs_interfaceid": "6d794bc3-2136-4b88-92e5-4703eb113b6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e9f0f991-6f64-45e6-9ce7-3f279f5ce31f", "address": "fa:16:3e:41:d4:9a", "network": {"id": "0065e8ee-5334-4ab3-8c58-6a2e6f9954f2", "bridge": "br-int", "label": "tempest-device-tagging-net2-447570772", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9f0f991-6f", "ovs_interfaceid": "e9f0f991-6f64-45e6-9ce7-3f279f5ce31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UVqYIxlh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cda43d26-e2f7-4e86-b850-b914957c9b57', 'attached_at': '', 'detached_at': '', 'volume_id': '25935fb7-f8be-4263-8b3b-42330253644d', 'serial': '25935fb7-f8be-4263-8b3b-42330253644d'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'fee88e93-607a-4d05-a072-70905d3a3e1d', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None}, {'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dlckRVJh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cda43d26-e2f7-4e86-b850-b914957c9b57', 'attached_at': '', 'detached_at': '', 'volume_id': 'f9255f82-4f06-40f7-8c74-41549e0ae487', 'serial': 'f9255f82-4f06-40f7-8c74-41549e0ae487'}, 'boot_index': 1, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '867c7148-32b4-4011-a5e5-d98f56d5373d', 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None}, {'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VoTjrUcu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cda43d26-e2f7-4e86-b850-b914957c9b57', 'attached_at': '', 'detached_at': '', 'volume_id': 'f8e39010-7dc1-43ac-8b13-222b2f4e824c', 'serial': 'f8e39010-7dc1-43ac-8b13-222b2f4e824c'}, 'boot_index': 2, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '4b630f2c-75d2-4f28-83ff-e5cc9e272904', 'guest_format': None, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:22:10 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:22:10 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:22:10 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG os_brick.initiator.connector [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Factory for ISCSI on None {{(pid=71229) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UVqYIxlh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:22:10 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:22:10 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:22:10 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:22:10 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:22:10 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 15:22:10 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec5c82c-2604-4fec-8be9-feaa93198adc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 15:22:10 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d -p 172.16.0.220:3260 --interface default --op new {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0896b7b6-ee72-4534-80b6-b0d8665b0c9c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d] added\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d] added
Apr 11 15:22:10 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba9b614-03d7-4195-9c8f-7c7981373db3]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5daf27d1-8977-4923-b029-16b69f7d27d2]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UVqYIxlh {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UVqYIxlh" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e4387a-e050-45e7-8ddf-6bb69196edbf]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UVqYIxlh'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c32655d-fcb8-4c80-bb6e-d7e438bc08fb]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b789f785-c808-4ec3-a730-99047b850898]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 11 15:22:10 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:22:10 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 11 15:22:10 user nova-compute[71229]:  {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:22:10 user nova-compute[71229]: WARNING os_brick.initiator.connectors.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 11 15:22:10 user nova-compute[71229]: 
Apr 11 15:22:10 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d -p 172.16.0.220:3260 --login {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:11 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:11 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5607ab0-80c3-4720-96e9-7fa94632fa3a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:11 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d, portal: 172.16.0.220,3260]
Apr 11 15:22:11 user nova-compute[71229]: Login to [iface: default, target: iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d, portal: 172.16.0.220,3260] successful.
Apr 11 15:22:11 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:22:11 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:11 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:11 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66e3943-4ab9-4902-b1e4-34a49c8eb540]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:11 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:22:11 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:11 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:11 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53cb5bd-b4c5-498a-b91f-2d722278af2b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:11 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)
Apr 11 15:22:11 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:22:11 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)
Apr 11 15:22:11 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:22:11 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.239s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:22:11 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 15:22:11 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 15:22:11 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 15:22:11 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:11 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:11 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[407948df-20cd-438b-a5ea-7601ee74b5bd]: (4, ('- - 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:11 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:22:11 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UVqYIxlh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 15:22:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.271s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] <== connect_volume: return (1273ms) {'type': 'block', 'scsi_wwn': '23437353330373263', 'path': '/dev/sdb'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437353330373263', 'path': '/dev/sdb'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dlckRVJh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:22:12 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:22:12 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:22:12 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:22:12 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:22:12 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 15:22:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee0e84f-d619-40c3-b9d4-32a026dd1ab1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 15:22:12 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 -p 172.16.0.220:3260 --interface default --op new {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cf063f-ebd7-4c83-9be0-b3e7b884ac3f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487] added\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487] added
Apr 11 15:22:12 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a25ae1f-72ee-4f9e-898c-a674f0d415d9]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db8d1b8-87a1-4a5a-a850-c2f5e851bd5e]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dlckRVJh {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dlckRVJh" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9c20bf-16d8-4659-912b-5d37c61cea73]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dlckRVJh'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7950fd8e-4ac1-4dbd-925f-494bba7e0cfa]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b0f5ae-145b-4a27-8854-548749d39504]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)
Apr 11 15:22:12 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)
Apr 11 15:22:12 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 -p 172.16.0.220:3260 --login {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c199cb38-0917-463e-88a8-d76cfa4dc9e3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487, portal: 172.16.0.220,3260]
Apr 11 15:22:12 user nova-compute[71229]: Login to [iface: default, target: iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487, portal: 172.16.0.220,3260] successful.
Apr 11 15:22:12 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8fae28-de7d-4cac-812b-b107fbba46a9]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa359c22-ac0e-4180-8f7f-5e3fdb80b768]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)
Apr 11 15:22:12 user nova-compute[71229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)
Apr 11 15:22:12 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)
Apr 11 15:22:12 user nova-compute[71229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)
Apr 11 15:22:12 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f0733b-7fe6-4ae1-9521-751aa40065ad]: (4, ('- - 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:22:12 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dlckRVJh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '26164363938633739', 'path': '/dev/sdc'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164363938633739', 'path': '/dev/sdc'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VoTjrUcu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:22:13 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:22:13 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:22:13 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:22:13 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:22:13 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 15:22:13 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f74e0d-0bb8-4ced-b067-6cf73594bbb6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 15:22:13 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c -p 172.16.0.220:3260 --interface default --op new {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c34b8ea-b441-4ebb-9612-72a51d7eb60d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c] added\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c] added
Apr 11 15:22:13 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[891a2148-5321-4623-934a-edae85ff29d7]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[08acbf00-a07a-44e0-8406-bc0cee8e56a1]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VoTjrUcu {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VoTjrUcu" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a6e2ff-9301-4f43-a188-e768b9e4afb9]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VoTjrUcu'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ef0dd8-0d83-496f-9446-098030527c4a]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f620f475-761b-44eb-b853-73cd2d285d55]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)
Apr 11 15:22:13 user nova-compute[71229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)
Apr 11 15:22:13 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)
Apr 11 15:22:13 user nova-compute[71229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)
Apr 11 15:22:13 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c -p 172.16.0.220:3260 --login {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb75dea-b415-4dd0-a158-0650e2ec9770]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c, portal: 172.16.0.220,3260]
Apr 11 15:22:13 user nova-compute[71229]: Login to [iface: default, target: iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c, portal: 172.16.0.220,3260] successful.
Apr 11 15:22:13 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5120707b-f5b4-4c72-b3a0-6d9aaaeb9fdd]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fae930f-be7c-4013-87fa-78a2a8be5acb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)
Apr 11 15:22:13 user nova-compute[71229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)
Apr 11 15:22:13 user nova-compute[71229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)
Apr 11 15:22:13 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)
Apr 11 15:22:13 user nova-compute[71229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)
Apr 11 15:22:13 user nova-compute[71229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)
Apr 11 15:22:13 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[254810d6-b5f7-43a7-8860-dedff2a7dbf2]: (4, ('- - 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:22:13 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VoTjrUcu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23036613336343766', 'path': '/dev/sdd'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036613336343766', 'path': '/dev/sdd'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T15:21:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1171936509',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1171936509',id=9,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPnuW6ogctwbnKiG/DdSHSi9VgV3vyQxSlprDZSCcAll42WGSndepoNq81o5lA3ENttdnb+uA8SJzEVin1fvRiPZ5AZG/PDhtEvtRNFaLWWnzYWXpsGmE8Y+m9wccFHrw==',key_name='tempest-keypair-1831001595',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e64015226c19441d87f3a6999a3a8db8',ramdisk_id='',reservation_id='r-u9ytaiu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-441311830',owner_user_name='tempest-TaggedBootDevicesTest_v242-441311830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:21:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31d206ed111842fd95ce5eb5b3835a48',uuid=cda43d26-e2f7-4e86-b850-b914957c9b57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee21c1bf-90da-44fe-b6f2-26132b87c5ed", "address": "fa:16:3e:3b:86:be", "network": {"id": "f10dfc9b-ad09-4bc9-9240-e6696b8f1b0e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-603478497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee21c1bf-90", "ovs_interfaceid": "ee21c1bf-90da-44fe-b6f2-26132b87c5ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Converting VIF {"id": "ee21c1bf-90da-44fe-b6f2-26132b87c5ed", "address": "fa:16:3e:3b:86:be", "network": {"id": "f10dfc9b-ad09-4bc9-9240-e6696b8f1b0e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-603478497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee21c1bf-90", "ovs_interfaceid": "ee21c1bf-90da-44fe-b6f2-26132b87c5ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:86:be,bridge_name='br-int',has_traffic_filtering=True,id=ee21c1bf-90da-44fe-b6f2-26132b87c5ed,network=Network(f10dfc9b-ad09-4bc9-9240-e6696b8f1b0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee21c1bf-90') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T15:21:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1171936509',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1171936509',id=9,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPnuW6ogctwbnKiG/DdSHSi9VgV3vyQxSlprDZSCcAll42WGSndepoNq81o5lA3ENttdnb+uA8SJzEVin1fvRiPZ5AZG/PDhtEvtRNFaLWWnzYWXpsGmE8Y+m9wccFHrw==',key_name='tempest-keypair-1831001595',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e64015226c19441d87f3a6999a3a8db8',ramdisk_id='',reservation_id='r-u9ytaiu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-441311830',owner_user_name='tempest-TaggedBootDevicesTest_v242-441311830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:21:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31d206ed111842fd95ce5eb5b3835a48',uuid=cda43d26-e2f7-4e86-b850-b914957c9b57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ac99ade-56b1-4865-b997-a9f8ef0a760b", "address": "fa:16:3e:b5:b8:ec", "network": {"id": "69cdc817-44c9-4420-acb7-e8aebab58bcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-667852060", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac99ade-56", "ovs_interfaceid": "2ac99ade-56b1-4865-b997-a9f8ef0a760b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Converting VIF {"id": "2ac99ade-56b1-4865-b997-a9f8ef0a760b", "address": "fa:16:3e:b5:b8:ec", "network": {"id": "69cdc817-44c9-4420-acb7-e8aebab58bcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-667852060", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac99ade-56", "ovs_interfaceid": "2ac99ade-56b1-4865-b997-a9f8ef0a760b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:b8:ec,bridge_name='br-int',has_traffic_filtering=True,id=2ac99ade-56b1-4865-b997-a9f8ef0a760b,network=Network(69cdc817-44c9-4420-acb7-e8aebab58bcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2ac99ade-56') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T15:21:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1171936509',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1171936509',id=9,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPnuW6ogctwbnKiG/DdSHSi9VgV3vyQxSlprDZSCcAll42WGSndepoNq81o5lA3ENttdnb+uA8SJzEVin1fvRiPZ5AZG/PDhtEvtRNFaLWWnzYWXpsGmE8Y+m9wccFHrw==',key_name='tempest-keypair-1831001595',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e64015226c19441d87f3a6999a3a8db8',ramdisk_id='',reservation_id='r-u9ytaiu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-441311830',owner_user_name='tempest-TaggedBootDevicesTest_v242-441311830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:21:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31d206ed111842fd95ce5eb5b3835a48',uuid=cda43d26-e2f7-4e86-b850-b914957c9b57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "097c3cb1-bc8f-42c3-be49-73d500fdbc39", "address": "fa:16:3e:2b:4b:c2", "network": {"id": "69cdc817-44c9-4420-acb7-e8aebab58bcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-667852060", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap097c3cb1-bc", "ovs_interfaceid": "097c3cb1-bc8f-42c3-be49-73d500fdbc39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Converting VIF {"id": "097c3cb1-bc8f-42c3-be49-73d500fdbc39", "address": "fa:16:3e:2b:4b:c2", "network": {"id": "69cdc817-44c9-4420-acb7-e8aebab58bcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-667852060", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap097c3cb1-bc", "ovs_interfaceid": "097c3cb1-bc8f-42c3-be49-73d500fdbc39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:4b:c2,bridge_name='br-int',has_traffic_filtering=True,id=097c3cb1-bc8f-42c3-be49-73d500fdbc39,network=Network(69cdc817-44c9-4420-acb7-e8aebab58bcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap097c3cb1-bc') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T15:21:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1171936509',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1171936509',id=9,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPnuW6ogctwbnKiG/DdSHSi9VgV3vyQxSlprDZSCcAll42WGSndepoNq81o5lA3ENttdnb+uA8SJzEVin1fvRiPZ5AZG/PDhtEvtRNFaLWWnzYWXpsGmE8Y+m9wccFHrw==',key_name='tempest-keypair-1831001595',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e64015226c19441d87f3a6999a3a8db8',ramdisk_id='',reservation_id='r-u9ytaiu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-441311830',owner_user_name='tempest-TaggedBootDevicesTest_v242-441311830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:21:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31d206ed111842fd95ce5eb5b3835a48',uuid=cda43d26-e2f7-4e86-b850-b914957c9b57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65d1d6cb-a27f-4eae-822e-459770a9a587", "address": "fa:16:3e:02:0d:ff", "network": {"id": "69cdc817-44c9-4420-acb7-e8aebab58bcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-667852060", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d1d6cb-a2", "ovs_interfaceid": "65d1d6cb-a27f-4eae-822e-459770a9a587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Converting VIF {"id": "65d1d6cb-a27f-4eae-822e-459770a9a587", "address": "fa:16:3e:02:0d:ff", "network": {"id": "69cdc817-44c9-4420-acb7-e8aebab58bcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-667852060", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d1d6cb-a2", "ovs_interfaceid": "65d1d6cb-a27f-4eae-822e-459770a9a587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:0d:ff,bridge_name='br-int',has_traffic_filtering=True,id=65d1d6cb-a27f-4eae-822e-459770a9a587,network=Network(69cdc817-44c9-4420-acb7-e8aebab58bcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65d1d6cb-a2') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T15:21:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1171936509',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1171936509',id=9,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPnuW6ogctwbnKiG/DdSHSi9VgV3vyQxSlprDZSCcAll42WGSndepoNq81o5lA3ENttdnb+uA8SJzEVin1fvRiPZ5AZG/PDhtEvtRNFaLWWnzYWXpsGmE8Y+m9wccFHrw==',key_name='tempest-keypair-1831001595',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e64015226c19441d87f3a6999a3a8db8',ramdisk_id='',reservation_id='r-u9ytaiu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-441311830',owner_user_name='tempest-TaggedBootDevicesTest_v242-441311830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:21:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31d206ed111842fd95ce5eb5b3835a48',uuid=cda43d26-e2f7-4e86-b850-b914957c9b57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9f2f28e-bb0a-4d1b-a831-e2c493521408", "address": "fa:16:3e:75:c7:7f", "network": {"id": "69cdc817-44c9-4420-acb7-e8aebab58bcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-667852060", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f2f28e-bb", "ovs_interfaceid": "d9f2f28e-bb0a-4d1b-a831-e2c493521408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Converting VIF {"id": "d9f2f28e-bb0a-4d1b-a831-e2c493521408", "address": "fa:16:3e:75:c7:7f", "network": {"id": "69cdc817-44c9-4420-acb7-e8aebab58bcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-667852060", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f2f28e-bb", "ovs_interfaceid": "d9f2f28e-bb0a-4d1b-a831-e2c493521408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:c7:7f,bridge_name='br-int',has_traffic_filtering=True,id=d9f2f28e-bb0a-4d1b-a831-e2c493521408,network=Network(69cdc817-44c9-4420-acb7-e8aebab58bcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9f2f28e-bb') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T15:21:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1171936509',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1171936509',id=9,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPnuW6ogctwbnKiG/DdSHSi9VgV3vyQxSlprDZSCcAll42WGSndepoNq81o5lA3ENttdnb+uA8SJzEVin1fvRiPZ5AZG/PDhtEvtRNFaLWWnzYWXpsGmE8Y+m9wccFHrw==',key_name='tempest-keypair-1831001595',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e64015226c19441d87f3a6999a3a8db8',ramdisk_id='',reservation_id='r-u9ytaiu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-441311830',owner_user_name='tempest-TaggedBootDevicesTest_v242-441311830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:21:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31d206ed111842fd95ce5eb5b3835a48',uuid=cda43d26-e2f7-4e86-b850-b914957c9b57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d794bc3-2136-4b88-92e5-4703eb113b6d", "address": "fa:16:3e:b0:b7:48", "network": {"id": "0065e8ee-5334-4ab3-8c58-6a2e6f9954f2", "bridge": "br-int", "label": "tempest-device-tagging-net2-447570772", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d794bc3-21", "ovs_interfaceid": "6d794bc3-2136-4b88-92e5-4703eb113b6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Converting VIF {"id": "6d794bc3-2136-4b88-92e5-4703eb113b6d", "address": "fa:16:3e:b0:b7:48", "network": {"id": "0065e8ee-5334-4ab3-8c58-6a2e6f9954f2", "bridge": "br-int", "label": "tempest-device-tagging-net2-447570772", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d794bc3-21", "ovs_interfaceid": "6d794bc3-2136-4b88-92e5-4703eb113b6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:b7:48,bridge_name='br-int',has_traffic_filtering=True,id=6d794bc3-2136-4b88-92e5-4703eb113b6d,network=Network(0065e8ee-5334-4ab3-8c58-6a2e6f9954f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d794bc3-21') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T15:21:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1171936509',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1171936509',id=9,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPnuW6ogctwbnKiG/DdSHSi9VgV3vyQxSlprDZSCcAll42WGSndepoNq81o5lA3ENttdnb+uA8SJzEVin1fvRiPZ5AZG/PDhtEvtRNFaLWWnzYWXpsGmE8Y+m9wccFHrw==',key_name='tempest-keypair-1831001595',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e64015226c19441d87f3a6999a3a8db8',ramdisk_id='',reservation_id='r-u9ytaiu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-441311830',owner_user_name='tempest-TaggedBootDevicesTest_v242-441311830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:21:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31d206ed111842fd95ce5eb5b3835a48',uuid=cda43d26-e2f7-4e86-b850-b914957c9b57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9f0f991-6f64-45e6-9ce7-3f279f5ce31f", "address": "fa:16:3e:41:d4:9a", "network": {"id": "0065e8ee-5334-4ab3-8c58-6a2e6f9954f2", "bridge": "br-int", "label": "tempest-device-tagging-net2-447570772", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9f0f991-6f", "ovs_interfaceid": "e9f0f991-6f64-45e6-9ce7-3f279f5ce31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Converting VIF {"id": "e9f0f991-6f64-45e6-9ce7-3f279f5ce31f", "address": "fa:16:3e:41:d4:9a", "network": {"id": "0065e8ee-5334-4ab3-8c58-6a2e6f9954f2", "bridge": "br-int", "label": "tempest-device-tagging-net2-447570772", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9f0f991-6f", "ovs_interfaceid": "e9f0f991-6f64-45e6-9ce7-3f279f5ce31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:d4:9a,bridge_name='br-int',has_traffic_filtering=True,id=e9f0f991-6f64-45e6-9ce7-3f279f5ce31f,network=Network(0065e8ee-5334-4ab3-8c58-6a2e6f9954f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9f0f991-6f') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG nova.objects.instance [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lazy-loading 'pci_devices' on Instance uuid cda43d26-e2f7-4e86-b850-b914957c9b57 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:22:14 user nova-compute[71229]:   <uuid>cda43d26-e2f7-4e86-b850-b914957c9b57</uuid>
Apr 11 15:22:14 user nova-compute[71229]:   <name>instance-00000009</name>
Apr 11 15:22:14 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:22:14 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:22:14 user nova-compute[71229]:   <metadata>
Apr 11 15:22:14 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:22:14 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:22:14 user nova-compute[71229]:       <nova:name>tempest-device-tagging-server-1171936509</nova:name>
Apr 11 15:22:14 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:22:10</nova:creationTime>
Apr 11 15:22:14 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:22:14 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:22:14 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:22:14 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:22:14 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:22:14 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:22:14 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:22:14 user nova-compute[71229]:       <nova:owner>
Apr 11 15:22:14 user nova-compute[71229]:         <nova:user uuid="31d206ed111842fd95ce5eb5b3835a48">tempest-TaggedBootDevicesTest_v242-441311830-project-member</nova:user>
Apr 11 15:22:14 user nova-compute[71229]:         <nova:project uuid="e64015226c19441d87f3a6999a3a8db8">tempest-TaggedBootDevicesTest_v242-441311830</nova:project>
Apr 11 15:22:14 user nova-compute[71229]:       </nova:owner>
Apr 11 15:22:14 user nova-compute[71229]:       <nova:root type="image" uuid="52fe638c-5ada-47d5-b376-233bfa808a37"/>
Apr 11 15:22:14 user nova-compute[71229]:       <nova:ports>
Apr 11 15:22:14 user nova-compute[71229]:         <nova:port uuid="ee21c1bf-90da-44fe-b6f2-26132b87c5ed">
Apr 11 15:22:14 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 11 15:22:14 user nova-compute[71229]:         </nova:port>
Apr 11 15:22:14 user nova-compute[71229]:         <nova:port uuid="2ac99ade-56b1-4865-b997-a9f8ef0a760b">
Apr 11 15:22:14 user nova-compute[71229]:           <nova:ip type="fixed" address="10.1.1.39" ipVersion="4"/>
Apr 11 15:22:14 user nova-compute[71229]:         </nova:port>
Apr 11 15:22:14 user nova-compute[71229]:         <nova:port uuid="097c3cb1-bc8f-42c3-be49-73d500fdbc39">
Apr 11 15:22:14 user nova-compute[71229]:           <nova:ip type="fixed" address="10.1.1.137" ipVersion="4"/>
Apr 11 15:22:14 user nova-compute[71229]:         </nova:port>
Apr 11 15:22:14 user nova-compute[71229]:         <nova:port uuid="65d1d6cb-a27f-4eae-822e-459770a9a587">
Apr 11 15:22:14 user nova-compute[71229]:           <nova:ip type="fixed" address="10.1.1.97" ipVersion="4"/>
Apr 11 15:22:14 user nova-compute[71229]:         </nova:port>
Apr 11 15:22:14 user nova-compute[71229]:         <nova:port uuid="d9f2f28e-bb0a-4d1b-a831-e2c493521408">
Apr 11 15:22:14 user nova-compute[71229]:           <nova:ip type="fixed" address="10.1.1.240" ipVersion="4"/>
Apr 11 15:22:14 user nova-compute[71229]:         </nova:port>
Apr 11 15:22:14 user nova-compute[71229]:         <nova:port uuid="6d794bc3-2136-4b88-92e5-4703eb113b6d">
Apr 11 15:22:14 user nova-compute[71229]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 11 15:22:14 user nova-compute[71229]:         </nova:port>
Apr 11 15:22:14 user nova-compute[71229]:         <nova:port uuid="e9f0f991-6f64-45e6-9ce7-3f279f5ce31f">
Apr 11 15:22:14 user nova-compute[71229]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 11 15:22:14 user nova-compute[71229]:         </nova:port>
Apr 11 15:22:14 user nova-compute[71229]:       </nova:ports>
Apr 11 15:22:14 user nova-compute[71229]:     </nova:instance>
Apr 11 15:22:14 user nova-compute[71229]:   </metadata>
Apr 11 15:22:14 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:22:14 user nova-compute[71229]:     <system>
Apr 11 15:22:14 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:22:14 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:22:14 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:22:14 user nova-compute[71229]:       <entry name="serial">cda43d26-e2f7-4e86-b850-b914957c9b57</entry>
Apr 11 15:22:14 user nova-compute[71229]:       <entry name="uuid">cda43d26-e2f7-4e86-b850-b914957c9b57</entry>
Apr 11 15:22:14 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:22:14 user nova-compute[71229]:     </system>
Apr 11 15:22:14 user nova-compute[71229]:   </sysinfo>
Apr 11 15:22:14 user nova-compute[71229]:   <os>
Apr 11 15:22:14 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:22:14 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 15:22:14 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:22:14 user nova-compute[71229]:   </os>
Apr 11 15:22:14 user nova-compute[71229]:   <features>
Apr 11 15:22:14 user nova-compute[71229]:     <acpi/>
Apr 11 15:22:14 user nova-compute[71229]:     <apic/>
Apr 11 15:22:14 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:22:14 user nova-compute[71229]:   </features>
Apr 11 15:22:14 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:22:14 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:22:14 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:22:14 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:22:14 user nova-compute[71229]:   </clock>
Apr 11 15:22:14 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:22:14 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:22:14 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:22:14 user nova-compute[71229]:   </cpu>
Apr 11 15:22:14 user nova-compute[71229]:   <devices>
Apr 11 15:22:14 user nova-compute[71229]:     <disk type="file" device="cdrom">
Apr 11 15:22:14 user nova-compute[71229]:       <driver name="qemu" type="raw" cache="none"/>
Apr 11 15:22:14 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/cda43d26-e2f7-4e86-b850-b914957c9b57/disk.config"/>
Apr 11 15:22:14 user nova-compute[71229]:       <target dev="hda" bus="ide"/>
Apr 11 15:22:14 user nova-compute[71229]:     </disk>
Apr 11 15:22:14 user nova-compute[71229]:     <disk type="block" device="disk">
Apr 11 15:22:14 user nova-compute[71229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:22:14 user nova-compute[71229]:       <source dev="/dev/sdb"/>
Apr 11 15:22:14 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:22:14 user nova-compute[71229]:       <serial>25935fb7-f8be-4263-8b3b-42330253644d</serial>
Apr 11 15:22:14 user nova-compute[71229]:     </disk>
Apr 11 15:22:14 user nova-compute[71229]:     <disk type="block" device="disk">
Apr 11 15:22:14 user nova-compute[71229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:22:14 user nova-compute[71229]:       <source dev="/dev/sdc"/>
Apr 11 15:22:14 user nova-compute[71229]:       <target dev="vdb" bus="virtio"/>
Apr 11 15:22:14 user nova-compute[71229]:       <serial>f9255f82-4f06-40f7-8c74-41549e0ae487</serial>
Apr 11 15:22:14 user nova-compute[71229]:     </disk>
Apr 11 15:22:14 user nova-compute[71229]:     <disk type="block" device="disk">
Apr 11 15:22:14 user nova-compute[71229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:22:14 user nova-compute[71229]:       <source dev="/dev/sdd"/>
Apr 11 15:22:14 user nova-compute[71229]:       <target dev="vdc" bus="virtio"/>
Apr 11 15:22:14 user nova-compute[71229]:       <serial>f8e39010-7dc1-43ac-8b13-222b2f4e824c</serial>
Apr 11 15:22:14 user nova-compute[71229]:     </disk>
Apr 11 15:22:14 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:22:14 user nova-compute[71229]:       <mac address="fa:16:3e:3b:86:be"/>
Apr 11 15:22:14 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:22:14 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:22:14 user nova-compute[71229]:       <target dev="tapee21c1bf-90"/>
Apr 11 15:22:14 user nova-compute[71229]:     </interface>
Apr 11 15:22:14 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:22:14 user nova-compute[71229]:       <mac address="fa:16:3e:b5:b8:ec"/>
Apr 11 15:22:14 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:22:14 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:22:14 user nova-compute[71229]:       <target dev="tap2ac99ade-56"/>
Apr 11 15:22:14 user nova-compute[71229]:     </interface>
Apr 11 15:22:14 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:22:14 user nova-compute[71229]:       <mac address="fa:16:3e:2b:4b:c2"/>
Apr 11 15:22:14 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:22:14 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:22:14 user nova-compute[71229]:       <target dev="tap097c3cb1-bc"/>
Apr 11 15:22:14 user nova-compute[71229]:     </interface>
Apr 11 15:22:14 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:22:14 user nova-compute[71229]:       <mac address="fa:16:3e:02:0d:ff"/>
Apr 11 15:22:14 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:22:14 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:22:14 user nova-compute[71229]:       <target dev="tap65d1d6cb-a2"/>
Apr 11 15:22:14 user nova-compute[71229]:     </interface>
Apr 11 15:22:14 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:22:14 user nova-compute[71229]:       <mac address="fa:16:3e:75:c7:7f"/>
Apr 11 15:22:14 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:22:14 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:22:14 user nova-compute[71229]:       <target dev="tapd9f2f28e-bb"/>
Apr 11 15:22:14 user nova-compute[71229]:     </interface>
Apr 11 15:22:14 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:22:14 user nova-compute[71229]:       <mac address="fa:16:3e:b0:b7:48"/>
Apr 11 15:22:14 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:22:14 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:22:14 user nova-compute[71229]:       <target dev="tap6d794bc3-21"/>
Apr 11 15:22:14 user nova-compute[71229]:     </interface>
Apr 11 15:22:14 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:22:14 user nova-compute[71229]:       <mac address="fa:16:3e:41:d4:9a"/>
Apr 11 15:22:14 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:22:14 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:22:14 user nova-compute[71229]:       <target dev="tape9f0f991-6f"/>
Apr 11 15:22:14 user nova-compute[71229]:     </interface>
Apr 11 15:22:14 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:22:14 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/cda43d26-e2f7-4e86-b850-b914957c9b57/console.log" append="off"/>
Apr 11 15:22:14 user nova-compute[71229]:     </serial>
Apr 11 15:22:14 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:22:14 user nova-compute[71229]:     <video>
Apr 11 15:22:14 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:22:14 user nova-compute[71229]:     </video>
Apr 11 15:22:14 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:22:14 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:22:14 user nova-compute[71229]:     </rng>
Apr 11 15:22:14 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:22:14 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:22:14 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:22:14 user nova-compute[71229]:     </memballoon>
Apr 11 15:22:14 user nova-compute[71229]:   </devices>
Apr 11 15:22:14 user nova-compute[71229]: </domain>
Apr 11 15:22:14 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T15:21:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1171936509',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1171936509',id=9,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPnuW6ogctwbnKiG/DdSHSi9VgV3vyQxSlprDZSCcAll42WGSndepoNq81o5lA3ENttdnb+uA8SJzEVin1fvRiPZ5AZG/PDhtEvtRNFaLWWnzYWXpsGmE8Y+m9wccFHrw==',key_name='tempest-keypair-1831001595',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e64015226c19441d87f3a6999a3a8db8',ramdisk_id='',reservation_id='r-u9ytaiu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-441311830',owner_user_name='tempest-TaggedBootDevicesTest_v242-441311830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:21:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31d206ed111842fd95ce5eb5b3835a48',uuid=cda43d26-e2f7-4e86-b850-b914957c9b57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee21c1bf-90da-44fe-b6f2-26132b87c5ed", "address": "fa:16:3e:3b:86:be", "network": {"id": "f10dfc9b-ad09-4bc9-9240-e6696b8f1b0e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-603478497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee21c1bf-90", "ovs_interfaceid": "ee21c1bf-90da-44fe-b6f2-26132b87c5ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Converting VIF {"id": "ee21c1bf-90da-44fe-b6f2-26132b87c5ed", "address": "fa:16:3e:3b:86:be", "network": {"id": "f10dfc9b-ad09-4bc9-9240-e6696b8f1b0e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-603478497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee21c1bf-90", "ovs_interfaceid": "ee21c1bf-90da-44fe-b6f2-26132b87c5ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:86:be,bridge_name='br-int',has_traffic_filtering=True,id=ee21c1bf-90da-44fe-b6f2-26132b87c5ed,network=Network(f10dfc9b-ad09-4bc9-9240-e6696b8f1b0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee21c1bf-90') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG os_vif [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:86:be,bridge_name='br-int',has_traffic_filtering=True,id=ee21c1bf-90da-44fe-b6f2-26132b87c5ed,network=Network(f10dfc9b-ad09-4bc9-9240-e6696b8f1b0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee21c1bf-90') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee21c1bf-90, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapee21c1bf-90, col_values=(('external_ids', {'iface-id': 'ee21c1bf-90da-44fe-b6f2-26132b87c5ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:86:be', 'vm-uuid': 'cda43d26-e2f7-4e86-b850-b914957c9b57'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:14 user nova-compute[71229]: INFO os_vif [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:86:be,bridge_name='br-int',has_traffic_filtering=True,id=ee21c1bf-90da-44fe-b6f2-26132b87c5ed,network=Network(f10dfc9b-ad09-4bc9-9240-e6696b8f1b0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee21c1bf-90')
Apr 11 15:22:14 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T15:21:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1171936509',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1171936509',id=9,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPnuW6ogctwbnKiG/DdSHSi9VgV3vyQxSlprDZSCcAll42WGSndepoNq81o5lA3ENttdnb+uA8SJzEVin1fvRiPZ5AZG/PDhtEvtRNFaLWWnzYWXpsGmE8Y+m9wccFHrw==',key_name='tempest-keypair-1831001595',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e64015226c19441d87f3a6999a3a8db8',ramdisk_id='',reservation_id='r-u9ytaiu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-441311830',owner_user_name='tempest-TaggedBootDevicesTest_v242-441311830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:21:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31d206ed111842fd95ce5eb5b3835a48',uuid=cda43d26-e2f7-4e86-b850-b914957c9b57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ac99ade-56b1-4865-b997-a9f8ef0a760b", "address": "fa:16:3e:b5:b8:ec", "network": {"id": "69cdc817-44c9-4420-acb7-e8aebab58bcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-667852060", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac99ade-56", "ovs_interfaceid": "2ac99ade-56b1-4865-b997-a9f8ef0a760b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Converting VIF {"id": "2ac99ade-56b1-4865-b997-a9f8ef0a760b", "address": "fa:16:3e:b5:b8:ec", "network": {"id": "69cdc817-44c9-4420-acb7-e8aebab58bcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-667852060", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac99ade-56", "ovs_interfaceid": "2ac99ade-56b1-4865-b997-a9f8ef0a760b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:b8:ec,bridge_name='br-int',has_traffic_filtering=True,id=2ac99ade-56b1-4865-b997-a9f8ef0a760b,network=Network(69cdc817-44c9-4420-acb7-e8aebab58bcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2ac99ade-56') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG os_vif [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:b8:ec,bridge_name='br-int',has_traffic_filtering=True,id=2ac99ade-56b1-4865-b997-a9f8ef0a760b,network=Network(69cdc817-44c9-4420-acb7-e8aebab58bcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2ac99ade-56') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ac99ade-56, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2ac99ade-56, col_values=(('external_ids', {'iface-id': '2ac99ade-56b1-4865-b997-a9f8ef0a760b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:b8:ec', 'vm-uuid': 'cda43d26-e2f7-4e86-b850-b914957c9b57'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:14 user nova-compute[71229]: INFO os_vif [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:b8:ec,bridge_name='br-int',has_traffic_filtering=True,id=2ac99ade-56b1-4865-b997-a9f8ef0a760b,network=Network(69cdc817-44c9-4420-acb7-e8aebab58bcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2ac99ade-56')
Apr 11 15:22:14 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T15:21:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1171936509',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1171936509',id=9,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPnuW6ogctwbnKiG/DdSHSi9VgV3vyQxSlprDZSCcAll42WGSndepoNq81o5lA3ENttdnb+uA8SJzEVin1fvRiPZ5AZG/PDhtEvtRNFaLWWnzYWXpsGmE8Y+m9wccFHrw==',key_name='tempest-keypair-1831001595',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e64015226c19441d87f3a6999a3a8db8',ramdisk_id='',reservation_id='r-u9ytaiu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-441311830',owner_user_name='tempest-TaggedBootDevicesTest_v242-441311830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:21:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31d206ed111842fd95ce5eb5b3835a48',uuid=cda43d26-e2f7-4e86-b850-b914957c9b57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "097c3cb1-bc8f-42c3-be49-73d500fdbc39", "address": "fa:16:3e:2b:4b:c2", "network": {"id": "69cdc817-44c9-4420-acb7-e8aebab58bcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-667852060", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap097c3cb1-bc", "ovs_interfaceid": "097c3cb1-bc8f-42c3-be49-73d500fdbc39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Converting VIF {"id": "097c3cb1-bc8f-42c3-be49-73d500fdbc39", "address": "fa:16:3e:2b:4b:c2", "network": {"id": "69cdc817-44c9-4420-acb7-e8aebab58bcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-667852060", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap097c3cb1-bc", "ovs_interfaceid": "097c3cb1-bc8f-42c3-be49-73d500fdbc39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:4b:c2,bridge_name='br-int',has_traffic_filtering=True,id=097c3cb1-bc8f-42c3-be49-73d500fdbc39,network=Network(69cdc817-44c9-4420-acb7-e8aebab58bcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap097c3cb1-bc') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG os_vif [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:4b:c2,bridge_name='br-int',has_traffic_filtering=True,id=097c3cb1-bc8f-42c3-be49-73d500fdbc39,network=Network(69cdc817-44c9-4420-acb7-e8aebab58bcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap097c3cb1-bc') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap097c3cb1-bc, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap097c3cb1-bc, col_values=(('external_ids', {'iface-id': '097c3cb1-bc8f-42c3-be49-73d500fdbc39', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:4b:c2', 'vm-uuid': 'cda43d26-e2f7-4e86-b850-b914957c9b57'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:14 user nova-compute[71229]: INFO os_vif [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:4b:c2,bridge_name='br-int',has_traffic_filtering=True,id=097c3cb1-bc8f-42c3-be49-73d500fdbc39,network=Network(69cdc817-44c9-4420-acb7-e8aebab58bcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap097c3cb1-bc')
Apr 11 15:22:14 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T15:21:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1171936509',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1171936509',id=9,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPnuW6ogctwbnKiG/DdSHSi9VgV3vyQxSlprDZSCcAll42WGSndepoNq81o5lA3ENttdnb+uA8SJzEVin1fvRiPZ5AZG/PDhtEvtRNFaLWWnzYWXpsGmE8Y+m9wccFHrw==',key_name='tempest-keypair-1831001595',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e64015226c19441d87f3a6999a3a8db8',ramdisk_id='',reservation_id='r-u9ytaiu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-441311830',owner_user_name='tempest-TaggedBootDevicesTest_v242-441311830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:21:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31d206ed111842fd95ce5eb5b3835a48',uuid=cda43d26-e2f7-4e86-b850-b914957c9b57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65d1d6cb-a27f-4eae-822e-459770a9a587", "address": "fa:16:3e:02:0d:ff", "network": {"id": "69cdc817-44c9-4420-acb7-e8aebab58bcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-667852060", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d1d6cb-a2", "ovs_interfaceid": "65d1d6cb-a27f-4eae-822e-459770a9a587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Converting VIF {"id": "65d1d6cb-a27f-4eae-822e-459770a9a587", "address": "fa:16:3e:02:0d:ff", "network": {"id": "69cdc817-44c9-4420-acb7-e8aebab58bcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-667852060", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d1d6cb-a2", "ovs_interfaceid": "65d1d6cb-a27f-4eae-822e-459770a9a587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:0d:ff,bridge_name='br-int',has_traffic_filtering=True,id=65d1d6cb-a27f-4eae-822e-459770a9a587,network=Network(69cdc817-44c9-4420-acb7-e8aebab58bcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65d1d6cb-a2') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG os_vif [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:0d:ff,bridge_name='br-int',has_traffic_filtering=True,id=65d1d6cb-a27f-4eae-822e-459770a9a587,network=Network(69cdc817-44c9-4420-acb7-e8aebab58bcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65d1d6cb-a2') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap65d1d6cb-a2, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap65d1d6cb-a2, col_values=(('external_ids', {'iface-id': '65d1d6cb-a27f-4eae-822e-459770a9a587', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:0d:ff', 'vm-uuid': 'cda43d26-e2f7-4e86-b850-b914957c9b57'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:14 user nova-compute[71229]: INFO os_vif [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:0d:ff,bridge_name='br-int',has_traffic_filtering=True,id=65d1d6cb-a27f-4eae-822e-459770a9a587,network=Network(69cdc817-44c9-4420-acb7-e8aebab58bcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65d1d6cb-a2')
Apr 11 15:22:14 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T15:21:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1171936509',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1171936509',id=9,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPnuW6ogctwbnKiG/DdSHSi9VgV3vyQxSlprDZSCcAll42WGSndepoNq81o5lA3ENttdnb+uA8SJzEVin1fvRiPZ5AZG/PDhtEvtRNFaLWWnzYWXpsGmE8Y+m9wccFHrw==',key_name='tempest-keypair-1831001595',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e64015226c19441d87f3a6999a3a8db8',ramdisk_id='',reservation_id='r-u9ytaiu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-441311830',owner_user_name='tempest-TaggedBootDevicesTest_v242-441311830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:21:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31d206ed111842fd95ce5eb5b3835a48',uuid=cda43d26-e2f7-4e86-b850-b914957c9b57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9f2f28e-bb0a-4d1b-a831-e2c493521408", "address": "fa:16:3e:75:c7:7f", "network": {"id": "69cdc817-44c9-4420-acb7-e8aebab58bcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-667852060", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f2f28e-bb", "ovs_interfaceid": "d9f2f28e-bb0a-4d1b-a831-e2c493521408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Converting VIF {"id": "d9f2f28e-bb0a-4d1b-a831-e2c493521408", "address": "fa:16:3e:75:c7:7f", "network": {"id": "69cdc817-44c9-4420-acb7-e8aebab58bcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-667852060", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f2f28e-bb", "ovs_interfaceid": "d9f2f28e-bb0a-4d1b-a831-e2c493521408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:c7:7f,bridge_name='br-int',has_traffic_filtering=True,id=d9f2f28e-bb0a-4d1b-a831-e2c493521408,network=Network(69cdc817-44c9-4420-acb7-e8aebab58bcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9f2f28e-bb') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG os_vif [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:c7:7f,bridge_name='br-int',has_traffic_filtering=True,id=d9f2f28e-bb0a-4d1b-a831-e2c493521408,network=Network(69cdc817-44c9-4420-acb7-e8aebab58bcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9f2f28e-bb') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:22:15 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:22:15 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:15 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9f2f28e-bb, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:22:15 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd9f2f28e-bb, col_values=(('external_ids', {'iface-id': 'd9f2f28e-bb0a-4d1b-a831-e2c493521408', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:c7:7f', 'vm-uuid': 'cda43d26-e2f7-4e86-b850-b914957c9b57'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:22:15 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:15 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:22:15 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:15 user nova-compute[71229]: INFO os_vif [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:c7:7f,bridge_name='br-int',has_traffic_filtering=True,id=d9f2f28e-bb0a-4d1b-a831-e2c493521408,network=Network(69cdc817-44c9-4420-acb7-e8aebab58bcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9f2f28e-bb')
Apr 11 15:22:15 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T15:21:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1171936509',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1171936509',id=9,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPnuW6ogctwbnKiG/DdSHSi9VgV3vyQxSlprDZSCcAll42WGSndepoNq81o5lA3ENttdnb+uA8SJzEVin1fvRiPZ5AZG/PDhtEvtRNFaLWWnzYWXpsGmE8Y+m9wccFHrw==',key_name='tempest-keypair-1831001595',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e64015226c19441d87f3a6999a3a8db8',ramdisk_id='',reservation_id='r-u9ytaiu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-441311830',owner_user_name='tempest-TaggedBootDevicesTest_v242-441311830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:21:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31d206ed111842fd95ce5eb5b3835a48',uuid=cda43d26-e2f7-4e86-b850-b914957c9b57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d794bc3-2136-4b88-92e5-4703eb113b6d", "address": "fa:16:3e:b0:b7:48", "network": {"id": "0065e8ee-5334-4ab3-8c58-6a2e6f9954f2", "bridge": "br-int", "label": "tempest-device-tagging-net2-447570772", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d794bc3-21", "ovs_interfaceid": "6d794bc3-2136-4b88-92e5-4703eb113b6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:22:15 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Converting VIF {"id": "6d794bc3-2136-4b88-92e5-4703eb113b6d", "address": "fa:16:3e:b0:b7:48", "network": {"id": "0065e8ee-5334-4ab3-8c58-6a2e6f9954f2", "bridge": "br-int", "label": "tempest-device-tagging-net2-447570772", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d794bc3-21", "ovs_interfaceid": "6d794bc3-2136-4b88-92e5-4703eb113b6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:22:15 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:b7:48,bridge_name='br-int',has_traffic_filtering=True,id=6d794bc3-2136-4b88-92e5-4703eb113b6d,network=Network(0065e8ee-5334-4ab3-8c58-6a2e6f9954f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d794bc3-21') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:22:15 user nova-compute[71229]: DEBUG os_vif [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:b7:48,bridge_name='br-int',has_traffic_filtering=True,id=6d794bc3-2136-4b88-92e5-4703eb113b6d,network=Network(0065e8ee-5334-4ab3-8c58-6a2e6f9954f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d794bc3-21') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:22:15 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:15 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:22:15 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:22:15 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:15 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d794bc3-21, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:22:15 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6d794bc3-21, col_values=(('external_ids', {'iface-id': '6d794bc3-2136-4b88-92e5-4703eb113b6d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:b7:48', 'vm-uuid': 'cda43d26-e2f7-4e86-b850-b914957c9b57'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:22:15 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:15 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:22:15 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:15 user nova-compute[71229]: INFO os_vif [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:b7:48,bridge_name='br-int',has_traffic_filtering=True,id=6d794bc3-2136-4b88-92e5-4703eb113b6d,network=Network(0065e8ee-5334-4ab3-8c58-6a2e6f9954f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d794bc3-21')
Apr 11 15:22:15 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T15:21:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1171936509',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1171936509',id=9,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPnuW6ogctwbnKiG/DdSHSi9VgV3vyQxSlprDZSCcAll42WGSndepoNq81o5lA3ENttdnb+uA8SJzEVin1fvRiPZ5AZG/PDhtEvtRNFaLWWnzYWXpsGmE8Y+m9wccFHrw==',key_name='tempest-keypair-1831001595',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e64015226c19441d87f3a6999a3a8db8',ramdisk_id='',reservation_id='r-u9ytaiu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-441311830',owner_user_name='tempest-TaggedBootDevicesTest_v242-441311830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:21:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31d206ed111842fd95ce5eb5b3835a48',uuid=cda43d26-e2f7-4e86-b850-b914957c9b57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9f0f991-6f64-45e6-9ce7-3f279f5ce31f", "address": "fa:16:3e:41:d4:9a", "network": {"id": "0065e8ee-5334-4ab3-8c58-6a2e6f9954f2", "bridge": "br-int", "label": "tempest-device-tagging-net2-447570772", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9f0f991-6f", "ovs_interfaceid": "e9f0f991-6f64-45e6-9ce7-3f279f5ce31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:22:15 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Converting VIF {"id": "e9f0f991-6f64-45e6-9ce7-3f279f5ce31f", "address": "fa:16:3e:41:d4:9a", "network": {"id": "0065e8ee-5334-4ab3-8c58-6a2e6f9954f2", "bridge": "br-int", "label": "tempest-device-tagging-net2-447570772", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9f0f991-6f", "ovs_interfaceid": "e9f0f991-6f64-45e6-9ce7-3f279f5ce31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:22:15 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:d4:9a,bridge_name='br-int',has_traffic_filtering=True,id=e9f0f991-6f64-45e6-9ce7-3f279f5ce31f,network=Network(0065e8ee-5334-4ab3-8c58-6a2e6f9954f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9f0f991-6f') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:22:15 user nova-compute[71229]: DEBUG os_vif [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:d4:9a,bridge_name='br-int',has_traffic_filtering=True,id=e9f0f991-6f64-45e6-9ce7-3f279f5ce31f,network=Network(0065e8ee-5334-4ab3-8c58-6a2e6f9954f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9f0f991-6f') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:22:15 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:15 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:22:15 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:22:15 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:15 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9f0f991-6f, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:22:15 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape9f0f991-6f, col_values=(('external_ids', {'iface-id': 'e9f0f991-6f64-45e6-9ce7-3f279f5ce31f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:d4:9a', 'vm-uuid': 'cda43d26-e2f7-4e86-b850-b914957c9b57'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:22:15 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:15 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:22:15 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:15 user nova-compute[71229]: INFO os_vif [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:d4:9a,bridge_name='br-int',has_traffic_filtering=True,id=e9f0f991-6f64-45e6-9ce7-3f279f5ce31f,network=Network(0065e8ee-5334-4ab3-8c58-6a2e6f9954f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9f0f991-6f')
Apr 11 15:22:15 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] No BDM found with device name hda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:22:15 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:22:15 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] No VIF found with MAC fa:16:3e:3b:86:be, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:22:15 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] No VIF found with MAC fa:16:3e:75:c7:7f, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:22:15 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Using config drive
Apr 11 15:22:15 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Creating config drive at /opt/stack/data/nova/instances/cda43d26-e2f7-4e86-b850-b914957c9b57/disk.config
Apr 11 15:22:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/cda43d26-e2f7-4e86-b850-b914957c9b57/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmprg4g4k3c {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/cda43d26-e2f7-4e86-b850-b914957c9b57/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmprg4g4k3c" returned: 0 in 0.052s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:15 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:17 user nova-compute[71229]: DEBUG nova.compute.manager [req-5f52a508-7669-42d5-b244-f50061e3ca77 req-2daa47dc-48a7-4115-8917-7ec7a5a89c44 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received event network-vif-plugged-ee21c1bf-90da-44fe-b6f2-26132b87c5ed {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:22:17 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-5f52a508-7669-42d5-b244-f50061e3ca77 req-2daa47dc-48a7-4115-8917-7ec7a5a89c44 service nova] Acquiring lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:22:17 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-5f52a508-7669-42d5-b244-f50061e3ca77 req-2daa47dc-48a7-4115-8917-7ec7a5a89c44 service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:22:17 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-5f52a508-7669-42d5-b244-f50061e3ca77 req-2daa47dc-48a7-4115-8917-7ec7a5a89c44 service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:22:17 user nova-compute[71229]: DEBUG nova.compute.manager [req-5f52a508-7669-42d5-b244-f50061e3ca77 req-2daa47dc-48a7-4115-8917-7ec7a5a89c44 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] No waiting events found dispatching network-vif-plugged-ee21c1bf-90da-44fe-b6f2-26132b87c5ed {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:22:17 user nova-compute[71229]: WARNING nova.compute.manager [req-5f52a508-7669-42d5-b244-f50061e3ca77 req-2daa47dc-48a7-4115-8917-7ec7a5a89c44 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received unexpected event network-vif-plugged-ee21c1bf-90da-44fe-b6f2-26132b87c5ed for instance with vm_state building and task_state spawning.
Apr 11 15:22:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:17 user nova-compute[71229]: DEBUG nova.compute.manager [req-abc5540f-e627-4ee1-8ade-2f36583391c2 req-de4848f5-0acc-4c98-95f5-6c986dca741c service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received event network-vif-plugged-2ac99ade-56b1-4865-b997-a9f8ef0a760b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:22:17 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-abc5540f-e627-4ee1-8ade-2f36583391c2 req-de4848f5-0acc-4c98-95f5-6c986dca741c service nova] Acquiring lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:22:17 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-abc5540f-e627-4ee1-8ade-2f36583391c2 req-de4848f5-0acc-4c98-95f5-6c986dca741c service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:22:17 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-abc5540f-e627-4ee1-8ade-2f36583391c2 req-de4848f5-0acc-4c98-95f5-6c986dca741c service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:22:17 user nova-compute[71229]: DEBUG nova.compute.manager [req-abc5540f-e627-4ee1-8ade-2f36583391c2 req-de4848f5-0acc-4c98-95f5-6c986dca741c service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] No waiting events found dispatching network-vif-plugged-2ac99ade-56b1-4865-b997-a9f8ef0a760b {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:22:17 user nova-compute[71229]: WARNING nova.compute.manager [req-abc5540f-e627-4ee1-8ade-2f36583391c2 req-de4848f5-0acc-4c98-95f5-6c986dca741c service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received unexpected event network-vif-plugged-2ac99ade-56b1-4865-b997-a9f8ef0a760b for instance with vm_state building and task_state spawning.
Apr 11 15:22:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:18 user nova-compute[71229]: DEBUG nova.compute.manager [req-0939683e-4d77-4056-b4aa-b8b8359ad882 req-b46a5176-1d60-46ec-bcaf-76d97fc0e946 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received event network-vif-plugged-6d794bc3-2136-4b88-92e5-4703eb113b6d {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:22:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-0939683e-4d77-4056-b4aa-b8b8359ad882 req-b46a5176-1d60-46ec-bcaf-76d97fc0e946 service nova] Acquiring lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:22:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-0939683e-4d77-4056-b4aa-b8b8359ad882 req-b46a5176-1d60-46ec-bcaf-76d97fc0e946 service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:22:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-0939683e-4d77-4056-b4aa-b8b8359ad882 req-b46a5176-1d60-46ec-bcaf-76d97fc0e946 service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:22:18 user nova-compute[71229]: DEBUG nova.compute.manager [req-0939683e-4d77-4056-b4aa-b8b8359ad882 req-b46a5176-1d60-46ec-bcaf-76d97fc0e946 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] No waiting events found dispatching network-vif-plugged-6d794bc3-2136-4b88-92e5-4703eb113b6d {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:22:18 user nova-compute[71229]: WARNING nova.compute.manager [req-0939683e-4d77-4056-b4aa-b8b8359ad882 req-b46a5176-1d60-46ec-bcaf-76d97fc0e946 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received unexpected event network-vif-plugged-6d794bc3-2136-4b88-92e5-4703eb113b6d for instance with vm_state building and task_state spawning.
Apr 11 15:22:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:19 user nova-compute[71229]: DEBUG nova.compute.manager [req-132c5552-1ff0-4c0b-8fe3-2b9a5be13aba req-afdc459e-09db-4a84-9e52-b040150291bb service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received event network-vif-plugged-ee21c1bf-90da-44fe-b6f2-26132b87c5ed {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:22:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-132c5552-1ff0-4c0b-8fe3-2b9a5be13aba req-afdc459e-09db-4a84-9e52-b040150291bb service nova] Acquiring lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:22:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-132c5552-1ff0-4c0b-8fe3-2b9a5be13aba req-afdc459e-09db-4a84-9e52-b040150291bb service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:22:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-132c5552-1ff0-4c0b-8fe3-2b9a5be13aba req-afdc459e-09db-4a84-9e52-b040150291bb service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:22:19 user nova-compute[71229]: DEBUG nova.compute.manager [req-132c5552-1ff0-4c0b-8fe3-2b9a5be13aba req-afdc459e-09db-4a84-9e52-b040150291bb service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] No waiting events found dispatching network-vif-plugged-ee21c1bf-90da-44fe-b6f2-26132b87c5ed {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:22:19 user nova-compute[71229]: WARNING nova.compute.manager [req-132c5552-1ff0-4c0b-8fe3-2b9a5be13aba req-afdc459e-09db-4a84-9e52-b040150291bb service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received unexpected event network-vif-plugged-ee21c1bf-90da-44fe-b6f2-26132b87c5ed for instance with vm_state building and task_state spawning.
Apr 11 15:22:19 user nova-compute[71229]: DEBUG nova.compute.manager [req-132c5552-1ff0-4c0b-8fe3-2b9a5be13aba req-afdc459e-09db-4a84-9e52-b040150291bb service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received event network-vif-plugged-097c3cb1-bc8f-42c3-be49-73d500fdbc39 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:22:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-132c5552-1ff0-4c0b-8fe3-2b9a5be13aba req-afdc459e-09db-4a84-9e52-b040150291bb service nova] Acquiring lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:22:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-132c5552-1ff0-4c0b-8fe3-2b9a5be13aba req-afdc459e-09db-4a84-9e52-b040150291bb service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:22:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-132c5552-1ff0-4c0b-8fe3-2b9a5be13aba req-afdc459e-09db-4a84-9e52-b040150291bb service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:22:19 user nova-compute[71229]: DEBUG nova.compute.manager [req-132c5552-1ff0-4c0b-8fe3-2b9a5be13aba req-afdc459e-09db-4a84-9e52-b040150291bb service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] No waiting events found dispatching network-vif-plugged-097c3cb1-bc8f-42c3-be49-73d500fdbc39 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:22:19 user nova-compute[71229]: WARNING nova.compute.manager [req-132c5552-1ff0-4c0b-8fe3-2b9a5be13aba req-afdc459e-09db-4a84-9e52-b040150291bb service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received unexpected event network-vif-plugged-097c3cb1-bc8f-42c3-be49-73d500fdbc39 for instance with vm_state building and task_state spawning.
Apr 11 15:22:19 user nova-compute[71229]: DEBUG nova.compute.manager [req-132c5552-1ff0-4c0b-8fe3-2b9a5be13aba req-afdc459e-09db-4a84-9e52-b040150291bb service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received event network-vif-plugged-097c3cb1-bc8f-42c3-be49-73d500fdbc39 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:22:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-132c5552-1ff0-4c0b-8fe3-2b9a5be13aba req-afdc459e-09db-4a84-9e52-b040150291bb service nova] Acquiring lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:22:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-132c5552-1ff0-4c0b-8fe3-2b9a5be13aba req-afdc459e-09db-4a84-9e52-b040150291bb service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:22:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-132c5552-1ff0-4c0b-8fe3-2b9a5be13aba req-afdc459e-09db-4a84-9e52-b040150291bb service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:22:19 user nova-compute[71229]: DEBUG nova.compute.manager [req-132c5552-1ff0-4c0b-8fe3-2b9a5be13aba req-afdc459e-09db-4a84-9e52-b040150291bb service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] No waiting events found dispatching network-vif-plugged-097c3cb1-bc8f-42c3-be49-73d500fdbc39 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:22:19 user nova-compute[71229]: WARNING nova.compute.manager [req-132c5552-1ff0-4c0b-8fe3-2b9a5be13aba req-afdc459e-09db-4a84-9e52-b040150291bb service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received unexpected event network-vif-plugged-097c3cb1-bc8f-42c3-be49-73d500fdbc39 for instance with vm_state building and task_state spawning.
Apr 11 15:22:19 user nova-compute[71229]: DEBUG nova.compute.manager [req-132c5552-1ff0-4c0b-8fe3-2b9a5be13aba req-afdc459e-09db-4a84-9e52-b040150291bb service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received event network-vif-plugged-d9f2f28e-bb0a-4d1b-a831-e2c493521408 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:22:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-132c5552-1ff0-4c0b-8fe3-2b9a5be13aba req-afdc459e-09db-4a84-9e52-b040150291bb service nova] Acquiring lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:22:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-132c5552-1ff0-4c0b-8fe3-2b9a5be13aba req-afdc459e-09db-4a84-9e52-b040150291bb service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:22:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-132c5552-1ff0-4c0b-8fe3-2b9a5be13aba req-afdc459e-09db-4a84-9e52-b040150291bb service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:22:19 user nova-compute[71229]: DEBUG nova.compute.manager [req-132c5552-1ff0-4c0b-8fe3-2b9a5be13aba req-afdc459e-09db-4a84-9e52-b040150291bb service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] No waiting events found dispatching network-vif-plugged-d9f2f28e-bb0a-4d1b-a831-e2c493521408 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:22:19 user nova-compute[71229]: WARNING nova.compute.manager [req-132c5552-1ff0-4c0b-8fe3-2b9a5be13aba req-afdc459e-09db-4a84-9e52-b040150291bb service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received unexpected event network-vif-plugged-d9f2f28e-bb0a-4d1b-a831-e2c493521408 for instance with vm_state building and task_state spawning.
Apr 11 15:22:19 user nova-compute[71229]: DEBUG nova.compute.manager [req-132c5552-1ff0-4c0b-8fe3-2b9a5be13aba req-afdc459e-09db-4a84-9e52-b040150291bb service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received event network-vif-plugged-d9f2f28e-bb0a-4d1b-a831-e2c493521408 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:22:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-132c5552-1ff0-4c0b-8fe3-2b9a5be13aba req-afdc459e-09db-4a84-9e52-b040150291bb service nova] Acquiring lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:22:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-132c5552-1ff0-4c0b-8fe3-2b9a5be13aba req-afdc459e-09db-4a84-9e52-b040150291bb service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:22:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-132c5552-1ff0-4c0b-8fe3-2b9a5be13aba req-afdc459e-09db-4a84-9e52-b040150291bb service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:22:19 user nova-compute[71229]: DEBUG nova.compute.manager [req-132c5552-1ff0-4c0b-8fe3-2b9a5be13aba req-afdc459e-09db-4a84-9e52-b040150291bb service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] No waiting events found dispatching network-vif-plugged-d9f2f28e-bb0a-4d1b-a831-e2c493521408 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:22:19 user nova-compute[71229]: WARNING nova.compute.manager [req-132c5552-1ff0-4c0b-8fe3-2b9a5be13aba req-afdc459e-09db-4a84-9e52-b040150291bb service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received unexpected event network-vif-plugged-d9f2f28e-bb0a-4d1b-a831-e2c493521408 for instance with vm_state building and task_state spawning.
Apr 11 15:22:19 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:19 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:19 user nova-compute[71229]: DEBUG nova.compute.manager [req-2b222a61-820b-47eb-acda-42e940e0f1fc req-b77c2cf9-1321-4c4b-89c2-5750e6792d55 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received event network-vif-plugged-2ac99ade-56b1-4865-b997-a9f8ef0a760b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:22:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2b222a61-820b-47eb-acda-42e940e0f1fc req-b77c2cf9-1321-4c4b-89c2-5750e6792d55 service nova] Acquiring lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:22:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2b222a61-820b-47eb-acda-42e940e0f1fc req-b77c2cf9-1321-4c4b-89c2-5750e6792d55 service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:22:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2b222a61-820b-47eb-acda-42e940e0f1fc req-b77c2cf9-1321-4c4b-89c2-5750e6792d55 service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:22:19 user nova-compute[71229]: DEBUG nova.compute.manager [req-2b222a61-820b-47eb-acda-42e940e0f1fc req-b77c2cf9-1321-4c4b-89c2-5750e6792d55 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] No waiting events found dispatching network-vif-plugged-2ac99ade-56b1-4865-b997-a9f8ef0a760b {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:22:19 user nova-compute[71229]: WARNING nova.compute.manager [req-2b222a61-820b-47eb-acda-42e940e0f1fc req-b77c2cf9-1321-4c4b-89c2-5750e6792d55 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received unexpected event network-vif-plugged-2ac99ade-56b1-4865-b997-a9f8ef0a760b for instance with vm_state building and task_state spawning.
Apr 11 15:22:19 user nova-compute[71229]: DEBUG nova.compute.manager [req-2b222a61-820b-47eb-acda-42e940e0f1fc req-b77c2cf9-1321-4c4b-89c2-5750e6792d55 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received event network-vif-plugged-65d1d6cb-a27f-4eae-822e-459770a9a587 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:22:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2b222a61-820b-47eb-acda-42e940e0f1fc req-b77c2cf9-1321-4c4b-89c2-5750e6792d55 service nova] Acquiring lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:22:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2b222a61-820b-47eb-acda-42e940e0f1fc req-b77c2cf9-1321-4c4b-89c2-5750e6792d55 service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:22:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2b222a61-820b-47eb-acda-42e940e0f1fc req-b77c2cf9-1321-4c4b-89c2-5750e6792d55 service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:22:19 user nova-compute[71229]: DEBUG nova.compute.manager [req-2b222a61-820b-47eb-acda-42e940e0f1fc req-b77c2cf9-1321-4c4b-89c2-5750e6792d55 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] No waiting events found dispatching network-vif-plugged-65d1d6cb-a27f-4eae-822e-459770a9a587 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:22:19 user nova-compute[71229]: WARNING nova.compute.manager [req-2b222a61-820b-47eb-acda-42e940e0f1fc req-b77c2cf9-1321-4c4b-89c2-5750e6792d55 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received unexpected event network-vif-plugged-65d1d6cb-a27f-4eae-822e-459770a9a587 for instance with vm_state building and task_state spawning.
Apr 11 15:22:19 user nova-compute[71229]: DEBUG nova.compute.manager [req-2b222a61-820b-47eb-acda-42e940e0f1fc req-b77c2cf9-1321-4c4b-89c2-5750e6792d55 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received event network-vif-plugged-65d1d6cb-a27f-4eae-822e-459770a9a587 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:22:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2b222a61-820b-47eb-acda-42e940e0f1fc req-b77c2cf9-1321-4c4b-89c2-5750e6792d55 service nova] Acquiring lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:22:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2b222a61-820b-47eb-acda-42e940e0f1fc req-b77c2cf9-1321-4c4b-89c2-5750e6792d55 service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:22:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2b222a61-820b-47eb-acda-42e940e0f1fc req-b77c2cf9-1321-4c4b-89c2-5750e6792d55 service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:22:19 user nova-compute[71229]: DEBUG nova.compute.manager [req-2b222a61-820b-47eb-acda-42e940e0f1fc req-b77c2cf9-1321-4c4b-89c2-5750e6792d55 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] No waiting events found dispatching network-vif-plugged-65d1d6cb-a27f-4eae-822e-459770a9a587 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:22:19 user nova-compute[71229]: WARNING nova.compute.manager [req-2b222a61-820b-47eb-acda-42e940e0f1fc req-b77c2cf9-1321-4c4b-89c2-5750e6792d55 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received unexpected event network-vif-plugged-65d1d6cb-a27f-4eae-822e-459770a9a587 for instance with vm_state building and task_state spawning.
Apr 11 15:22:19 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:19 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:19 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:20 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:20 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:20 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:20 user nova-compute[71229]: DEBUG nova.compute.manager [req-3f21a548-d9d8-498d-9a25-c1816084d65d req-11193f1d-4ffc-4dea-b91f-f17ebc8a2d9a service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received event network-vif-plugged-6d794bc3-2136-4b88-92e5-4703eb113b6d {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:22:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3f21a548-d9d8-498d-9a25-c1816084d65d req-11193f1d-4ffc-4dea-b91f-f17ebc8a2d9a service nova] Acquiring lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:22:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3f21a548-d9d8-498d-9a25-c1816084d65d req-11193f1d-4ffc-4dea-b91f-f17ebc8a2d9a service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:22:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3f21a548-d9d8-498d-9a25-c1816084d65d req-11193f1d-4ffc-4dea-b91f-f17ebc8a2d9a service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:22:20 user nova-compute[71229]: DEBUG nova.compute.manager [req-3f21a548-d9d8-498d-9a25-c1816084d65d req-11193f1d-4ffc-4dea-b91f-f17ebc8a2d9a service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] No waiting events found dispatching network-vif-plugged-6d794bc3-2136-4b88-92e5-4703eb113b6d {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:22:20 user nova-compute[71229]: WARNING nova.compute.manager [req-3f21a548-d9d8-498d-9a25-c1816084d65d req-11193f1d-4ffc-4dea-b91f-f17ebc8a2d9a service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received unexpected event network-vif-plugged-6d794bc3-2136-4b88-92e5-4703eb113b6d for instance with vm_state building and task_state spawning.
Apr 11 15:22:20 user nova-compute[71229]: DEBUG nova.compute.manager [req-3f21a548-d9d8-498d-9a25-c1816084d65d req-11193f1d-4ffc-4dea-b91f-f17ebc8a2d9a service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received event network-vif-plugged-e9f0f991-6f64-45e6-9ce7-3f279f5ce31f {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:22:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3f21a548-d9d8-498d-9a25-c1816084d65d req-11193f1d-4ffc-4dea-b91f-f17ebc8a2d9a service nova] Acquiring lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:22:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3f21a548-d9d8-498d-9a25-c1816084d65d req-11193f1d-4ffc-4dea-b91f-f17ebc8a2d9a service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:22:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3f21a548-d9d8-498d-9a25-c1816084d65d req-11193f1d-4ffc-4dea-b91f-f17ebc8a2d9a service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:22:20 user nova-compute[71229]: DEBUG nova.compute.manager [req-3f21a548-d9d8-498d-9a25-c1816084d65d req-11193f1d-4ffc-4dea-b91f-f17ebc8a2d9a service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] No waiting events found dispatching network-vif-plugged-e9f0f991-6f64-45e6-9ce7-3f279f5ce31f {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:22:20 user nova-compute[71229]: WARNING nova.compute.manager [req-3f21a548-d9d8-498d-9a25-c1816084d65d req-11193f1d-4ffc-4dea-b91f-f17ebc8a2d9a service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received unexpected event network-vif-plugged-e9f0f991-6f64-45e6-9ce7-3f279f5ce31f for instance with vm_state building and task_state spawning.
Apr 11 15:22:20 user nova-compute[71229]: DEBUG nova.compute.manager [req-3f21a548-d9d8-498d-9a25-c1816084d65d req-11193f1d-4ffc-4dea-b91f-f17ebc8a2d9a service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received event network-vif-plugged-e9f0f991-6f64-45e6-9ce7-3f279f5ce31f {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:22:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3f21a548-d9d8-498d-9a25-c1816084d65d req-11193f1d-4ffc-4dea-b91f-f17ebc8a2d9a service nova] Acquiring lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:22:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3f21a548-d9d8-498d-9a25-c1816084d65d req-11193f1d-4ffc-4dea-b91f-f17ebc8a2d9a service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:22:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3f21a548-d9d8-498d-9a25-c1816084d65d req-11193f1d-4ffc-4dea-b91f-f17ebc8a2d9a service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:22:20 user nova-compute[71229]: DEBUG nova.compute.manager [req-3f21a548-d9d8-498d-9a25-c1816084d65d req-11193f1d-4ffc-4dea-b91f-f17ebc8a2d9a service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] No waiting events found dispatching network-vif-plugged-e9f0f991-6f64-45e6-9ce7-3f279f5ce31f {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:22:20 user nova-compute[71229]: WARNING nova.compute.manager [req-3f21a548-d9d8-498d-9a25-c1816084d65d req-11193f1d-4ffc-4dea-b91f-f17ebc8a2d9a service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received unexpected event network-vif-plugged-e9f0f991-6f64-45e6-9ce7-3f279f5ce31f for instance with vm_state building and task_state spawning.
Apr 11 15:22:21 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681226541.0015166, cda43d26-e2f7-4e86-b850-b914957c9b57 => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:22:21 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] VM Resumed (Lifecycle Event)
Apr 11 15:22:21 user nova-compute[71229]: DEBUG nova.compute.manager [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 15:22:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Guest created on hypervisor {{(pid=71229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 15:22:21 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Instance spawned successfully.
Apr 11 15:22:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 15:22:21 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:22:21 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:22:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Found default for hw_cdrom_bus of ide {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:22:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Found default for hw_disk_bus of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:22:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Found default for hw_input_bus of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:22:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Found default for hw_pointer_model of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:22:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Found default for hw_video_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:22:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Found default for hw_vif_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:22:21 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:22:21 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681226541.0022075, cda43d26-e2f7-4e86-b850-b914957c9b57 => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:22:21 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] VM Started (Lifecycle Event)
Apr 11 15:22:21 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:22:21 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:22:21 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:22:21 user nova-compute[71229]: INFO nova.compute.manager [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Took 10.39 seconds to spawn the instance on the hypervisor.
Apr 11 15:22:21 user nova-compute[71229]: DEBUG nova.compute.manager [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:22:21 user nova-compute[71229]: INFO nova.compute.manager [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Took 27.63 seconds to build instance.
Apr 11 15:22:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3ce4e010-8b3a-4f51-8343-51043a50a96a tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.807s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:22:21 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:35 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:40 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:45 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:46 user nova-compute[71229]: DEBUG nova.compute.manager [None req-801039d5-7103-4778-bd15-2a440ea59524 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:22:46 user nova-compute[71229]: INFO nova.compute.manager [None req-801039d5-7103-4778-bd15-2a440ea59524 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] instance snapshotting
Apr 11 15:22:46 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-801039d5-7103-4778-bd15-2a440ea59524 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Beginning live snapshot process
Apr 11 15:22:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-801039d5-7103-4778-bd15-2a440ea59524 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json -f qcow2 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-801039d5-7103-4778-bd15-2a440ea59524 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json -f qcow2" returned: 0 in 0.155s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-801039d5-7103-4778-bd15-2a440ea59524 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json -f qcow2 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-801039d5-7103-4778-bd15-2a440ea59524 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json -f qcow2" returned: 0 in 0.140s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-801039d5-7103-4778-bd15-2a440ea59524 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-801039d5-7103-4778-bd15-2a440ea59524 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.137s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-801039d5-7103-4778-bd15-2a440ea59524 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphwfyoq_s/06df1519a8294c5e89892a4e07f26539.delta 1073741824 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-801039d5-7103-4778-bd15-2a440ea59524 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphwfyoq_s/06df1519a8294c5e89892a4e07f26539.delta 1073741824" returned: 0 in 0.060s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:47 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-801039d5-7103-4778-bd15-2a440ea59524 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 11 15:22:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-801039d5-7103-4778-bd15-2a440ea59524 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Checking UEFI support for host arch (x86_64) {{(pid=71229) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1722}}
Apr 11 15:22:47 user nova-compute[71229]: INFO nova.virt.libvirt.host [None req-801039d5-7103-4778-bd15-2a440ea59524 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] UEFI support detected
Apr 11 15:22:48 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-801039d5-7103-4778-bd15-2a440ea59524 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71229) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 15:22:48 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-801039d5-7103-4778-bd15-2a440ea59524 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71229) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 15:22:48 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-801039d5-7103-4778-bd15-2a440ea59524 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 11 15:22:48 user nova-compute[71229]: DEBUG nova.privsep.utils [None req-801039d5-7103-4778-bd15-2a440ea59524 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71229) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 15:22:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-801039d5-7103-4778-bd15-2a440ea59524 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphwfyoq_s/06df1519a8294c5e89892a4e07f26539.delta /opt/stack/data/nova/instances/snapshots/tmphwfyoq_s/06df1519a8294c5e89892a4e07f26539 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-801039d5-7103-4778-bd15-2a440ea59524 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphwfyoq_s/06df1519a8294c5e89892a4e07f26539.delta /opt/stack/data/nova/instances/snapshots/tmphwfyoq_s/06df1519a8294c5e89892a4e07f26539" returned: 0 in 0.326s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:49 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-801039d5-7103-4778-bd15-2a440ea59524 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Snapshot extracted, beginning image upload
Apr 11 15:22:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Acquiring lock "074896e5-8065-4b4a-b61a-653bc67718db" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:22:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "074896e5-8065-4b4a-b61a-653bc67718db" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:22:49 user nova-compute[71229]: DEBUG nova.objects.instance [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lazy-loading 'flavor' on Instance uuid 074896e5-8065-4b4a-b61a-653bc67718db {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:22:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "074896e5-8065-4b4a-b61a-653bc67718db" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:22:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Acquiring lock "074896e5-8065-4b4a-b61a-653bc67718db" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:22:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "074896e5-8065-4b4a-b61a-653bc67718db" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:22:49 user nova-compute[71229]: INFO nova.compute.manager [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Attaching volume aef9b013-1588-4f60-9f42-59ac8ed9c42a to /dev/vdb
Apr 11 15:22:49 user nova-compute[71229]: DEBUG os_brick.utils [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:22:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:49 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee44d87-b96c-4629-8ec4-7e2f070cb0d9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d55e24a97c90\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:49 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7387650f-00e5-4fd7-9a7b-c5cc65b7cea7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:49 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a13409e-a822-42c2-b4fd-1bc9f1325bbf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:49 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[702689b9-707c-4b63-ab15-8abdaf44b9af]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Running cmd (subprocess): nvme version {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] 'nvme version' failed. Not Retrying. {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:22:49 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] nvme not present on system {{(pid=71229) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 15:22:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:22:49 user nova-compute[71229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 15:22:49 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa4a254-29d2-4388-b0f0-e620364b3da1]: (4, '') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:49 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71229) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 15:22:49 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 15:22:49 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] LIGHTOS: no hostnqn found. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 15:22:49 user nova-compute[71229]: DEBUG os_brick.utils [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d55e24a97c90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:22:50 user nova-compute[71229]: DEBUG nova.virt.block_device [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Updating existing volume attachment record: c672baf9-b02a-4295-be90-e8663aa549a0 {{(pid=71229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 15:22:50 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:51 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:51 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-801039d5-7103-4778-bd15-2a440ea59524 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Snapshot image upload complete
Apr 11 15:22:51 user nova-compute[71229]: INFO nova.compute.manager [None req-801039d5-7103-4778-bd15-2a440ea59524 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Took 4.85 seconds to snapshot the instance on the hypervisor.
Apr 11 15:22:53 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "refresh_cache-074896e5-8065-4b4a-b61a-653bc67718db" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquired lock "refresh_cache-074896e5-8065-4b4a-b61a-653bc67718db" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Forcefully refreshing network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aef9b013-1588-4f60-9f42-59ac8ed9c42a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LedGbvro', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:22:54 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:22:54 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:22:54 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:22:54 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aef9b013-1588-4f60-9f42-59ac8ed9c42a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aef9b013-1588-4f60-9f42-59ac8ed9c42a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:22:54 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 15:22:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aef9b013-1588-4f60-9f42-59ac8ed9c42a -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aef9b013-1588-4f60-9f42-59ac8ed9c42a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a61998-f9e1-499f-822a-8e50064e6236]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 15:22:54 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aef9b013-1588-4f60-9f42-59ac8ed9c42a -p 172.16.0.220:3260 --interface default --op new {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aef9b013-1588-4f60-9f42-59ac8ed9c42a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9c4d55-68f9-40ef-ba8d-908a05d11d32]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aef9b013-1588-4f60-9f42-59ac8ed9c42a] added\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aef9b013-1588-4f60-9f42-59ac8ed9c42a] added
Apr 11 15:22:54 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aef9b013-1588-4f60-9f42-59ac8ed9c42a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aef9b013-1588-4f60-9f42-59ac8ed9c42a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1176e11f-d9e9-450f-bc84-e50be730bcea]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aef9b013-1588-4f60-9f42-59ac8ed9c42a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aef9b013-1588-4f60-9f42-59ac8ed9c42a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf6d570-03e3-4582-94ea-0c3bedaee53c]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aef9b013-1588-4f60-9f42-59ac8ed9c42a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LedGbvro {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aef9b013-1588-4f60-9f42-59ac8ed9c42a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LedGbvro" returned: 0 in 0.074s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[800cf0e2-6b46-40f2-9707-ff8704a7e560]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LedGbvro'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aef9b013-1588-4f60-9f42-59ac8ed9c42a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aef9b013-1588-4f60-9f42-59ac8ed9c42a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84ac886-cbf4-4183-a998-0734b278e7d8]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c318f0f0-793f-4a62-8db2-b0ba65d734b1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)
Apr 11 15:22:54 user nova-compute[71229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)
Apr 11 15:22:54 user nova-compute[71229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)
Apr 11 15:22:54 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)
Apr 11 15:22:54 user nova-compute[71229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)
Apr 11 15:22:54 user nova-compute[71229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)
Apr 11 15:22:54 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aef9b013-1588-4f60-9f42-59ac8ed9c42a -p 172.16.0.220:3260 --login {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aef9b013-1588-4f60-9f42-59ac8ed9c42a -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[363e412d-8347-4544-9c02-55e07b913629]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aef9b013-1588-4f60-9f42-59ac8ed9c42a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aef9b013-1588-4f60-9f42-59ac8ed9c42a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aef9b013-1588-4f60-9f42-59ac8ed9c42a, portal: 172.16.0.220,3260]
Apr 11 15:22:54 user nova-compute[71229]: Login to [iface: default, target: iqn.2010-10.org.openstack:aef9b013-1588-4f60-9f42-59ac8ed9c42a, portal: 172.16.0.220,3260] successful.
Apr 11 15:22:54 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aef9b013-1588-4f60-9f42-59ac8ed9c42a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aef9b013-1588-4f60-9f42-59ac8ed9c42a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[84989aa8-bb1a-477d-a6d3-d379d1b2449c]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc620501-0a1e-4367-92dd-771350477b9e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aef9b013-1588-4f60-9f42-59ac8ed9c42a (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)
Apr 11 15:22:54 user nova-compute[71229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)
Apr 11 15:22:54 user nova-compute[71229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)
Apr 11 15:22:54 user nova-compute[71229]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aef9b013-1588-4f60-9f42-59ac8ed9c42a (non-flash)
Apr 11 15:22:54 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)
Apr 11 15:22:54 user nova-compute[71229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)
Apr 11 15:22:54 user nova-compute[71229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)
Apr 11 15:22:54 user nova-compute[71229]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aef9b013-1588-4f60-9f42-59ac8ed9c42a (non-flash)
Apr 11 15:22:54 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aef9b013-1588-4f60-9f42-59ac8ed9c42a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.028s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d99821-be4d-43b7-bbc6-f533dc9b7d52]: (4, ('- - 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:aef9b013-1588-4f60-9f42-59ac8ed9c42a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LedGbvro', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Updating instance_info_cache with network_info: [{"id": "b0a1c8e2-240f-45dc-bfcc-24902144caf8", "address": "fa:16:3e:9d:aa:23", "network": {"id": "7c5ce6d1-32c2-4fd9-a28f-234811470f19", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2073264016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc574e5ba43d43029c450e4fa80ac501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0a1c8e2-24", "ovs_interfaceid": "b0a1c8e2-240f-45dc-bfcc-24902144caf8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Releasing lock "refresh_cache-074896e5-8065-4b4a-b61a-653bc67718db" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Updated the network info_cache for instance {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 15:22:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:55 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/074896e5-8065-4b4a-b61a-653bc67718db/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/074896e5-8065-4b4a-b61a-653bc67718db/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/074896e5-8065-4b4a-b61a-653bc67718db/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/074896e5-8065-4b4a-b61a-653bc67718db/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b1dedd0-ae18-421b-b83a-a7b2c22c65d5/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:55 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.430s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:22:55 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] <== connect_volume: return (1433ms) {'type': 'block', 'scsi_wwn': '23861373130663565', 'path': '/dev/sde'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:22:55 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861373130663565', 'path': '/dev/sde'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 15:22:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b1dedd0-ae18-421b-b83a-a7b2c22c65d5/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b1dedd0-ae18-421b-b83a-a7b2c22c65d5/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:55 user nova-compute[71229]: DEBUG nova.objects.instance [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lazy-loading 'flavor' on Instance uuid 074896e5-8065-4b4a-b61a-653bc67718db {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:22:55 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 15:22:55 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:22:55 user nova-compute[71229]:   <source dev="/dev/sde"/>
Apr 11 15:22:55 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 15:22:55 user nova-compute[71229]:   <serial>aef9b013-1588-4f60-9f42-59ac8ed9c42a</serial>
Apr 11 15:22:55 user nova-compute[71229]: </disk>
Apr 11 15:22:55 user nova-compute[71229]:  {{(pid=71229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 15:22:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b1dedd0-ae18-421b-b83a-a7b2c22c65d5/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d84862f-b710-48b1-9275-93fc799cf1f9/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d84862f-b710-48b1-9275-93fc799cf1f9/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d84862f-b710-48b1-9275-93fc799cf1f9/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d84862f-b710-48b1-9275-93fc799cf1f9/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2c294d-49b2-41bf-89d0-17a560e7741f/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2c294d-49b2-41bf-89d0-17a560e7741f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2c294d-49b2-41bf-89d0-17a560e7741f/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:56 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:22:56 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:22:56 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] No VIF found with MAC fa:16:3e:9d:aa:23, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:22:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2c294d-49b2-41bf-89d0-17a560e7741f/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:56 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-9999cb89-17cd-4d9b-bc12-5524195af545 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "074896e5-8065-4b4a-b61a-653bc67718db" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.670s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:22:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a06747-0f43-4731-87e6-40629c382a6b/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a06747-0f43-4731-87e6-40629c382a6b/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a06747-0f43-4731-87e6-40629c382a6b/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:56 user nova-compute[71229]: DEBUG nova.compute.manager [req-07f23c31-602b-4ae6-8c2b-98ae2e1c456e req-bcedfa2a-6291-4b49-abb7-7ddf541733a9 service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Received event network-changed-d8c64197-b034-4f38-821d-ba030f1fca6b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:22:56 user nova-compute[71229]: DEBUG nova.compute.manager [req-07f23c31-602b-4ae6-8c2b-98ae2e1c456e req-bcedfa2a-6291-4b49-abb7-7ddf541733a9 service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Refreshing instance network info cache due to event network-changed-d8c64197-b034-4f38-821d-ba030f1fca6b. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:22:56 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-07f23c31-602b-4ae6-8c2b-98ae2e1c456e req-bcedfa2a-6291-4b49-abb7-7ddf541733a9 service nova] Acquiring lock "refresh_cache-6a805345-374c-4326-9e8f-39bfc7947a35" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:22:56 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-07f23c31-602b-4ae6-8c2b-98ae2e1c456e req-bcedfa2a-6291-4b49-abb7-7ddf541733a9 service nova] Acquired lock "refresh_cache-6a805345-374c-4326-9e8f-39bfc7947a35" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:22:56 user nova-compute[71229]: DEBUG nova.network.neutron [req-07f23c31-602b-4ae6-8c2b-98ae2e1c456e req-bcedfa2a-6291-4b49-abb7-7ddf541733a9 service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Refreshing network info cache for port d8c64197-b034-4f38-821d-ba030f1fca6b {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:22:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a06747-0f43-4731-87e6-40629c382a6b/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:56 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:22:56 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:22:56 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:22:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bd4e3ea-2df2-48f8-96bd-8f8219c73bea/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bd4e3ea-2df2-48f8-96bd-8f8219c73bea/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bd4e3ea-2df2-48f8-96bd-8f8219c73bea/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bd4e3ea-2df2-48f8-96bd-8f8219c73bea/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:57 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:22:57 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:22:57 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=7917MB free_disk=26.33306121826172GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 15:22:57 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:22:57 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:22:57 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Acquiring lock "074896e5-8065-4b4a-b61a-653bc67718db" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:22:57 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "074896e5-8065-4b4a-b61a-653bc67718db" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:22:57 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Acquiring lock "074896e5-8065-4b4a-b61a-653bc67718db-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:22:57 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "074896e5-8065-4b4a-b61a-653bc67718db-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:22:57 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "074896e5-8065-4b4a-b61a-653bc67718db-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:22:57 user nova-compute[71229]: INFO nova.compute.manager [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Terminating instance
Apr 11 15:22:57 user nova-compute[71229]: DEBUG nova.compute.manager [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Start destroying the instance on the hypervisor. {{(pid=71229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 15:22:57 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:57 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:57 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance de1a45fd-27be-4438-80a4-2f3a100643c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:22:57 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 074896e5-8065-4b4a-b61a-653bc67718db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:22:57 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 6a805345-374c-4326-9e8f-39bfc7947a35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:22:57 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:22:57 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 8d84862f-b710-48b1-9275-93fc799cf1f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:22:57 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance f3a06747-0f43-4731-87e6-40629c382a6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:22:57 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 2b2c294d-49b2-41bf-89d0-17a560e7741f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:22:57 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:22:57 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance cda43d26-e2f7-4e86-b850-b914957c9b57 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:22:57 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 15:22:57 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 15:22:57 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:57 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:57 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:57 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Refreshing inventories for resource provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG nova.network.neutron [req-07f23c31-602b-4ae6-8c2b-98ae2e1c456e req-bcedfa2a-6291-4b49-abb7-7ddf541733a9 service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Updated VIF entry in instance network info cache for port d8c64197-b034-4f38-821d-ba030f1fca6b. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG nova.network.neutron [req-07f23c31-602b-4ae6-8c2b-98ae2e1c456e req-bcedfa2a-6291-4b49-abb7-7ddf541733a9 service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Updating instance_info_cache with network_info: [{"id": "d8c64197-b034-4f38-821d-ba030f1fca6b", "address": "fa:16:3e:0f:f8:cb", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c64197-b0", "ovs_interfaceid": "d8c64197-b034-4f38-821d-ba030f1fca6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Updating ProviderTree inventory for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Updating inventory in ProviderTree for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-07f23c31-602b-4ae6-8c2b-98ae2e1c456e req-bcedfa2a-6291-4b49-abb7-7ddf541733a9 service nova] Releasing lock "refresh_cache-6a805345-374c-4326-9e8f-39bfc7947a35" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Refreshing aggregate associations for resource provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de, aggregates: None {{(pid=71229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG nova.compute.manager [req-c19c202e-8f1f-4831-99c0-4552be2993a7 req-39075bf4-cea3-479c-af92-6a828d6187a9 service nova] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Received event network-vif-unplugged-b0a1c8e2-240f-45dc-bfcc-24902144caf8 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c19c202e-8f1f-4831-99c0-4552be2993a7 req-39075bf4-cea3-479c-af92-6a828d6187a9 service nova] Acquiring lock "074896e5-8065-4b4a-b61a-653bc67718db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c19c202e-8f1f-4831-99c0-4552be2993a7 req-39075bf4-cea3-479c-af92-6a828d6187a9 service nova] Lock "074896e5-8065-4b4a-b61a-653bc67718db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c19c202e-8f1f-4831-99c0-4552be2993a7 req-39075bf4-cea3-479c-af92-6a828d6187a9 service nova] Lock "074896e5-8065-4b4a-b61a-653bc67718db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG nova.compute.manager [req-c19c202e-8f1f-4831-99c0-4552be2993a7 req-39075bf4-cea3-479c-af92-6a828d6187a9 service nova] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] No waiting events found dispatching network-vif-unplugged-b0a1c8e2-240f-45dc-bfcc-24902144caf8 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG nova.compute.manager [req-c19c202e-8f1f-4831-99c0-4552be2993a7 req-39075bf4-cea3-479c-af92-6a828d6187a9 service nova] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Received event network-vif-unplugged-b0a1c8e2-240f-45dc-bfcc-24902144caf8 for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Refreshing trait associations for resource provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de, traits: COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=71229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.614s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:58 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Instance destroyed successfully.
Apr 11 15:22:58 user nova-compute[71229]: DEBUG nova.objects.instance [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lazy-loading 'resources' on Instance uuid 074896e5-8065-4b4a-b61a-653bc67718db {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:20:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1908410251',display_name='tempest-DeleteServersTestJSON-server-1908410251',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1908410251',id=2,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:21:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc574e5ba43d43029c450e4fa80ac501',ramdisk_id='',reservation_id='r-0hyoaswl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-738772639',owner_user_name='tempest-DeleteServersTestJSON-738772639-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:21:10Z,user_data=None,user_id='6b62270e2c254a888625c7e4491adf05',uuid=074896e5-8065-4b4a-b61a-653bc67718db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b0a1c8e2-240f-45dc-bfcc-24902144caf8", "address": "fa:16:3e:9d:aa:23", "network": {"id": "7c5ce6d1-32c2-4fd9-a28f-234811470f19", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2073264016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc574e5ba43d43029c450e4fa80ac501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0a1c8e2-24", "ovs_interfaceid": "b0a1c8e2-240f-45dc-bfcc-24902144caf8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Converting VIF {"id": "b0a1c8e2-240f-45dc-bfcc-24902144caf8", "address": "fa:16:3e:9d:aa:23", "network": {"id": "7c5ce6d1-32c2-4fd9-a28f-234811470f19", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2073264016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc574e5ba43d43029c450e4fa80ac501", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0a1c8e2-24", "ovs_interfaceid": "b0a1c8e2-240f-45dc-bfcc-24902144caf8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:aa:23,bridge_name='br-int',has_traffic_filtering=True,id=b0a1c8e2-240f-45dc-bfcc-24902144caf8,network=Network(7c5ce6d1-32c2-4fd9-a28f-234811470f19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0a1c8e2-24') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG os_vif [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:aa:23,bridge_name='br-int',has_traffic_filtering=True,id=b0a1c8e2-240f-45dc-bfcc-24902144caf8,network=Network(7c5ce6d1-32c2-4fd9-a28f-234811470f19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0a1c8e2-24') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb0a1c8e2-24, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:22:58 user nova-compute[71229]: INFO os_vif [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:aa:23,bridge_name='br-int',has_traffic_filtering=True,id=b0a1c8e2-240f-45dc-bfcc-24902144caf8,network=Network(7c5ce6d1-32c2-4fd9-a28f-234811470f19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0a1c8e2-24')
Apr 11 15:22:58 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:aef9b013-1588-4f60-9f42-59ac8ed9c42a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LedGbvro', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:22:58 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:22:58 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b442d853-21fe-4de1-b82e-7e857655e136]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aef9b013-1588-4f60-9f42-59ac8ed9c42a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 15:22:58 user nova-compute[71229]: No targets found.
Apr 11 15:22:58 user nova-compute[71229]: iSNS:
Apr 11 15:22:58 user nova-compute[71229]: No targets found.
Apr 11 15:22:58 user nova-compute[71229]: STATIC:
Apr 11 15:22:58 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d
Apr 11 15:22:58 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:22:58 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:22:58 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:aef9b013-1588-4f60-9f42-59ac8ed9c42a
Apr 11 15:22:58 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:22:58 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:22:58 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487
Apr 11 15:22:58 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:22:58 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:22:58 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c
Apr 11 15:22:58 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:22:58 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:22:58 user nova-compute[71229]: FIRMWARE:
Apr 11 15:22:58 user nova-compute[71229]: No targets found.
Apr 11 15:22:58 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 15:22:58 user nova-compute[71229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 15:22:58 user nova-compute[71229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71229) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aef9b013-1588-4f60-9f42-59ac8ed9c42a', 0)] {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[27300516-3c63-40bb-9bdf-878e37e697c4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aef9b013-1588-4f60-9f42-59ac8ed9c42a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a564f42b-d9fb-4501-b57c-f5b47f1ba217]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aef9b013-1588-4f60-9f42-59ac8ed9c42a (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)
Apr 11 15:22:58 user nova-compute[71229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)
Apr 11 15:22:58 user nova-compute[71229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)
Apr 11 15:22:58 user nova-compute[71229]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aef9b013-1588-4f60-9f42-59ac8ed9c42a (non-flash)
Apr 11 15:22:58 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)
Apr 11 15:22:58 user nova-compute[71229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)
Apr 11 15:22:58 user nova-compute[71229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)
Apr 11 15:22:58 user nova-compute[71229]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aef9b013-1588-4f60-9f42-59ac8ed9c42a (non-flash)
Apr 11 15:22:58 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb5c3aa440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aef9b013-1588-4f60-9f42-59ac8ed9c42a'): ({'sde'}, set())}) {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Removing single pathed devices sde {{(pid=71229) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0ec4df-2c7a-4cdf-93b2-fe3bc958c1c1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2721a4ef-5b82-4fe7-8ce0-5cc6b54d19b7]: (4, ('ok\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Flushing IO for device /dev/sde {{(pid=71229) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec404a57-9f0d-4f12-b301-2965a0d8b85a]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71229) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.054s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fac9f62-eacd-4fed-8de4-14e8ed455dbd]: (4, ('1', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] SCSI volumes sde have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aef9b013-1588-4f60-9f42-59ac8ed9c42a')] {{(pid=71229) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aef9b013-1588-4f60-9f42-59ac8ed9c42a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aef9b013-1588-4f60-9f42-59ac8ed9c42a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[096269b7-3456-4418-868a-e5941942732d]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:22:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aef9b013-1588-4f60-9f42-59ac8ed9c42a -p 172.16.0.220:3260 --logout {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aef9b013-1588-4f60-9f42-59ac8ed9c42a -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:59 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ed39d7-f524-41d6-bc20-bc27f95fc2e5]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:aef9b013-1588-4f60-9f42-59ac8ed9c42a, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:aef9b013-1588-4f60-9f42-59ac8ed9c42a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:aef9b013-1588-4f60-9f42-59ac8ed9c42a, portal: 172.16.0.220,3260]
Apr 11 15:22:59 user nova-compute[71229]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:aef9b013-1588-4f60-9f42-59ac8ed9c42a, portal: 172.16.0.220,3260] successful.
Apr 11 15:22:59 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:22:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aef9b013-1588-4f60-9f42-59ac8ed9c42a -p 172.16.0.220:3260 --op delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:22:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aef9b013-1588-4f60-9f42-59ac8ed9c42a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:22:59 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[428a6259-7b63-4600-87a5-6a2c8c8e0497]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:22:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:22:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:22:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] <== disconnect_volume: return (307ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:22:59 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 15:22:59 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Deleting instance files /opt/stack/data/nova/instances/074896e5-8065-4b4a-b61a-653bc67718db_del
Apr 11 15:22:59 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Deletion of /opt/stack/data/nova/instances/074896e5-8065-4b4a-b61a-653bc67718db_del complete
Apr 11 15:22:59 user nova-compute[71229]: INFO nova.compute.manager [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Took 1.28 seconds to destroy the instance on the hypervisor.
Apr 11 15:22:59 user nova-compute[71229]: DEBUG oslo.service.loopingcall [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71229) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 15:22:59 user nova-compute[71229]: DEBUG nova.compute.manager [-] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Deallocating network for instance {{(pid=71229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 15:22:59 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] deallocate_for_instance() {{(pid=71229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 15:22:59 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:22:59 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Took 0.76 seconds to deallocate network for instance.
Apr 11 15:22:59 user nova-compute[71229]: DEBUG nova.compute.manager [req-f0edf0fb-e1e4-468a-bc89-96ec28b9ca07 req-5de72873-c3cb-42d4-8995-21d99839fb09 service nova] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Received event network-vif-deleted-b0a1c8e2-240f-45dc-bfcc-24902144caf8 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:22:59 user nova-compute[71229]: INFO nova.compute.manager [req-f0edf0fb-e1e4-468a-bc89-96ec28b9ca07 req-5de72873-c3cb-42d4-8995-21d99839fb09 service nova] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Neutron deleted interface b0a1c8e2-240f-45dc-bfcc-24902144caf8; detaching it from the instance and deleting it from the info cache
Apr 11 15:22:59 user nova-compute[71229]: DEBUG nova.network.neutron [req-f0edf0fb-e1e4-468a-bc89-96ec28b9ca07 req-5de72873-c3cb-42d4-8995-21d99839fb09 service nova] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:22:59 user nova-compute[71229]: DEBUG nova.compute.manager [req-f0edf0fb-e1e4-468a-bc89-96ec28b9ca07 req-5de72873-c3cb-42d4-8995-21d99839fb09 service nova] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Detach interface failed, port_id=b0a1c8e2-240f-45dc-bfcc-24902144caf8, reason: Instance 074896e5-8065-4b4a-b61a-653bc67718db could not be found. {{(pid=71229) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 15:23:00 user nova-compute[71229]: DEBUG nova.compute.manager [req-a29f4e44-911f-4afe-8435-7371584fe81e req-51070967-ac1c-4d16-8657-8798cae55272 service nova] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Received event network-vif-plugged-b0a1c8e2-240f-45dc-bfcc-24902144caf8 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:23:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a29f4e44-911f-4afe-8435-7371584fe81e req-51070967-ac1c-4d16-8657-8798cae55272 service nova] Acquiring lock "074896e5-8065-4b4a-b61a-653bc67718db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a29f4e44-911f-4afe-8435-7371584fe81e req-51070967-ac1c-4d16-8657-8798cae55272 service nova] Lock "074896e5-8065-4b4a-b61a-653bc67718db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a29f4e44-911f-4afe-8435-7371584fe81e req-51070967-ac1c-4d16-8657-8798cae55272 service nova] Lock "074896e5-8065-4b4a-b61a-653bc67718db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:23:00 user nova-compute[71229]: DEBUG nova.compute.manager [req-a29f4e44-911f-4afe-8435-7371584fe81e req-51070967-ac1c-4d16-8657-8798cae55272 service nova] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] No waiting events found dispatching network-vif-plugged-b0a1c8e2-240f-45dc-bfcc-24902144caf8 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:23:00 user nova-compute[71229]: WARNING nova.compute.manager [req-a29f4e44-911f-4afe-8435-7371584fe81e req-51070967-ac1c-4d16-8657-8798cae55272 service nova] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Received unexpected event network-vif-plugged-b0a1c8e2-240f-45dc-bfcc-24902144caf8 for instance with vm_state active and task_state deleting.
Apr 11 15:23:00 user nova-compute[71229]: INFO nova.compute.manager [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Took 0.76 seconds to detach 1 volumes for instance.
Apr 11 15:23:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:00 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:23:00 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:23:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.298s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:23:01 user nova-compute[71229]: INFO nova.scheduler.client.report [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Deleted allocations for instance 074896e5-8065-4b4a-b61a-653bc67718db
Apr 11 15:23:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-2de9f6e9-97cf-4cda-8f1a-34ef8e147559 tempest-DeleteServersTestJSON-738772639 tempest-DeleteServersTestJSON-738772639-project-member] Lock "074896e5-8065-4b4a-b61a-653bc67718db" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.305s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:23:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:03 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-a14f5ed4-67f9-4561-9e14-c1945e240bea tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Acquiring lock "4b1dedd0-ae18-421b-b83a-a7b2c22c65d5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-a14f5ed4-67f9-4561-9e14-c1945e240bea tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "4b1dedd0-ae18-421b-b83a-a7b2c22c65d5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-a14f5ed4-67f9-4561-9e14-c1945e240bea tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Acquiring lock "4b1dedd0-ae18-421b-b83a-a7b2c22c65d5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-a14f5ed4-67f9-4561-9e14-c1945e240bea tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "4b1dedd0-ae18-421b-b83a-a7b2c22c65d5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-a14f5ed4-67f9-4561-9e14-c1945e240bea tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "4b1dedd0-ae18-421b-b83a-a7b2c22c65d5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:23:06 user nova-compute[71229]: INFO nova.compute.manager [None req-a14f5ed4-67f9-4561-9e14-c1945e240bea tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Terminating instance
Apr 11 15:23:06 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a14f5ed4-67f9-4561-9e14-c1945e240bea tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Start destroying the instance on the hypervisor. {{(pid=71229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 15:23:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:06 user nova-compute[71229]: DEBUG nova.compute.manager [req-f111dffd-3c34-4f2b-b0a3-038d07e22bd6 req-2f9387f0-4ad4-472b-9c42-3c3c9a9cd9c8 service nova] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Received event network-vif-unplugged-e92694db-c1b5-4366-bf78-1f6340cab2fe {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:23:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-f111dffd-3c34-4f2b-b0a3-038d07e22bd6 req-2f9387f0-4ad4-472b-9c42-3c3c9a9cd9c8 service nova] Acquiring lock "4b1dedd0-ae18-421b-b83a-a7b2c22c65d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-f111dffd-3c34-4f2b-b0a3-038d07e22bd6 req-2f9387f0-4ad4-472b-9c42-3c3c9a9cd9c8 service nova] Lock "4b1dedd0-ae18-421b-b83a-a7b2c22c65d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-f111dffd-3c34-4f2b-b0a3-038d07e22bd6 req-2f9387f0-4ad4-472b-9c42-3c3c9a9cd9c8 service nova] Lock "4b1dedd0-ae18-421b-b83a-a7b2c22c65d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:23:06 user nova-compute[71229]: DEBUG nova.compute.manager [req-f111dffd-3c34-4f2b-b0a3-038d07e22bd6 req-2f9387f0-4ad4-472b-9c42-3c3c9a9cd9c8 service nova] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] No waiting events found dispatching network-vif-unplugged-e92694db-c1b5-4366-bf78-1f6340cab2fe {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:23:06 user nova-compute[71229]: DEBUG nova.compute.manager [req-f111dffd-3c34-4f2b-b0a3-038d07e22bd6 req-2f9387f0-4ad4-472b-9c42-3c3c9a9cd9c8 service nova] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Received event network-vif-unplugged-e92694db-c1b5-4366-bf78-1f6340cab2fe for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 15:23:06 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Instance destroyed successfully.
Apr 11 15:23:06 user nova-compute[71229]: DEBUG nova.objects.instance [None req-a14f5ed4-67f9-4561-9e14-c1945e240bea tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lazy-loading 'resources' on Instance uuid 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:23:06 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-a14f5ed4-67f9-4561-9e14-c1945e240bea tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:21:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-934769884',display_name='tempest-VolumesActionsTest-instance-934769884',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-934769884',id=4,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:21:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b4a341ccfc0b4f08bb2e97083143dd40',ramdisk_id='',reservation_id='r-aldf7xge',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1278032672',owner_user_name='tempest-VolumesActionsTest-1278032672-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:21:26Z,user_data=None,user_id='acc44d2042554ca0b0bde4b2de5b566a',uuid=4b1dedd0-ae18-421b-b83a-a7b2c22c65d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e92694db-c1b5-4366-bf78-1f6340cab2fe", "address": "fa:16:3e:08:c1:ec", "network": {"id": "5b9dc948-4f8b-460a-bc87-04cf194f5c08", "bridge": "br-int", "label": "tempest-VolumesActionsTest-712454576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b4a341ccfc0b4f08bb2e97083143dd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape92694db-c1", "ovs_interfaceid": "e92694db-c1b5-4366-bf78-1f6340cab2fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:23:06 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-a14f5ed4-67f9-4561-9e14-c1945e240bea tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Converting VIF {"id": "e92694db-c1b5-4366-bf78-1f6340cab2fe", "address": "fa:16:3e:08:c1:ec", "network": {"id": "5b9dc948-4f8b-460a-bc87-04cf194f5c08", "bridge": "br-int", "label": "tempest-VolumesActionsTest-712454576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b4a341ccfc0b4f08bb2e97083143dd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape92694db-c1", "ovs_interfaceid": "e92694db-c1b5-4366-bf78-1f6340cab2fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:23:06 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-a14f5ed4-67f9-4561-9e14-c1945e240bea tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:c1:ec,bridge_name='br-int',has_traffic_filtering=True,id=e92694db-c1b5-4366-bf78-1f6340cab2fe,network=Network(5b9dc948-4f8b-460a-bc87-04cf194f5c08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape92694db-c1') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:23:06 user nova-compute[71229]: DEBUG os_vif [None req-a14f5ed4-67f9-4561-9e14-c1945e240bea tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:c1:ec,bridge_name='br-int',has_traffic_filtering=True,id=e92694db-c1b5-4366-bf78-1f6340cab2fe,network=Network(5b9dc948-4f8b-460a-bc87-04cf194f5c08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape92694db-c1') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:23:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape92694db-c1, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:23:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:23:06 user nova-compute[71229]: INFO os_vif [None req-a14f5ed4-67f9-4561-9e14-c1945e240bea tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:c1:ec,bridge_name='br-int',has_traffic_filtering=True,id=e92694db-c1b5-4366-bf78-1f6340cab2fe,network=Network(5b9dc948-4f8b-460a-bc87-04cf194f5c08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape92694db-c1')
Apr 11 15:23:06 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-a14f5ed4-67f9-4561-9e14-c1945e240bea tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Deleting instance files /opt/stack/data/nova/instances/4b1dedd0-ae18-421b-b83a-a7b2c22c65d5_del
Apr 11 15:23:06 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-a14f5ed4-67f9-4561-9e14-c1945e240bea tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Deletion of /opt/stack/data/nova/instances/4b1dedd0-ae18-421b-b83a-a7b2c22c65d5_del complete
Apr 11 15:23:06 user nova-compute[71229]: INFO nova.compute.manager [None req-a14f5ed4-67f9-4561-9e14-c1945e240bea tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Took 0.72 seconds to destroy the instance on the hypervisor.
Apr 11 15:23:06 user nova-compute[71229]: DEBUG oslo.service.loopingcall [None req-a14f5ed4-67f9-4561-9e14-c1945e240bea tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71229) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 15:23:06 user nova-compute[71229]: DEBUG nova.compute.manager [-] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Deallocating network for instance {{(pid=71229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 15:23:06 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] deallocate_for_instance() {{(pid=71229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 15:23:07 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:23:07 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Took 0.49 seconds to deallocate network for instance.
Apr 11 15:23:07 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-a14f5ed4-67f9-4561-9e14-c1945e240bea tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:07 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-a14f5ed4-67f9-4561-9e14-c1945e240bea tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:07 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-a14f5ed4-67f9-4561-9e14-c1945e240bea tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:23:07 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-a14f5ed4-67f9-4561-9e14-c1945e240bea tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:23:07 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-a14f5ed4-67f9-4561-9e14-c1945e240bea tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.271s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:23:07 user nova-compute[71229]: INFO nova.scheduler.client.report [None req-a14f5ed4-67f9-4561-9e14-c1945e240bea tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Deleted allocations for instance 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5
Apr 11 15:23:07 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-a14f5ed4-67f9-4561-9e14-c1945e240bea tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "4b1dedd0-ae18-421b-b83a-a7b2c22c65d5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.677s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:23:08 user nova-compute[71229]: DEBUG nova.compute.manager [req-82f02e7f-63c4-4d5b-bb2c-62e6e6ca342b req-90506a1f-0071-4caa-996f-6b2548f6e77e service nova] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Received event network-vif-plugged-e92694db-c1b5-4366-bf78-1f6340cab2fe {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:23:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-82f02e7f-63c4-4d5b-bb2c-62e6e6ca342b req-90506a1f-0071-4caa-996f-6b2548f6e77e service nova] Acquiring lock "4b1dedd0-ae18-421b-b83a-a7b2c22c65d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-82f02e7f-63c4-4d5b-bb2c-62e6e6ca342b req-90506a1f-0071-4caa-996f-6b2548f6e77e service nova] Lock "4b1dedd0-ae18-421b-b83a-a7b2c22c65d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-82f02e7f-63c4-4d5b-bb2c-62e6e6ca342b req-90506a1f-0071-4caa-996f-6b2548f6e77e service nova] Lock "4b1dedd0-ae18-421b-b83a-a7b2c22c65d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:23:08 user nova-compute[71229]: DEBUG nova.compute.manager [req-82f02e7f-63c4-4d5b-bb2c-62e6e6ca342b req-90506a1f-0071-4caa-996f-6b2548f6e77e service nova] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] No waiting events found dispatching network-vif-plugged-e92694db-c1b5-4366-bf78-1f6340cab2fe {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:23:08 user nova-compute[71229]: WARNING nova.compute.manager [req-82f02e7f-63c4-4d5b-bb2c-62e6e6ca342b req-90506a1f-0071-4caa-996f-6b2548f6e77e service nova] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Received unexpected event network-vif-plugged-e92694db-c1b5-4366-bf78-1f6340cab2fe for instance with vm_state deleted and task_state None.
Apr 11 15:23:08 user nova-compute[71229]: DEBUG nova.compute.manager [req-82f02e7f-63c4-4d5b-bb2c-62e6e6ca342b req-90506a1f-0071-4caa-996f-6b2548f6e77e service nova] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Received event network-vif-deleted-e92694db-c1b5-4366-bf78-1f6340cab2fe {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:23:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:13 user nova-compute[71229]: DEBUG nova.compute.manager [req-da79c7db-e943-4380-9111-ecbc41030b06 req-072c97af-5fe6-4d2b-8489-de5afb31252e service nova] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Received event network-changed-bcba48c0-9931-4249-925c-57cb387499d1 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:23:13 user nova-compute[71229]: DEBUG nova.compute.manager [req-da79c7db-e943-4380-9111-ecbc41030b06 req-072c97af-5fe6-4d2b-8489-de5afb31252e service nova] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Refreshing instance network info cache due to event network-changed-bcba48c0-9931-4249-925c-57cb387499d1. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:23:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-da79c7db-e943-4380-9111-ecbc41030b06 req-072c97af-5fe6-4d2b-8489-de5afb31252e service nova] Acquiring lock "refresh_cache-8d84862f-b710-48b1-9275-93fc799cf1f9" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:23:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-da79c7db-e943-4380-9111-ecbc41030b06 req-072c97af-5fe6-4d2b-8489-de5afb31252e service nova] Acquired lock "refresh_cache-8d84862f-b710-48b1-9275-93fc799cf1f9" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:23:13 user nova-compute[71229]: DEBUG nova.network.neutron [req-da79c7db-e943-4380-9111-ecbc41030b06 req-072c97af-5fe6-4d2b-8489-de5afb31252e service nova] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Refreshing network info cache for port bcba48c0-9931-4249-925c-57cb387499d1 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:23:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Acquiring lock "8d84862f-b710-48b1-9275-93fc799cf1f9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "8d84862f-b710-48b1-9275-93fc799cf1f9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:13 user nova-compute[71229]: DEBUG nova.objects.instance [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lazy-loading 'flavor' on Instance uuid 8d84862f-b710-48b1-9275-93fc799cf1f9 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:23:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "8d84862f-b710-48b1-9275-93fc799cf1f9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:23:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Acquiring lock "8d84862f-b710-48b1-9275-93fc799cf1f9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "8d84862f-b710-48b1-9275-93fc799cf1f9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:13 user nova-compute[71229]: INFO nova.compute.manager [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Attaching volume 761a1221-3eec-47f9-8a05-9eb545bede26 to /dev/vdb
Apr 11 15:23:13 user nova-compute[71229]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681226578.5987208, 074896e5-8065-4b4a-b61a-653bc67718db => Stopped> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:23:13 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] VM Stopped (Lifecycle Event)
Apr 11 15:23:13 user nova-compute[71229]: DEBUG os_brick.utils [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:23:13 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:13 user nova-compute[71229]: DEBUG nova.compute.manager [None req-db67efa4-457b-4a65-9420-d8caefb12b74 None None] [instance: 074896e5-8065-4b4a-b61a-653bc67718db] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:23:13 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:13 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db4af4d-0204-4075-9971-f661e8d2b284]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d55e24a97c90\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:13 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:13 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.038s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:13 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d753b708-eb70-4b52-b68e-125e97bf5a0b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:13 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:13 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:13 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d83f27-4d64-49f6-bdfa-5bb52a9023d8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:13 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b85205-6407-4498-aecb-afb76e41eb22]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:13 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Running cmd (subprocess): nvme version {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:13 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] 'nvme version' failed. Not Retrying. {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:23:13 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] nvme not present on system {{(pid=71229) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 15:23:13 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:13 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:23:13 user nova-compute[71229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 15:23:13 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0743563f-74b9-4f05-8566-2de08856ae01]: (4, '') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:13 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71229) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 15:23:13 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 15:23:13 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] LIGHTOS: no hostnqn found. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 15:23:13 user nova-compute[71229]: DEBUG os_brick.utils [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d55e24a97c90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:23:13 user nova-compute[71229]: DEBUG nova.virt.block_device [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Updating existing volume attachment record: 0b07e044-deaa-43fc-bfe7-6638b85227cc {{(pid=71229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 15:23:13 user nova-compute[71229]: DEBUG nova.network.neutron [req-da79c7db-e943-4380-9111-ecbc41030b06 req-072c97af-5fe6-4d2b-8489-de5afb31252e service nova] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Updated VIF entry in instance network info cache for port bcba48c0-9931-4249-925c-57cb387499d1. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:23:13 user nova-compute[71229]: DEBUG nova.network.neutron [req-da79c7db-e943-4380-9111-ecbc41030b06 req-072c97af-5fe6-4d2b-8489-de5afb31252e service nova] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Updating instance_info_cache with network_info: [{"id": "bcba48c0-9931-4249-925c-57cb387499d1", "address": "fa:16:3e:99:2a:86", "network": {"id": "d861c3b4-c929-43bb-83c3-e746f8119831", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2114528813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c88bf2782342c8af04195140d6cd0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcba48c0-99", "ovs_interfaceid": "bcba48c0-9931-4249-925c-57cb387499d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:23:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-da79c7db-e943-4380-9111-ecbc41030b06 req-072c97af-5fe6-4d2b-8489-de5afb31252e service nova] Releasing lock "refresh_cache-8d84862f-b710-48b1-9275-93fc799cf1f9" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:23:14 user nova-compute[71229]: DEBUG nova.compute.manager [req-63f50f52-8939-463c-aeaf-04d3ba064ddf req-bf233dc4-af22-4f93-86d2-76351bd8ea70 service nova] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Received event network-changed-a7049f98-5ea1-4167-be7f-3206830f17c4 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:23:14 user nova-compute[71229]: DEBUG nova.compute.manager [req-63f50f52-8939-463c-aeaf-04d3ba064ddf req-bf233dc4-af22-4f93-86d2-76351bd8ea70 service nova] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Refreshing instance network info cache due to event network-changed-a7049f98-5ea1-4167-be7f-3206830f17c4. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:23:14 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-63f50f52-8939-463c-aeaf-04d3ba064ddf req-bf233dc4-af22-4f93-86d2-76351bd8ea70 service nova] Acquiring lock "refresh_cache-f3a06747-0f43-4731-87e6-40629c382a6b" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:23:14 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-63f50f52-8939-463c-aeaf-04d3ba064ddf req-bf233dc4-af22-4f93-86d2-76351bd8ea70 service nova] Acquired lock "refresh_cache-f3a06747-0f43-4731-87e6-40629c382a6b" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:23:14 user nova-compute[71229]: DEBUG nova.network.neutron [req-63f50f52-8939-463c-aeaf-04d3ba064ddf req-bf233dc4-af22-4f93-86d2-76351bd8ea70 service nova] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Refreshing network info cache for port a7049f98-5ea1-4167-be7f-3206830f17c4 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:23:14 user nova-compute[71229]: DEBUG nova.network.neutron [req-63f50f52-8939-463c-aeaf-04d3ba064ddf req-bf233dc4-af22-4f93-86d2-76351bd8ea70 service nova] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Updated VIF entry in instance network info cache for port a7049f98-5ea1-4167-be7f-3206830f17c4. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:23:14 user nova-compute[71229]: DEBUG nova.network.neutron [req-63f50f52-8939-463c-aeaf-04d3ba064ddf req-bf233dc4-af22-4f93-86d2-76351bd8ea70 service nova] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Updating instance_info_cache with network_info: [{"id": "a7049f98-5ea1-4167-be7f-3206830f17c4", "address": "fa:16:3e:74:02:c7", "network": {"id": "f52bd4a9-1843-408b-85af-c2124ad01be7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-593462205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da140971126a4d298ff718275e7a22ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7049f98-5e", "ovs_interfaceid": "a7049f98-5ea1-4167-be7f-3206830f17c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:23:14 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-63f50f52-8939-463c-aeaf-04d3ba064ddf req-bf233dc4-af22-4f93-86d2-76351bd8ea70 service nova] Releasing lock "refresh_cache-f3a06747-0f43-4731-87e6-40629c382a6b" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:23:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "f3a06747-0f43-4731-87e6-40629c382a6b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "f3a06747-0f43-4731-87e6-40629c382a6b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:15 user nova-compute[71229]: DEBUG nova.objects.instance [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lazy-loading 'flavor' on Instance uuid f3a06747-0f43-4731-87e6-40629c382a6b {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:23:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "f3a06747-0f43-4731-87e6-40629c382a6b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:23:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "f3a06747-0f43-4731-87e6-40629c382a6b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "f3a06747-0f43-4731-87e6-40629c382a6b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:16 user nova-compute[71229]: INFO nova.compute.manager [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Attaching volume 63216764-be19-490d-a6be-b93ad54a8762 to /dev/vdb
Apr 11 15:23:16 user nova-compute[71229]: DEBUG os_brick.utils [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:23:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:16 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cab29b0-3391-440d-af3e-61fc4a25a323]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d55e24a97c90\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:16 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ccbc0e-1464-42ef-8539-6ae25e19d560]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:16 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cff5ba7-6d6e-4774-9a0a-dd20cfb7dd05]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:16 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f876ab17-864d-4797-9420-075a2cbc5e5d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Running cmd (subprocess): nvme version {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] 'nvme version' failed. Not Retrying. {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:23:16 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] nvme not present on system {{(pid=71229) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 15:23:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:23:16 user nova-compute[71229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 15:23:16 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cac3920-7fa4-4b92-9165-9f8ecd00e241]: (4, '') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:16 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71229) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 15:23:16 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 15:23:16 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] LIGHTOS: no hostnqn found. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 15:23:16 user nova-compute[71229]: DEBUG os_brick.utils [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d55e24a97c90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:23:16 user nova-compute[71229]: DEBUG nova.virt.block_device [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Updating existing volume attachment record: d55e62fd-a52a-4da2-87af-9e00de431fd5 {{(pid=71229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 15:23:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tKFecpPZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:23:18 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:23:18 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:23:18 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:23:18 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:23:18 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 15:23:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4028df42-8d46-4c5c-a276-2d9bf6d4c88f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 15:23:18 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 -p 172.16.0.220:3260 --interface default --op new {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e58b6fd-da84-45ec-8e0f-dcc8206dd032]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26] added\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26] added
Apr 11 15:23:18 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0edb2451-e3b5-4862-87d4-93e944e3bf69]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4c9211-9c1c-4c62-91f5-71afdb23fde5]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tKFecpPZ {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tKFecpPZ" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2238cf2-c871-4566-9e07-11737592d073]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tKFecpPZ'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[33582c3e-fae7-4264-bb10-68014c4c4f60]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4adc66-a07c-4184-a6fa-6bb2013b56e3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)
Apr 11 15:23:18 user nova-compute[71229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)
Apr 11 15:23:18 user nova-compute[71229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)
Apr 11 15:23:18 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)
Apr 11 15:23:18 user nova-compute[71229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)
Apr 11 15:23:18 user nova-compute[71229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)
Apr 11 15:23:18 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 -p 172.16.0.220:3260 --login {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3c248f-d1d3-4c0f-b2d7-706b2dc4a186]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26, portal: 172.16.0.220,3260]
Apr 11 15:23:18 user nova-compute[71229]: Login to [iface: default, target: iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26, portal: 172.16.0.220,3260] successful.
Apr 11 15:23:18 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a968c0-ae42-4de9-8e2b-761a1ed9a4e8]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e40e962-8377-4697-80f9-a2cda42017a8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)
Apr 11 15:23:18 user nova-compute[71229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)
Apr 11 15:23:18 user nova-compute[71229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)
Apr 11 15:23:18 user nova-compute[71229]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 (non-flash)
Apr 11 15:23:18 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)
Apr 11 15:23:18 user nova-compute[71229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)
Apr 11 15:23:18 user nova-compute[71229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)
Apr 11 15:23:18 user nova-compute[71229]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 (non-flash)
Apr 11 15:23:18 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] HCTL ('36', '-', '-', 0) found on session 7 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e438a9-01c8-4a1c-a3ae-2e4409ecf751]: (4, ('- - 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:18 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Searching for a device in session 7 and hctl ['36', '*', '*', 0] yield: None {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:23:19 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Searching for a device in session 7 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:23:19 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tKFecpPZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 15:23:19 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:23:19 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23234623061393439', 'path': '/dev/sde'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:23:19 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234623061393439', 'path': '/dev/sde'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 15:23:19 user nova-compute[71229]: DEBUG nova.objects.instance [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lazy-loading 'flavor' on Instance uuid 8d84862f-b710-48b1-9275-93fc799cf1f9 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:23:19 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 15:23:19 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:23:19 user nova-compute[71229]:   <source dev="/dev/sde"/>
Apr 11 15:23:19 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 15:23:19 user nova-compute[71229]:   <serial>761a1221-3eec-47f9-8a05-9eb545bede26</serial>
Apr 11 15:23:19 user nova-compute[71229]: </disk>
Apr 11 15:23:19 user nova-compute[71229]:  {{(pid=71229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 15:23:19 user nova-compute[71229]: DEBUG nova.compute.manager [req-c58df0a4-2531-44df-929f-0c983e087e5f req-009da4e0-6574-4f22-8a98-bdbdc2caaa74 service nova] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Received event network-changed-41b19aaa-a4cf-494a-97e9-c3a081d24d80 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:23:19 user nova-compute[71229]: DEBUG nova.compute.manager [req-c58df0a4-2531-44df-929f-0c983e087e5f req-009da4e0-6574-4f22-8a98-bdbdc2caaa74 service nova] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Refreshing instance network info cache due to event network-changed-41b19aaa-a4cf-494a-97e9-c3a081d24d80. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:23:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c58df0a4-2531-44df-929f-0c983e087e5f req-009da4e0-6574-4f22-8a98-bdbdc2caaa74 service nova] Acquiring lock "refresh_cache-2b2c294d-49b2-41bf-89d0-17a560e7741f" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:23:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c58df0a4-2531-44df-929f-0c983e087e5f req-009da4e0-6574-4f22-8a98-bdbdc2caaa74 service nova] Acquired lock "refresh_cache-2b2c294d-49b2-41bf-89d0-17a560e7741f" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:23:19 user nova-compute[71229]: DEBUG nova.network.neutron [req-c58df0a4-2531-44df-929f-0c983e087e5f req-009da4e0-6574-4f22-8a98-bdbdc2caaa74 service nova] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Refreshing network info cache for port 41b19aaa-a4cf-494a-97e9-c3a081d24d80 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:23:19 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:23:19 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:23:19 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] No VIF found with MAC fa:16:3e:99:2a:86, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-bf3601bf-8e8e-4634-9315-fa57d8b0f9e9 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "8d84862f-b710-48b1-9275-93fc799cf1f9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.431s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:63216764-be19-490d-a6be-b93ad54a8762', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hBedKUIZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:23:20 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:23:20 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:23:20 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:23:20 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63216764-be19-490d-a6be-b93ad54a8762" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63216764-be19-490d-a6be-b93ad54a8762" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:23:20 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 15:23:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63216764-be19-490d-a6be-b93ad54a8762 -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG nova.network.neutron [req-c58df0a4-2531-44df-929f-0c983e087e5f req-009da4e0-6574-4f22-8a98-bdbdc2caaa74 service nova] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Updated VIF entry in instance network info cache for port 41b19aaa-a4cf-494a-97e9-c3a081d24d80. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG nova.network.neutron [req-c58df0a4-2531-44df-929f-0c983e087e5f req-009da4e0-6574-4f22-8a98-bdbdc2caaa74 service nova] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Updating instance_info_cache with network_info: [{"id": "41b19aaa-a4cf-494a-97e9-c3a081d24d80", "address": "fa:16:3e:ce:80:c4", "network": {"id": "5709c284-0131-449d-869b-bfcf88bbe239", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-578269461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e67f7203b1849c0af305f88ad8284f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41b19aaa-a4", "ovs_interfaceid": "41b19aaa-a4cf-494a-97e9-c3a081d24d80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63216764-be19-490d-a6be-b93ad54a8762 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c692e65f-de33-49ee-9fec-d406847dfbc5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 15:23:20 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c58df0a4-2531-44df-929f-0c983e087e5f req-009da4e0-6574-4f22-8a98-bdbdc2caaa74 service nova] Releasing lock "refresh_cache-2b2c294d-49b2-41bf-89d0-17a560e7741f" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63216764-be19-490d-a6be-b93ad54a8762 -p 172.16.0.220:3260 --interface default --op new {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63216764-be19-490d-a6be-b93ad54a8762 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed506dc-5965-4937-9f58-4a12a858f81d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63216764-be19-490d-a6be-b93ad54a8762] added\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63216764-be19-490d-a6be-b93ad54a8762] added
Apr 11 15:23:20 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63216764-be19-490d-a6be-b93ad54a8762 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63216764-be19-490d-a6be-b93ad54a8762 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97e4a88-50b6-4074-a0ff-1ce2aa27c878]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63216764-be19-490d-a6be-b93ad54a8762 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63216764-be19-490d-a6be-b93ad54a8762 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ba2ae3-5cde-4160-9ee5-c71b2815bc2a]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63216764-be19-490d-a6be-b93ad54a8762 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hBedKUIZ {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63216764-be19-490d-a6be-b93ad54a8762 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hBedKUIZ" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3bea99-51f1-451b-bc01-a5feb6bfe51c]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hBedKUIZ'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63216764-be19-490d-a6be-b93ad54a8762 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63216764-be19-490d-a6be-b93ad54a8762 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e83c85a-5ce6-4578-bb43-2b006a48fba0]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08ef260-209f-44e3-aacb-142d92bc4f3c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)
Apr 11 15:23:20 user nova-compute[71229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)
Apr 11 15:23:20 user nova-compute[71229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)
Apr 11 15:23:20 user nova-compute[71229]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 (non-flash)
Apr 11 15:23:20 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)
Apr 11 15:23:20 user nova-compute[71229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)
Apr 11 15:23:20 user nova-compute[71229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)
Apr 11 15:23:20 user nova-compute[71229]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 (non-flash)
Apr 11 15:23:20 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63216764-be19-490d-a6be-b93ad54a8762 -p 172.16.0.220:3260 --login {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63216764-be19-490d-a6be-b93ad54a8762 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc79452-85af-442e-a6aa-9c380af21101]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:63216764-be19-490d-a6be-b93ad54a8762, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:63216764-be19-490d-a6be-b93ad54a8762, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:63216764-be19-490d-a6be-b93ad54a8762, portal: 172.16.0.220,3260]
Apr 11 15:23:20 user nova-compute[71229]: Login to [iface: default, target: iqn.2010-10.org.openstack:63216764-be19-490d-a6be-b93ad54a8762, portal: 172.16.0.220,3260] successful.
Apr 11 15:23:20 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63216764-be19-490d-a6be-b93ad54a8762 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63216764-be19-490d-a6be-b93ad54a8762 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[82dd16cf-f7a0-4ad5-a68f-8dbb83a5497f]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[73167c76-3cb9-4a00-97f6-2ef6bb2efb96]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63216764-be19-490d-a6be-b93ad54a8762 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)
Apr 11 15:23:20 user nova-compute[71229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)
Apr 11 15:23:20 user nova-compute[71229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)
Apr 11 15:23:20 user nova-compute[71229]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 (non-flash)
Apr 11 15:23:20 user nova-compute[71229]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63216764-be19-490d-a6be-b93ad54a8762 (non-flash)
Apr 11 15:23:20 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)
Apr 11 15:23:20 user nova-compute[71229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)
Apr 11 15:23:20 user nova-compute[71229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)
Apr 11 15:23:20 user nova-compute[71229]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 (non-flash)
Apr 11 15:23:20 user nova-compute[71229]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63216764-be19-490d-a6be-b93ad54a8762 (non-flash)
Apr 11 15:23:20 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63216764-be19-490d-a6be-b93ad54a8762" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] HCTL ('37', '-', '-', 0) found on session 8 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e45b1e4-026e-4429-a144-4ca428b68caf]: (4, ('- - 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Searching for a device in session 8 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:63216764-be19-490d-a6be-b93ad54a8762', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hBedKUIZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Acquiring lock "8d84862f-b710-48b1-9275-93fc799cf1f9" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Lock "8d84862f-b710-48b1-9275-93fc799cf1f9" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG os_brick.utils [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[527ccb43-b6b3-479b-a3bf-5ed852d7ca64]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d55e24a97c90\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee0458f-2d83-4b77-9619-980b107fd805]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[97609553-67ae-474f-b1e0-b13b16202cc9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6cc80ae-d6fe-4ce7-9850-05814250f616]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Running cmd (subprocess): nvme version {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] nvme not present on system {{(pid=71229) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:23:20 user nova-compute[71229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 15:23:20 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[276cdcf7-8328-45c8-91cc-e73ebdc387b6]: (4, '') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71229) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] LIGHTOS: no hostnqn found. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 15:23:20 user nova-compute[71229]: DEBUG os_brick.utils [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d55e24a97c90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:23:21 user nova-compute[71229]: INFO nova.compute.manager [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Swapping volume 761a1221-3eec-47f9-8a05-9eb545bede26 for 33e46e47-d157-4f4d-b7cf-96f42888f78c
Apr 11 15:23:21 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Acquiring lock "2b2c294d-49b2-41bf-89d0-17a560e7741f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "2b2c294d-49b2-41bf-89d0-17a560e7741f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:21 user nova-compute[71229]: DEBUG nova.objects.instance [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lazy-loading 'flavor' on Instance uuid 2b2c294d-49b2-41bf-89d0-17a560e7741f {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:23:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "2b2c294d-49b2-41bf-89d0-17a560e7741f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:23:21 user nova-compute[71229]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681226586.657588, 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5 => Stopped> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:23:21 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] VM Stopped (Lifecycle Event)
Apr 11 15:23:21 user nova-compute[71229]: DEBUG nova.compute.manager [None req-b012b6d3-dbec-4c10-ade0-040ddcf48ebb None None] [instance: 4b1dedd0-ae18-421b-b83a-a7b2c22c65d5] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:23:21 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:23:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23531653437313439', 'path': '/dev/sdf'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:23:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531653437313439', 'path': '/dev/sdf'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 15:23:21 user nova-compute[71229]: DEBUG nova.objects.instance [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lazy-loading 'flavor' on Instance uuid f3a06747-0f43-4731-87e6-40629c382a6b {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:23:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Acquiring lock "2b2c294d-49b2-41bf-89d0-17a560e7741f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "2b2c294d-49b2-41bf-89d0-17a560e7741f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:21 user nova-compute[71229]: INFO nova.compute.manager [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Attaching volume f1eaab93-85f1-49cd-a6c4-4c499c77d2c9 to /dev/sdc
Apr 11 15:23:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 15:23:21 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:23:21 user nova-compute[71229]:   <source dev="/dev/sdf"/>
Apr 11 15:23:21 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 15:23:21 user nova-compute[71229]:   <serial>63216764-be19-490d-a6be-b93ad54a8762</serial>
Apr 11 15:23:21 user nova-compute[71229]: </disk>
Apr 11 15:23:21 user nova-compute[71229]:  {{(pid=71229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 15:23:21 user nova-compute[71229]: DEBUG os_brick.utils [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:23:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:21 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[affa0137-5711-4d4e-9e4f-90ce38bc3a19]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d55e24a97c90\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:21 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d908f844-ae16-48c2-8760-fe43432919c5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:21 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a6c78b-9737-405b-bf9f-077dd96849e6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:21 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2dbe621-e433-4d50-b3f9-b7cb392e3b66]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Running cmd (subprocess): nvme version {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] 'nvme version' failed. Not Retrying. {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:23:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] nvme not present on system {{(pid=71229) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 15:23:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:23:21 user nova-compute[71229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 15:23:21 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9fee690-0a51-4756-8b34-996dabc1ee92]: (4, '') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71229) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 15:23:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 15:23:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] LIGHTOS: no hostnqn found. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 15:23:21 user nova-compute[71229]: DEBUG os_brick.utils [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d55e24a97c90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:23:21 user nova-compute[71229]: DEBUG nova.virt.block_device [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Updating existing volume attachment record: 3566ce51-a71a-42f5-a286-8613f88de8c0 {{(pid=71229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 15:23:22 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:23:22 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:23:22 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] No VIF found with MAC fa:16:3e:74:02:c7, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:23:22 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-0eaa66ef-3ac9-45f1-baae-b03bece3b472 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "f3a06747-0f43-4731-87e6-40629c382a6b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.343s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:23:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c3438a14-9ae6-43e9-85b2-179b0a4fe229 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "f3a06747-0f43-4731-87e6-40629c382a6b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c3438a14-9ae6-43e9-85b2-179b0a4fe229 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "f3a06747-0f43-4731-87e6-40629c382a6b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:23 user nova-compute[71229]: INFO nova.compute.manager [None req-c3438a14-9ae6-43e9-85b2-179b0a4fe229 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Detaching volume 63216764-be19-490d-a6be-b93ad54a8762
Apr 11 15:23:23 user nova-compute[71229]: INFO nova.virt.block_device [None req-c3438a14-9ae6-43e9-85b2-179b0a4fe229 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Attempting to driver detach volume 63216764-be19-490d-a6be-b93ad54a8762 from mountpoint /dev/vdb
Apr 11 15:23:23 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c3438a14-9ae6-43e9-85b2-179b0a4fe229 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Attempting to detach device vdb from instance f3a06747-0f43-4731-87e6-40629c382a6b from the persistent domain config. {{(pid=71229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 15:23:23 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-c3438a14-9ae6-43e9-85b2-179b0a4fe229 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 15:23:23 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:23:23 user nova-compute[71229]:   <source dev="/dev/sdf"/>
Apr 11 15:23:23 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 15:23:23 user nova-compute[71229]:   <serial>63216764-be19-490d-a6be-b93ad54a8762</serial>
Apr 11 15:23:23 user nova-compute[71229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 15:23:23 user nova-compute[71229]: </disk>
Apr 11 15:23:23 user nova-compute[71229]:  {{(pid=71229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 15:23:23 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-c3438a14-9ae6-43e9-85b2-179b0a4fe229 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Successfully detached device vdb from instance f3a06747-0f43-4731-87e6-40629c382a6b from the persistent domain config.
Apr 11 15:23:23 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c3438a14-9ae6-43e9-85b2-179b0a4fe229 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f3a06747-0f43-4731-87e6-40629c382a6b from the live domain config. {{(pid=71229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 15:23:23 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-c3438a14-9ae6-43e9-85b2-179b0a4fe229 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 15:23:23 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:23:23 user nova-compute[71229]:   <source dev="/dev/sdf"/>
Apr 11 15:23:23 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 15:23:23 user nova-compute[71229]:   <serial>63216764-be19-490d-a6be-b93ad54a8762</serial>
Apr 11 15:23:23 user nova-compute[71229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 15:23:23 user nova-compute[71229]: </disk>
Apr 11 15:23:23 user nova-compute[71229]:  {{(pid=71229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 15:23:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-a43b4a3f-9b4f-4af5-b1f3-0c727afbf4b7 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Acquiring lock "3bd4e3ea-2df2-48f8-96bd-8f8219c73bea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-a43b4a3f-9b4f-4af5-b1f3-0c727afbf4b7 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Lock "3bd4e3ea-2df2-48f8-96bd-8f8219c73bea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-a43b4a3f-9b4f-4af5-b1f3-0c727afbf4b7 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Acquiring lock "3bd4e3ea-2df2-48f8-96bd-8f8219c73bea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-a43b4a3f-9b4f-4af5-b1f3-0c727afbf4b7 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Lock "3bd4e3ea-2df2-48f8-96bd-8f8219c73bea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-a43b4a3f-9b4f-4af5-b1f3-0c727afbf4b7 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Lock "3bd4e3ea-2df2-48f8-96bd-8f8219c73bea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:23:23 user nova-compute[71229]: INFO nova.compute.manager [None req-a43b4a3f-9b4f-4af5-b1f3-0c727afbf4b7 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Terminating instance
Apr 11 15:23:23 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a43b4a3f-9b4f-4af5-b1f3-0c727afbf4b7 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Start destroying the instance on the hypervisor. {{(pid=71229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 15:23:23 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Received event <DeviceRemovedEvent: 1681226603.8948524, f3a06747-0f43-4731-87e6-40629c382a6b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71229) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 15:23:23 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c3438a14-9ae6-43e9-85b2-179b0a4fe229 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f3a06747-0f43-4731-87e6-40629c382a6b {{(pid=71229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 15:23:23 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-c3438a14-9ae6-43e9-85b2-179b0a4fe229 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Successfully detached device vdb from instance f3a06747-0f43-4731-87e6-40629c382a6b from the live domain config.
Apr 11 15:23:23 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3438a14-9ae6-43e9-85b2-179b0a4fe229 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 15:23:23 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3438a14-9ae6-43e9-85b2-179b0a4fe229 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:63216764-be19-490d-a6be-b93ad54a8762', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hBedKUIZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:23:23 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-c3438a14-9ae6-43e9-85b2-179b0a4fe229 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:23:23 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-c3438a14-9ae6-43e9-85b2-179b0a4fe229 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:23:23 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-c3438a14-9ae6-43e9-85b2-179b0a4fe229 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:23:23 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:23 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:23 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa332e4-ef9d-4aaa-9ea8-1994d867ec4c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:63216764-be19-490d-a6be-b93ad54a8762\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:23 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3438a14-9ae6-43e9-85b2-179b0a4fe229 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 15:23:23 user nova-compute[71229]: No targets found.
Apr 11 15:23:23 user nova-compute[71229]: iSNS:
Apr 11 15:23:23 user nova-compute[71229]: No targets found.
Apr 11 15:23:23 user nova-compute[71229]: STATIC:
Apr 11 15:23:23 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26
Apr 11 15:23:23 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:23:23 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:23:23 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d
Apr 11 15:23:23 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:23:23 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:23:23 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487
Apr 11 15:23:23 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:23:23 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:23:23 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c
Apr 11 15:23:23 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:23:23 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:23:23 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:63216764-be19-490d-a6be-b93ad54a8762
Apr 11 15:23:23 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:23:23 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:23:23 user nova-compute[71229]: FIRMWARE:
Apr 11 15:23:23 user nova-compute[71229]: No targets found.
Apr 11 15:23:23 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:23:23 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3438a14-9ae6-43e9-85b2-179b0a4fe229 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 15:23:23 user nova-compute[71229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 15:23:23 user nova-compute[71229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71229) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 15:23:23 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3438a14-9ae6-43e9-85b2-179b0a4fe229 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63216764-be19-490d-a6be-b93ad54a8762', 0)] {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 15:23:23 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:23 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:23 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd327543-1125-4cff-8e8a-853500764c3b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63216764-be19-490d-a6be-b93ad54a8762\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:23 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:23 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:23 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0809db99-7262-43a5-8424-5a094ef752df]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63216764-be19-490d-a6be-b93ad54a8762 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:23 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3438a14-9ae6-43e9-85b2-179b0a4fe229 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)
Apr 11 15:23:23 user nova-compute[71229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)
Apr 11 15:23:23 user nova-compute[71229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)
Apr 11 15:23:23 user nova-compute[71229]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 (non-flash)
Apr 11 15:23:23 user nova-compute[71229]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63216764-be19-490d-a6be-b93ad54a8762 (non-flash)
Apr 11 15:23:23 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:23:23 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3438a14-9ae6-43e9-85b2-179b0a4fe229 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)
Apr 11 15:23:23 user nova-compute[71229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)
Apr 11 15:23:23 user nova-compute[71229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)
Apr 11 15:23:23 user nova-compute[71229]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 (non-flash)
Apr 11 15:23:23 user nova-compute[71229]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63216764-be19-490d-a6be-b93ad54a8762 (non-flash)
Apr 11 15:23:23 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:23:24 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3438a14-9ae6-43e9-85b2-179b0a4fe229 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb643a12d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63216764-be19-490d-a6be-b93ad54a8762'): ({'sdf'}, set())}) {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 15:23:24 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-c3438a14-9ae6-43e9-85b2-179b0a4fe229 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Removing single pathed devices sdf {{(pid=71229) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 15:23:24 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:24 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:24 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8471606b-2801-48bb-b255-bc0bf7a941e2]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:24 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:24 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:24 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03dd93c-9c60-41d6-8ea8-d5c083e0e865]: (4, ('ok\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:24 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-c3438a14-9ae6-43e9-85b2-179b0a4fe229 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Flushing IO for device /dev/sdf {{(pid=71229) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 15:23:24 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:24 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:24 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c81f09-7403-46ff-8739-6b6c97977dc6]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:24 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-c3438a14-9ae6-43e9-85b2-179b0a4fe229 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71229) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 15:23:24 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:24 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:24 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd8d00c-68c6-4191-9d34-82e34332a9f4]: (4, ('1', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:24 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-c3438a14-9ae6-43e9-85b2-179b0a4fe229 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 15:23:24 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-c3438a14-9ae6-43e9-85b2-179b0a4fe229 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] SCSI volumes sdf have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 15:23:24 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3438a14-9ae6-43e9-85b2-179b0a4fe229 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63216764-be19-490d-a6be-b93ad54a8762')] {{(pid=71229) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 15:23:24 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63216764-be19-490d-a6be-b93ad54a8762 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:24 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63216764-be19-490d-a6be-b93ad54a8762 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:24 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6c0ad4-d82f-4249-bc55-1d9fae89d436]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:24 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3438a14-9ae6-43e9-85b2-179b0a4fe229 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:24 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63216764-be19-490d-a6be-b93ad54a8762 -p 172.16.0.220:3260 --logout {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:24 user nova-compute[71229]: DEBUG nova.compute.manager [req-2a5a5140-4d76-4f7f-8a05-edd15d0e3b4a req-339b63e2-197e-417f-b6f8-510f4098b56c service nova] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Received event network-vif-unplugged-6c658c02-f85a-49aa-aaab-5aa3552ddb63 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:23:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2a5a5140-4d76-4f7f-8a05-edd15d0e3b4a req-339b63e2-197e-417f-b6f8-510f4098b56c service nova] Acquiring lock "3bd4e3ea-2df2-48f8-96bd-8f8219c73bea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2a5a5140-4d76-4f7f-8a05-edd15d0e3b4a req-339b63e2-197e-417f-b6f8-510f4098b56c service nova] Lock "3bd4e3ea-2df2-48f8-96bd-8f8219c73bea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2a5a5140-4d76-4f7f-8a05-edd15d0e3b4a req-339b63e2-197e-417f-b6f8-510f4098b56c service nova] Lock "3bd4e3ea-2df2-48f8-96bd-8f8219c73bea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:23:24 user nova-compute[71229]: DEBUG nova.compute.manager [req-2a5a5140-4d76-4f7f-8a05-edd15d0e3b4a req-339b63e2-197e-417f-b6f8-510f4098b56c service nova] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] No waiting events found dispatching network-vif-unplugged-6c658c02-f85a-49aa-aaab-5aa3552ddb63 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:23:24 user nova-compute[71229]: DEBUG nova.compute.manager [req-2a5a5140-4d76-4f7f-8a05-edd15d0e3b4a req-339b63e2-197e-417f-b6f8-510f4098b56c service nova] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Received event network-vif-unplugged-6c658c02-f85a-49aa-aaab-5aa3552ddb63 for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 15:23:24 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63216764-be19-490d-a6be-b93ad54a8762 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:24 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[277e4c2f-3be4-47ce-9fe6-ee66b12b10db]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:63216764-be19-490d-a6be-b93ad54a8762, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:63216764-be19-490d-a6be-b93ad54a8762, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:24 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3438a14-9ae6-43e9-85b2-179b0a4fe229 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:63216764-be19-490d-a6be-b93ad54a8762, portal: 172.16.0.220,3260]
Apr 11 15:23:24 user nova-compute[71229]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:63216764-be19-490d-a6be-b93ad54a8762, portal: 172.16.0.220,3260] successful.
Apr 11 15:23:24 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:24 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63216764-be19-490d-a6be-b93ad54a8762 -p 172.16.0.220:3260 --op delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:24 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63216764-be19-490d-a6be-b93ad54a8762 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:24 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6de2fd-df02-472d-9361-d8ecfad8a4db]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:24 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3438a14-9ae6-43e9-85b2-179b0a4fe229 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:24 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-c3438a14-9ae6-43e9-85b2-179b0a4fe229 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:23:24 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3438a14-9ae6-43e9-85b2-179b0a4fe229 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] <== disconnect_volume: return (364ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:23:24 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3438a14-9ae6-43e9-85b2-179b0a4fe229 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 15:23:24 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Instance destroyed successfully.
Apr 11 15:23:24 user nova-compute[71229]: DEBUG nova.objects.instance [None req-a43b4a3f-9b4f-4af5-b1f3-0c727afbf4b7 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Lazy-loading 'resources' on Instance uuid 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:23:24 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-a43b4a3f-9b4f-4af5-b1f3-0c727afbf4b7 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:21:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-120628292',display_name='tempest-VolumesNegativeTest-instance-120628292',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-120628292',id=8,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:21:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6abbfac8ab124b919978b9085a958d4b',ramdisk_id='',reservation_id='r-ugn569my',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1341935232',owner_user_name='tempest-VolumesNegativeTest-1341935232-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:21:43Z,user_data=None,user_id='dacdf9131d93415596e40cb8a5416137',uuid=3bd4e3ea-2df2-48f8-96bd-8f8219c73bea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c658c02-f85a-49aa-aaab-5aa3552ddb63", "address": "fa:16:3e:05:bb:c4", "network": {"id": "aa9e8d0b-ed9a-44fd-b934-5461808630c5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "da25b23996564e4b84947ca5a81d90ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c658c02-f8", "ovs_interfaceid": "6c658c02-f85a-49aa-aaab-5aa3552ddb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:23:24 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-a43b4a3f-9b4f-4af5-b1f3-0c727afbf4b7 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Converting VIF {"id": "6c658c02-f85a-49aa-aaab-5aa3552ddb63", "address": "fa:16:3e:05:bb:c4", "network": {"id": "aa9e8d0b-ed9a-44fd-b934-5461808630c5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "da25b23996564e4b84947ca5a81d90ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c658c02-f8", "ovs_interfaceid": "6c658c02-f85a-49aa-aaab-5aa3552ddb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:23:24 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-a43b4a3f-9b4f-4af5-b1f3-0c727afbf4b7 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:bb:c4,bridge_name='br-int',has_traffic_filtering=True,id=6c658c02-f85a-49aa-aaab-5aa3552ddb63,network=Network(aa9e8d0b-ed9a-44fd-b934-5461808630c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c658c02-f8') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:23:24 user nova-compute[71229]: DEBUG os_vif [None req-a43b4a3f-9b4f-4af5-b1f3-0c727afbf4b7 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:bb:c4,bridge_name='br-int',has_traffic_filtering=True,id=6c658c02-f85a-49aa-aaab-5aa3552ddb63,network=Network(aa9e8d0b-ed9a-44fd-b934-5461808630c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c658c02-f8') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:23:24 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:24 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6c658c02-f8, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:23:24 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:24 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:24 user nova-compute[71229]: INFO os_vif [None req-a43b4a3f-9b4f-4af5-b1f3-0c727afbf4b7 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:bb:c4,bridge_name='br-int',has_traffic_filtering=True,id=6c658c02-f85a-49aa-aaab-5aa3552ddb63,network=Network(aa9e8d0b-ed9a-44fd-b934-5461808630c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c658c02-f8')
Apr 11 15:23:24 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-a43b4a3f-9b4f-4af5-b1f3-0c727afbf4b7 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Deleting instance files /opt/stack/data/nova/instances/3bd4e3ea-2df2-48f8-96bd-8f8219c73bea_del
Apr 11 15:23:24 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-a43b4a3f-9b4f-4af5-b1f3-0c727afbf4b7 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Deletion of /opt/stack/data/nova/instances/3bd4e3ea-2df2-48f8-96bd-8f8219c73bea_del complete
Apr 11 15:23:24 user nova-compute[71229]: INFO nova.compute.manager [None req-a43b4a3f-9b4f-4af5-b1f3-0c727afbf4b7 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 11 15:23:24 user nova-compute[71229]: DEBUG oslo.service.loopingcall [None req-a43b4a3f-9b4f-4af5-b1f3-0c727afbf4b7 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71229) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 15:23:24 user nova-compute[71229]: DEBUG nova.compute.manager [-] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Deallocating network for instance {{(pid=71229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 15:23:24 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] deallocate_for_instance() {{(pid=71229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG nova.objects.instance [None req-c3438a14-9ae6-43e9-85b2-179b0a4fe229 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lazy-loading 'flavor' on Instance uuid f3a06747-0f43-4731-87e6-40629c382a6b {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c3438a14-9ae6-43e9-85b2-179b0a4fe229 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "f3a06747-0f43-4731-87e6-40629c382a6b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.719s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG nova.compute.manager [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KnDtHpAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8d84862f-b710-48b1-9275-93fc799cf1f9', 'attached_at': '', 'detached_at': '', 'volume_id': '33e46e47-d157-4f4d-b7cf-96f42888f78c', 'serial': '33e46e47-d157-4f4d-b7cf-96f42888f78c'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tKFecpPZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '8d84862f-b710-48b1-9275-93fc799cf1f9', 'attached_at': '', 'detached_at': '', 'volume_id': '761a1221-3eec-47f9-8a05-9eb545bede26', 'serial'} {{(pid=71229) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KnDtHpAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:23:25 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:23:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:23:25 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:23:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:23:25 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 15:23:25 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:25 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Took 0.74 seconds to deallocate network for instance.
Apr 11 15:23:25 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a2a9c5-c999-4ba8-8e1c-7fb7075ac2ea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 15:23:25 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c -p 172.16.0.220:3260 --interface default --op new {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7bd47e9-d6d0-4601-bc5f-a698a7b527e7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c] added\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c] added
Apr 11 15:23:25 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffc98a0-f275-496c-b922-833e2b24f66e]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-a43b4a3f-9b4f-4af5-b1f3-0c727afbf4b7 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-a43b4a3f-9b4f-4af5-b1f3-0c727afbf4b7 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2a892a-8657-4438-ba33-b2b7067397f7]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KnDtHpAV {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KnDtHpAV" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4c6de3-ce01-4487-9cc5-133929f6ec9a]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KnDtHpAV'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb0544b-b739-469a-b99d-dedc2b913031]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d1cb1e-3cd7-4907-b6b2-5d4c408b2b59]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)
Apr 11 15:23:25 user nova-compute[71229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)
Apr 11 15:23:25 user nova-compute[71229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)
Apr 11 15:23:25 user nova-compute[71229]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 (non-flash)
Apr 11 15:23:25 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)
Apr 11 15:23:25 user nova-compute[71229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)
Apr 11 15:23:25 user nova-compute[71229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)
Apr 11 15:23:25 user nova-compute[71229]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 (non-flash)
Apr 11 15:23:25 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c -p 172.16.0.220:3260 --login {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0786aa0f-0715-4ed5-aaf1-8378bc3b757b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c, portal: 172.16.0.220,3260]
Apr 11 15:23:25 user nova-compute[71229]: Login to [iface: default, target: iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c, portal: 172.16.0.220,3260] successful.
Apr 11 15:23:25 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f4f42c-03e9-4c06-a808-9936069143e5]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60f8084-ac9f-42c1-9886-569d8e28259c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)
Apr 11 15:23:25 user nova-compute[71229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)
Apr 11 15:23:25 user nova-compute[71229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)
Apr 11 15:23:25 user nova-compute[71229]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 (non-flash)
Apr 11 15:23:25 user nova-compute[71229]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c (non-flash)
Apr 11 15:23:25 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)
Apr 11 15:23:25 user nova-compute[71229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)
Apr 11 15:23:25 user nova-compute[71229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)
Apr 11 15:23:25 user nova-compute[71229]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 (non-flash)
Apr 11 15:23:25 user nova-compute[71229]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c (non-flash)
Apr 11 15:23:25 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] HCTL ('37', '-', '-', 0) found on session 9 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-a43b4a3f-9b4f-4af5-b1f3-0c727afbf4b7 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57e8fa9-ec00-473b-a7c3-0ffa9425111e]: (4, ('- - 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Searching for a device in session 9 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KnDtHpAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-a43b4a3f-9b4f-4af5-b1f3-0c727afbf4b7 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:23:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-a43b4a3f-9b4f-4af5-b1f3-0c727afbf4b7 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.270s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:23:25 user nova-compute[71229]: INFO nova.scheduler.client.report [None req-a43b4a3f-9b4f-4af5-b1f3-0c727afbf4b7 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Deleted allocations for instance 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea
Apr 11 15:23:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-a43b4a3f-9b4f-4af5-b1f3-0c727afbf4b7 tempest-VolumesNegativeTest-1341935232 tempest-VolumesNegativeTest-1341935232-project-member] Lock "3bd4e3ea-2df2-48f8-96bd-8f8219c73bea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.067s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:23:26 user nova-compute[71229]: DEBUG nova.compute.manager [req-4b4a7715-6cc0-4d70-bc89-88876a7d312d req-6a3fe66c-d473-41aa-a314-ae71c340304c service nova] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Received event network-vif-plugged-6c658c02-f85a-49aa-aaab-5aa3552ddb63 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:23:26 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4b4a7715-6cc0-4d70-bc89-88876a7d312d req-6a3fe66c-d473-41aa-a314-ae71c340304c service nova] Acquiring lock "3bd4e3ea-2df2-48f8-96bd-8f8219c73bea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:26 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4b4a7715-6cc0-4d70-bc89-88876a7d312d req-6a3fe66c-d473-41aa-a314-ae71c340304c service nova] Lock "3bd4e3ea-2df2-48f8-96bd-8f8219c73bea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:26 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4b4a7715-6cc0-4d70-bc89-88876a7d312d req-6a3fe66c-d473-41aa-a314-ae71c340304c service nova] Lock "3bd4e3ea-2df2-48f8-96bd-8f8219c73bea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:23:26 user nova-compute[71229]: DEBUG nova.compute.manager [req-4b4a7715-6cc0-4d70-bc89-88876a7d312d req-6a3fe66c-d473-41aa-a314-ae71c340304c service nova] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] No waiting events found dispatching network-vif-plugged-6c658c02-f85a-49aa-aaab-5aa3552ddb63 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:23:26 user nova-compute[71229]: WARNING nova.compute.manager [req-4b4a7715-6cc0-4d70-bc89-88876a7d312d req-6a3fe66c-d473-41aa-a314-ae71c340304c service nova] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Received unexpected event network-vif-plugged-6c658c02-f85a-49aa-aaab-5aa3552ddb63 for instance with vm_state deleted and task_state None.
Apr 11 15:23:26 user nova-compute[71229]: DEBUG nova.compute.manager [req-4b4a7715-6cc0-4d70-bc89-88876a7d312d req-6a3fe66c-d473-41aa-a314-ae71c340304c service nova] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Received event network-vif-deleted-6c658c02-f85a-49aa-aaab-5aa3552ddb63 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:23:26 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 15:23:26 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f1eaab93-85f1-49cd-a6c4-4c499c77d2c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eqAxpQUN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:23:26 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:23:26 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:23:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:26 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:23:26 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23434393433653738', 'path': '/dev/sdf'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:23:26 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434393433653738', 'path': '/dev/sdf'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 15:23:26 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.473s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:23:26 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:23:26 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1eaab93-85f1-49cd-a6c4-4c499c77d2c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:23:26 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1eaab93-85f1-49cd-a6c4-4c499c77d2c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:23:26 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 15:23:26 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1eaab93-85f1-49cd-a6c4-4c499c77d2c9 -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:26 user nova-compute[71229]: DEBUG nova.objects.instance [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Lazy-loading 'flavor' on Instance uuid 8d84862f-b710-48b1-9275-93fc799cf1f9 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:23:26 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1eaab93-85f1-49cd-a6c4-4c499c77d2c9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:26 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebcacb08-abc1-43f0-8daf-0b55857b9121]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:26 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 15:23:26 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:26 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1eaab93-85f1-49cd-a6c4-4c499c77d2c9 -p 172.16.0.220:3260 --interface default --op new {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:26 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1eaab93-85f1-49cd-a6c4-4c499c77d2c9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:26 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca72025-0232-46e6-b0d9-b1b3440edac4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1eaab93-85f1-49cd-a6c4-4c499c77d2c9] added\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:26 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1eaab93-85f1-49cd-a6c4-4c499c77d2c9] added
Apr 11 15:23:26 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:26 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1eaab93-85f1-49cd-a6c4-4c499c77d2c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:26 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1eaab93-85f1-49cd-a6c4-4c499c77d2c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:26 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[781caa48-e0f8-4c89-a10c-20f3f4a78f9c]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:26 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:26 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1eaab93-85f1-49cd-a6c4-4c499c77d2c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:26 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1eaab93-85f1-49cd-a6c4-4c499c77d2c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:26 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1360223c-bb97-4392-8985-94e1b28317c5]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:26 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:26 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1eaab93-85f1-49cd-a6c4-4c499c77d2c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eqAxpQUN {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:26 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1eaab93-85f1-49cd-a6c4-4c499c77d2c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eqAxpQUN" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:26 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[240b14a5-98c2-4363-be84-172ef47beb84]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:26 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eqAxpQUN'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:26 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1eaab93-85f1-49cd-a6c4-4c499c77d2c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:26 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1eaab93-85f1-49cd-a6c4-4c499c77d2c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:26 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e783746-a638-4b82-9d7b-51fde3ac3aff]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:26 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:26 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:26 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:26 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d479ddc-a218-439f-8416-c795de586b37]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:26 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)
Apr 11 15:23:26 user nova-compute[71229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)
Apr 11 15:23:26 user nova-compute[71229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)
Apr 11 15:23:26 user nova-compute[71229]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 (non-flash)
Apr 11 15:23:26 user nova-compute[71229]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c (non-flash)
Apr 11 15:23:26 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:23:26 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)
Apr 11 15:23:26 user nova-compute[71229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)
Apr 11 15:23:26 user nova-compute[71229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)
Apr 11 15:23:26 user nova-compute[71229]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 (non-flash)
Apr 11 15:23:26 user nova-compute[71229]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c (non-flash)
Apr 11 15:23:26 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:23:26 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1eaab93-85f1-49cd-a6c4-4c499c77d2c9 -p 172.16.0.220:3260 --login {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:26 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1eaab93-85f1-49cd-a6c4-4c499c77d2c9 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:26 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[89da1d15-6cd0-41f6-bf6d-0e47b17ffe2a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1eaab93-85f1-49cd-a6c4-4c499c77d2c9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f1eaab93-85f1-49cd-a6c4-4c499c77d2c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:26 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1eaab93-85f1-49cd-a6c4-4c499c77d2c9, portal: 172.16.0.220,3260]
Apr 11 15:23:26 user nova-compute[71229]: Login to [iface: default, target: iqn.2010-10.org.openstack:f1eaab93-85f1-49cd-a6c4-4c499c77d2c9, portal: 172.16.0.220,3260] successful.
Apr 11 15:23:26 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:26 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1eaab93-85f1-49cd-a6c4-4c499c77d2c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:27 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1eaab93-85f1-49cd-a6c4-4c499c77d2c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:27 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b40a17e-9bbb-47b9-bd9f-5456a5bbe083]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:27 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:27 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:27 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:27 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[26437318-21a4-4547-a6ff-909e9d7053e4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1eaab93-85f1-49cd-a6c4-4c499c77d2c9 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:27 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1eaab93-85f1-49cd-a6c4-4c499c77d2c9 (non-flash)
Apr 11 15:23:27 user nova-compute[71229]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)
Apr 11 15:23:27 user nova-compute[71229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)
Apr 11 15:23:27 user nova-compute[71229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)
Apr 11 15:23:27 user nova-compute[71229]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 (non-flash)
Apr 11 15:23:27 user nova-compute[71229]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c (non-flash)
Apr 11 15:23:27 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:23:27 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1eaab93-85f1-49cd-a6c4-4c499c77d2c9 (non-flash)
Apr 11 15:23:27 user nova-compute[71229]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)
Apr 11 15:23:27 user nova-compute[71229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)
Apr 11 15:23:27 user nova-compute[71229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)
Apr 11 15:23:27 user nova-compute[71229]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 (non-flash)
Apr 11 15:23:27 user nova-compute[71229]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c (non-flash)
Apr 11 15:23:27 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:23:27 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1eaab93-85f1-49cd-a6c4-4c499c77d2c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:23:27 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 15:23:27 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] HCTL ('38', '-', '-', 0) found on session 10 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 15:23:27 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 15:23:27 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:27 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.015s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:27 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac587a13-8126-4159-8659-6e853f22833d]: (4, ('- - 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:27 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Searching for a device in session 10 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:23:27 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:f1eaab93-85f1-49cd-a6c4-4c499c77d2c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eqAxpQUN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 15:23:27 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=71229) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 15:23:27 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] COPY block job progress, current cursor: 148897792 final cursor: 1073741824 {{(pid=71229) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 15:23:28 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:23:28 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] <== connect_volume: return (1785ms) {'type': 'block', 'scsi_wwn': '23766306137336637', 'path': '/dev/sdg'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:23:28 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766306137336637', 'path': '/dev/sdg'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 15:23:28 user nova-compute[71229]: DEBUG nova.objects.instance [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lazy-loading 'flavor' on Instance uuid 2b2c294d-49b2-41bf-89d0-17a560e7741f {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:23:28 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 15:23:28 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:23:28 user nova-compute[71229]:   <source dev="/dev/sdg"/>
Apr 11 15:23:28 user nova-compute[71229]:   <target dev="sdc" bus="scsi"/>
Apr 11 15:23:28 user nova-compute[71229]:   <serial>f1eaab93-85f1-49cd-a6c4-4c499c77d2c9</serial>
Apr 11 15:23:28 user nova-compute[71229]:   <address type="drive" controller="0" unit="2"/>
Apr 11 15:23:28 user nova-compute[71229]: </disk>
Apr 11 15:23:28 user nova-compute[71229]:  {{(pid=71229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 15:23:28 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] COPY block job progress, current cursor: 329252864 final cursor: 1073741824 {{(pid=71229) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 15:23:28 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] No BDM found with device name sda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:23:28 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:23:28 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] No BDM found with device name sdc, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:23:28 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] No VIF found with MAC fa:16:3e:ce:80:c4, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:23:28 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] COPY block job progress, current cursor: 517996544 final cursor: 1073741824 {{(pid=71229) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 15:23:28 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-2f0ac713-b811-406e-ab6f-1e3abb002c50 tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "2b2c294d-49b2-41bf-89d0-17a560e7741f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.060s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:23:29 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] COPY block job progress, current cursor: 691011584 final cursor: 1073741824 {{(pid=71229) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 15:23:29 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:29 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] COPY block job progress, current cursor: 827326464 final cursor: 1073741824 {{(pid=71229) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 15:23:29 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-86781472-0df0-4f47-b538-2a745271625c tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Acquiring lock "2b2c294d-49b2-41bf-89d0-17a560e7741f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:29 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-86781472-0df0-4f47-b538-2a745271625c tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "2b2c294d-49b2-41bf-89d0-17a560e7741f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:30 user nova-compute[71229]: INFO nova.compute.manager [None req-86781472-0df0-4f47-b538-2a745271625c tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Detaching volume f1eaab93-85f1-49cd-a6c4-4c499c77d2c9
Apr 11 15:23:30 user nova-compute[71229]: INFO nova.virt.block_device [None req-86781472-0df0-4f47-b538-2a745271625c tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Attempting to driver detach volume f1eaab93-85f1-49cd-a6c4-4c499c77d2c9 from mountpoint /dev/sdc
Apr 11 15:23:30 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-86781472-0df0-4f47-b538-2a745271625c tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Attempting to detach device sdc from instance 2b2c294d-49b2-41bf-89d0-17a560e7741f from the persistent domain config. {{(pid=71229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-86781472-0df0-4f47-b538-2a745271625c tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 15:23:30 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:23:30 user nova-compute[71229]:   <source dev="/dev/sdg"/>
Apr 11 15:23:30 user nova-compute[71229]:   <target dev="sdc" bus="scsi"/>
Apr 11 15:23:30 user nova-compute[71229]:   <serial>f1eaab93-85f1-49cd-a6c4-4c499c77d2c9</serial>
Apr 11 15:23:30 user nova-compute[71229]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 11 15:23:30 user nova-compute[71229]: </disk>
Apr 11 15:23:30 user nova-compute[71229]:  {{(pid=71229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 15:23:30 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-86781472-0df0-4f47-b538-2a745271625c tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Successfully detached device sdc from instance 2b2c294d-49b2-41bf-89d0-17a560e7741f from the persistent domain config.
Apr 11 15:23:30 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-86781472-0df0-4f47-b538-2a745271625c tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 2b2c294d-49b2-41bf-89d0-17a560e7741f from the live domain config. {{(pid=71229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-86781472-0df0-4f47-b538-2a745271625c tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 15:23:30 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:23:30 user nova-compute[71229]:   <source dev="/dev/sdg"/>
Apr 11 15:23:30 user nova-compute[71229]:   <target dev="sdc" bus="scsi"/>
Apr 11 15:23:30 user nova-compute[71229]:   <serial>f1eaab93-85f1-49cd-a6c4-4c499c77d2c9</serial>
Apr 11 15:23:30 user nova-compute[71229]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 11 15:23:30 user nova-compute[71229]: </disk>
Apr 11 15:23:30 user nova-compute[71229]:  {{(pid=71229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] COPY block job progress, current cursor: 1001390080 final cursor: 1073741824 {{(pid=71229) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Received event <DeviceRemovedEvent: 1681226610.5708153, 2b2c294d-49b2-41bf-89d0-17a560e7741f => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71229) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-86781472-0df0-4f47-b538-2a745271625c tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 2b2c294d-49b2-41bf-89d0-17a560e7741f {{(pid=71229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 15:23:30 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-86781472-0df0-4f47-b538-2a745271625c tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Successfully detached device sdc from instance 2b2c294d-49b2-41bf-89d0-17a560e7741f from the live domain config.
Apr 11 15:23:30 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86781472-0df0-4f47-b538-2a745271625c tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-86781472-0df0-4f47-b538-2a745271625c tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:f1eaab93-85f1-49cd-a6c4-4c499c77d2c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eqAxpQUN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:23:30 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-86781472-0df0-4f47-b538-2a745271625c tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:23:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-86781472-0df0-4f47-b538-2a745271625c tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-86781472-0df0-4f47-b538-2a745271625c tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[012683e3-feeb-4cb7-8be9-0c1b51abdd38]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f1eaab93-85f1-49cd-a6c4-4c499c77d2c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-86781472-0df0-4f47-b538-2a745271625c tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 15:23:30 user nova-compute[71229]: No targets found.
Apr 11 15:23:30 user nova-compute[71229]: iSNS:
Apr 11 15:23:30 user nova-compute[71229]: No targets found.
Apr 11 15:23:30 user nova-compute[71229]: STATIC:
Apr 11 15:23:30 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26
Apr 11 15:23:30 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:23:30 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:23:30 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d
Apr 11 15:23:30 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:23:30 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:23:30 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c
Apr 11 15:23:30 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:23:30 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:23:30 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:f1eaab93-85f1-49cd-a6c4-4c499c77d2c9
Apr 11 15:23:30 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:23:30 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:23:30 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487
Apr 11 15:23:30 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:23:30 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:23:30 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c
Apr 11 15:23:30 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:23:30 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:23:30 user nova-compute[71229]: FIRMWARE:
Apr 11 15:23:30 user nova-compute[71229]: No targets found.
Apr 11 15:23:30 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-86781472-0df0-4f47-b538-2a745271625c tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 15:23:30 user nova-compute[71229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 15:23:30 user nova-compute[71229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71229) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-86781472-0df0-4f47-b538-2a745271625c tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1eaab93-85f1-49cd-a6c4-4c499c77d2c9', 0)] {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21c703f-8759-4476-8831-b82926e9f176]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1eaab93-85f1-49cd-a6c4-4c499c77d2c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca617739-9a6d-44e0-93ec-999a135b71b9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1eaab93-85f1-49cd-a6c4-4c499c77d2c9 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-86781472-0df0-4f47-b538-2a745271625c tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1eaab93-85f1-49cd-a6c4-4c499c77d2c9 (non-flash)
Apr 11 15:23:30 user nova-compute[71229]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)
Apr 11 15:23:30 user nova-compute[71229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)
Apr 11 15:23:30 user nova-compute[71229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)
Apr 11 15:23:30 user nova-compute[71229]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 (non-flash)
Apr 11 15:23:30 user nova-compute[71229]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c (non-flash)
Apr 11 15:23:30 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-86781472-0df0-4f47-b538-2a745271625c tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1eaab93-85f1-49cd-a6c4-4c499c77d2c9 (non-flash)
Apr 11 15:23:30 user nova-compute[71229]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)
Apr 11 15:23:30 user nova-compute[71229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)
Apr 11 15:23:30 user nova-compute[71229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)
Apr 11 15:23:30 user nova-compute[71229]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 (non-flash)
Apr 11 15:23:30 user nova-compute[71229]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c (non-flash)
Apr 11 15:23:30 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-86781472-0df0-4f47-b538-2a745271625c tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb69ded990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1eaab93-85f1-49cd-a6c4-4c499c77d2c9'): ({'sdg'}, set())}) {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-86781472-0df0-4f47-b538-2a745271625c tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Removing single pathed devices sdg {{(pid=71229) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d324e8-e512-482a-a26b-fc190f067103]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[591ec9e4-40d0-4c71-baae-cf566155417c]: (4, ('ok\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-86781472-0df0-4f47-b538-2a745271625c tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Flushing IO for device /dev/sdg {{(pid=71229) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff9550d-3119-4eef-baa0-1710299e3a0b]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-86781472-0df0-4f47-b538-2a745271625c tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71229) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71229) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.031s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9e3bd6-214b-4fe8-944e-2ba8723dc37b]: (4, ('1', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-86781472-0df0-4f47-b538-2a745271625c tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-86781472-0df0-4f47-b538-2a745271625c tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] SCSI volumes sdg have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-86781472-0df0-4f47-b538-2a745271625c tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1eaab93-85f1-49cd-a6c4-4c499c77d2c9')] {{(pid=71229) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1eaab93-85f1-49cd-a6c4-4c499c77d2c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1eaab93-85f1-49cd-a6c4-4c499c77d2c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[661d64c5-09ce-4892-a628-bd6a97caa7d3]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-86781472-0df0-4f47-b538-2a745271625c tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1eaab93-85f1-49cd-a6c4-4c499c77d2c9 -p 172.16.0.220:3260 --logout {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1eaab93-85f1-49cd-a6c4-4c499c77d2c9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[62beebd8-0ff5-4147-9746-a60cf1956ae2]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:f1eaab93-85f1-49cd-a6c4-4c499c77d2c9, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:f1eaab93-85f1-49cd-a6c4-4c499c77d2c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-86781472-0df0-4f47-b538-2a745271625c tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:f1eaab93-85f1-49cd-a6c4-4c499c77d2c9, portal: 172.16.0.220,3260]
Apr 11 15:23:30 user nova-compute[71229]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:f1eaab93-85f1-49cd-a6c4-4c499c77d2c9, portal: 172.16.0.220,3260] successful.
Apr 11 15:23:30 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1eaab93-85f1-49cd-a6c4-4c499c77d2c9 -p 172.16.0.220:3260 --op delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tKFecpPZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:23:30 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:23:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1eaab93-85f1-49cd-a6c4-4c499c77d2c9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d27549-3200-45cf-8be4-102d7e30ee66]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-86781472-0df0-4f47-b538-2a745271625c tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-86781472-0df0-4f47-b538-2a745271625c tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-86781472-0df0-4f47-b538-2a745271625c tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] <== disconnect_volume: return (305ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86781472-0df0-4f47-b538-2a745271625c tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.009s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c838ffa-67b9-4748-bfbc-6927f61f23e4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 15:23:30 user nova-compute[71229]: No targets found.
Apr 11 15:23:30 user nova-compute[71229]: iSNS:
Apr 11 15:23:30 user nova-compute[71229]: No targets found.
Apr 11 15:23:30 user nova-compute[71229]: STATIC:
Apr 11 15:23:30 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26
Apr 11 15:23:30 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:23:30 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:23:30 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d
Apr 11 15:23:30 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:23:30 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:23:30 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c
Apr 11 15:23:30 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:23:30 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:23:30 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487
Apr 11 15:23:30 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:23:30 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:23:30 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c
Apr 11 15:23:30 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:23:30 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:23:30 user nova-compute[71229]: FIRMWARE:
Apr 11 15:23:30 user nova-compute[71229]: No targets found.
Apr 11 15:23:30 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 15:23:30 user nova-compute[71229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 15:23:30 user nova-compute[71229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71229) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26', 0)] {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a0dbaf-a165-4f80-9302-433db93250ba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba1d302-11fb-4bd8-a597-0b99e2ad87d1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)
Apr 11 15:23:30 user nova-compute[71229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)
Apr 11 15:23:30 user nova-compute[71229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)
Apr 11 15:23:30 user nova-compute[71229]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 (non-flash)
Apr 11 15:23:30 user nova-compute[71229]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c (non-flash)
Apr 11 15:23:30 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)
Apr 11 15:23:30 user nova-compute[71229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)
Apr 11 15:23:30 user nova-compute[71229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)
Apr 11 15:23:30 user nova-compute[71229]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 (non-flash)
Apr 11 15:23:30 user nova-compute[71229]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c (non-flash)
Apr 11 15:23:30 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb5c27dea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26'): ({'sde'}, set())}) {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Removing single pathed devices sde {{(pid=71229) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[02446f56-2c81-4b54-9d27-832334d15e36]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:31 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:31 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b8929c-f41f-4e90-a37c-30e90a714011]: (4, ('ok\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:31 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Flushing IO for device /dev/sde {{(pid=71229) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 15:23:31 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:31 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:31 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[83254285-17af-4eb0-b521-0532f452c951]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:31 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71229) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 15:23:31 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:31 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:31 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6177d217-9690-4552-ba36-bd93cdce6dd6]: (4, ('1', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:31 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 15:23:31 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] SCSI volumes sde have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 15:23:31 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26')] {{(pid=71229) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 15:23:31 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:31 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:31 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[671a1668-e84a-448c-8907-8670a5cce0bf]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:31 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:31 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 -p 172.16.0.220:3260 --logout {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:31 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:31 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fdc66a-112e-4f1a-b2f0-604bd31e7eba]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:31 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26, portal: 172.16.0.220,3260]
Apr 11 15:23:31 user nova-compute[71229]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26, portal: 172.16.0.220,3260] successful.
Apr 11 15:23:31 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:31 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 -p 172.16.0.220:3260 --op delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:31 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:31 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b96bb8-51a2-44be-8918-8b1f488d519e]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:31 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:31 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:23:31 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] <== disconnect_volume: return (325ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:23:31 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 15:23:31 user nova-compute[71229]: DEBUG nova.compute.manager [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KnDtHpAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '8d84862f-b710-48b1-9275-93fc799cf1f9', 'attached_at': '', 'detached_at': '', 'volume_id': '33e46e47-d157-4f4d-b7cf-96f42888f78c', 'serial'} {{(pid=71229) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 11 15:23:31 user nova-compute[71229]: DEBUG nova.compute.manager [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] swap_volume: removing Cinder connection for volume 761a1221-3eec-47f9-8a05-9eb545bede26 {{(pid=71229) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 11 15:23:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:31 user nova-compute[71229]: DEBUG nova.objects.instance [None req-86781472-0df0-4f47-b538-2a745271625c tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lazy-loading 'flavor' on Instance uuid 2b2c294d-49b2-41bf-89d0-17a560e7741f {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:23:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-86781472-0df0-4f47-b538-2a745271625c tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "2b2c294d-49b2-41bf-89d0-17a560e7741f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.805s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:23:32 user nova-compute[71229]: DEBUG nova.compute.manager [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] swap_volume: Updating volume 761a1221-3eec-47f9-8a05-9eb545bede26 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "KnDtHpAV", "auth_password": "Pb5fiVDBNMc9gt", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "33e46e47-d157-4f4d-b7cf-96f42888f78c"}, "status": "reserved", "instance": "8d84862f-b710-48b1-9275-93fc799cf1f9", "attached_at": "", "detached_at": "", "volume_id": "33e46e47-d157-4f4d-b7cf-96f42888f78c", "serial": "33e46e47-d157-4f4d-b7cf-96f42888f78c"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '33e46e47-d157-4f4d-b7cf-96f42888f78c', 'no_device': None, 'attachment_id': '2ae5b472-d209-4b45-85d7-d694bfe35789'} {{(pid=71229) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 11 15:23:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-566e267c-543c-4256-8e81-1bf0461a4086 tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Lock "8d84862f-b710-48b1-9275-93fc799cf1f9" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 11.240s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:23:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-e7c8e414-156d-4743-9ff4-7a078cf0e5bd tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Acquiring lock "2b2c294d-49b2-41bf-89d0-17a560e7741f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-e7c8e414-156d-4743-9ff4-7a078cf0e5bd tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "2b2c294d-49b2-41bf-89d0-17a560e7741f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-e7c8e414-156d-4743-9ff4-7a078cf0e5bd tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Acquiring lock "2b2c294d-49b2-41bf-89d0-17a560e7741f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-e7c8e414-156d-4743-9ff4-7a078cf0e5bd tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "2b2c294d-49b2-41bf-89d0-17a560e7741f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-e7c8e414-156d-4743-9ff4-7a078cf0e5bd tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "2b2c294d-49b2-41bf-89d0-17a560e7741f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:23:32 user nova-compute[71229]: INFO nova.compute.manager [None req-e7c8e414-156d-4743-9ff4-7a078cf0e5bd tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Terminating instance
Apr 11 15:23:32 user nova-compute[71229]: DEBUG nova.compute.manager [None req-e7c8e414-156d-4743-9ff4-7a078cf0e5bd tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Start destroying the instance on the hypervisor. {{(pid=71229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 15:23:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:32 user nova-compute[71229]: DEBUG nova.compute.manager [req-716d334e-f07f-4c90-a882-af95592b0a2e req-02e073d3-bccd-436d-b78c-e346aca518fe service nova] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Received event network-vif-unplugged-41b19aaa-a4cf-494a-97e9-c3a081d24d80 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:23:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-716d334e-f07f-4c90-a882-af95592b0a2e req-02e073d3-bccd-436d-b78c-e346aca518fe service nova] Acquiring lock "2b2c294d-49b2-41bf-89d0-17a560e7741f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-716d334e-f07f-4c90-a882-af95592b0a2e req-02e073d3-bccd-436d-b78c-e346aca518fe service nova] Lock "2b2c294d-49b2-41bf-89d0-17a560e7741f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-716d334e-f07f-4c90-a882-af95592b0a2e req-02e073d3-bccd-436d-b78c-e346aca518fe service nova] Lock "2b2c294d-49b2-41bf-89d0-17a560e7741f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:23:32 user nova-compute[71229]: DEBUG nova.compute.manager [req-716d334e-f07f-4c90-a882-af95592b0a2e req-02e073d3-bccd-436d-b78c-e346aca518fe service nova] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] No waiting events found dispatching network-vif-unplugged-41b19aaa-a4cf-494a-97e9-c3a081d24d80 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:23:32 user nova-compute[71229]: DEBUG nova.compute.manager [req-716d334e-f07f-4c90-a882-af95592b0a2e req-02e073d3-bccd-436d-b78c-e346aca518fe service nova] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Received event network-vif-unplugged-41b19aaa-a4cf-494a-97e9-c3a081d24d80 for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 15:23:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Acquiring lock "8d84862f-b710-48b1-9275-93fc799cf1f9" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Lock "8d84862f-b710-48b1-9275-93fc799cf1f9" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:33 user nova-compute[71229]: DEBUG os_brick.utils [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:23:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:33 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b557d7d-911a-4917-8550-ca56e8294abf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d55e24a97c90\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:33 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[22920b2a-24e0-42f6-b2ed-67f4f8f7cc2c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:33 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1f0eeb-03f8-486b-bea2-025c083e2554]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:33 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[663d889b-7f6a-4f15-a89d-505617f7dd96]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Running cmd (subprocess): nvme version {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:23:33 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] nvme not present on system {{(pid=71229) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 15:23:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:23:33 user nova-compute[71229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 15:23:33 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d741bd-fae1-4f61-98f7-c1e0e9383ec5]: (4, '') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:33 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71229) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 15:23:33 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 15:23:33 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] LIGHTOS: no hostnqn found. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 15:23:33 user nova-compute[71229]: DEBUG os_brick.utils [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d55e24a97c90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:23:33 user nova-compute[71229]: INFO nova.compute.manager [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Swapping volume 33e46e47-d157-4f4d-b7cf-96f42888f78c for 761a1221-3eec-47f9-8a05-9eb545bede26
Apr 11 15:23:33 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Instance destroyed successfully.
Apr 11 15:23:33 user nova-compute[71229]: DEBUG nova.objects.instance [None req-e7c8e414-156d-4743-9ff4-7a078cf0e5bd tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lazy-loading 'resources' on Instance uuid 2b2c294d-49b2-41bf-89d0-17a560e7741f {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:23:33 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-e7c8e414-156d-4743-9ff4-7a078cf0e5bd tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T15:21:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1731751351',display_name='tempest-AttachSCSIVolumeTestJSON-server-1731751351',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1731751351',id=7,image_ref='3e614d46-369e-4f7d-9d40-f3e9759f60f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFG+zxkXnTpf+p02vM4Xm045ubcRVkYMQB82y2IimhiNqNrzMiV7JBv5D8QDKrCrIsbmJVrkWShxDADZaCrqirBShJpvYeU0v7+/LyAPe6u+e6K/qaIcS7cSvQZjtrOk2A==',key_name='tempest-keypair-1093697918',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:21:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7e67f7203b1849c0af305f88ad8284f9',ramdisk_id='',reservation_id='r-fwwk8bcs',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3e614d46-369e-4f7d-9d40-f3e9759f60f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-19713134',owner_user_name='tempest-AttachSCSIVolumeTestJSON-19713134-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:21:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cab8ba2ebb8643a59d3a8a821cd1c2f1',uuid=2b2c294d-49b2-41bf-89d0-17a560e7741f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41b19aaa-a4cf-494a-97e9-c3a081d24d80", "address": "fa:16:3e:ce:80:c4", "network": {"id": "5709c284-0131-449d-869b-bfcf88bbe239", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-578269461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e67f7203b1849c0af305f88ad8284f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41b19aaa-a4", "ovs_interfaceid": "41b19aaa-a4cf-494a-97e9-c3a081d24d80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:23:33 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-e7c8e414-156d-4743-9ff4-7a078cf0e5bd tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Converting VIF {"id": "41b19aaa-a4cf-494a-97e9-c3a081d24d80", "address": "fa:16:3e:ce:80:c4", "network": {"id": "5709c284-0131-449d-869b-bfcf88bbe239", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-578269461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e67f7203b1849c0af305f88ad8284f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41b19aaa-a4", "ovs_interfaceid": "41b19aaa-a4cf-494a-97e9-c3a081d24d80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:23:33 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-e7c8e414-156d-4743-9ff4-7a078cf0e5bd tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:80:c4,bridge_name='br-int',has_traffic_filtering=True,id=41b19aaa-a4cf-494a-97e9-c3a081d24d80,network=Network(5709c284-0131-449d-869b-bfcf88bbe239),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41b19aaa-a4') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:23:33 user nova-compute[71229]: DEBUG os_vif [None req-e7c8e414-156d-4743-9ff4-7a078cf0e5bd tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:80:c4,bridge_name='br-int',has_traffic_filtering=True,id=41b19aaa-a4cf-494a-97e9-c3a081d24d80,network=Network(5709c284-0131-449d-869b-bfcf88bbe239),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41b19aaa-a4') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:23:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap41b19aaa-a4, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:23:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:23:33 user nova-compute[71229]: INFO os_vif [None req-e7c8e414-156d-4743-9ff4-7a078cf0e5bd tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:80:c4,bridge_name='br-int',has_traffic_filtering=True,id=41b19aaa-a4cf-494a-97e9-c3a081d24d80,network=Network(5709c284-0131-449d-869b-bfcf88bbe239),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41b19aaa-a4')
Apr 11 15:23:33 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-e7c8e414-156d-4743-9ff4-7a078cf0e5bd tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Deleting instance files /opt/stack/data/nova/instances/2b2c294d-49b2-41bf-89d0-17a560e7741f_del
Apr 11 15:23:33 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-e7c8e414-156d-4743-9ff4-7a078cf0e5bd tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Deletion of /opt/stack/data/nova/instances/2b2c294d-49b2-41bf-89d0-17a560e7741f_del complete
Apr 11 15:23:33 user nova-compute[71229]: INFO nova.compute.manager [None req-e7c8e414-156d-4743-9ff4-7a078cf0e5bd tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 11 15:23:33 user nova-compute[71229]: DEBUG oslo.service.loopingcall [None req-e7c8e414-156d-4743-9ff4-7a078cf0e5bd tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71229) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 15:23:33 user nova-compute[71229]: DEBUG nova.compute.manager [-] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Deallocating network for instance {{(pid=71229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 15:23:33 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] deallocate_for_instance() {{(pid=71229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 15:23:34 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:23:34 user nova-compute[71229]: DEBUG nova.compute.manager [req-124e157e-6c9b-49dd-8d73-fdf969599509 req-f2722378-c7bf-464d-8d1d-7ac18eea6be5 service nova] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Received event network-vif-deleted-41b19aaa-a4cf-494a-97e9-c3a081d24d80 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:23:34 user nova-compute[71229]: INFO nova.compute.manager [req-124e157e-6c9b-49dd-8d73-fdf969599509 req-f2722378-c7bf-464d-8d1d-7ac18eea6be5 service nova] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Neutron deleted interface 41b19aaa-a4cf-494a-97e9-c3a081d24d80; detaching it from the instance and deleting it from the info cache
Apr 11 15:23:34 user nova-compute[71229]: DEBUG nova.network.neutron [req-124e157e-6c9b-49dd-8d73-fdf969599509 req-f2722378-c7bf-464d-8d1d-7ac18eea6be5 service nova] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:23:34 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Took 0.93 seconds to deallocate network for instance.
Apr 11 15:23:34 user nova-compute[71229]: DEBUG nova.compute.manager [req-124e157e-6c9b-49dd-8d73-fdf969599509 req-f2722378-c7bf-464d-8d1d-7ac18eea6be5 service nova] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Detach interface failed, port_id=41b19aaa-a4cf-494a-97e9-c3a081d24d80, reason: Instance 2b2c294d-49b2-41bf-89d0-17a560e7741f could not be found. {{(pid=71229) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 15:23:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-e7c8e414-156d-4743-9ff4-7a078cf0e5bd tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-e7c8e414-156d-4743-9ff4-7a078cf0e5bd tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:34 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-e7c8e414-156d-4743-9ff4-7a078cf0e5bd tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:23:34 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-e7c8e414-156d-4743-9ff4-7a078cf0e5bd tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:23:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-e7c8e414-156d-4743-9ff4-7a078cf0e5bd tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.266s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:23:34 user nova-compute[71229]: INFO nova.scheduler.client.report [None req-e7c8e414-156d-4743-9ff4-7a078cf0e5bd tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Deleted allocations for instance 2b2c294d-49b2-41bf-89d0-17a560e7741f
Apr 11 15:23:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-e7c8e414-156d-4743-9ff4-7a078cf0e5bd tempest-AttachSCSIVolumeTestJSON-19713134 tempest-AttachSCSIVolumeTestJSON-19713134-project-member] Lock "2b2c294d-49b2-41bf-89d0-17a560e7741f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.247s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:23:34 user nova-compute[71229]: DEBUG nova.compute.manager [req-8e197f36-1694-4a85-bfce-d228fe6a0a42 req-3594471a-3417-46ca-bef1-c96097c37d8a service nova] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Received event network-vif-plugged-41b19aaa-a4cf-494a-97e9-c3a081d24d80 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:23:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-8e197f36-1694-4a85-bfce-d228fe6a0a42 req-3594471a-3417-46ca-bef1-c96097c37d8a service nova] Acquiring lock "2b2c294d-49b2-41bf-89d0-17a560e7741f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-8e197f36-1694-4a85-bfce-d228fe6a0a42 req-3594471a-3417-46ca-bef1-c96097c37d8a service nova] Lock "2b2c294d-49b2-41bf-89d0-17a560e7741f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-8e197f36-1694-4a85-bfce-d228fe6a0a42 req-3594471a-3417-46ca-bef1-c96097c37d8a service nova] Lock "2b2c294d-49b2-41bf-89d0-17a560e7741f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:23:34 user nova-compute[71229]: DEBUG nova.compute.manager [req-8e197f36-1694-4a85-bfce-d228fe6a0a42 req-3594471a-3417-46ca-bef1-c96097c37d8a service nova] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] No waiting events found dispatching network-vif-plugged-41b19aaa-a4cf-494a-97e9-c3a081d24d80 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:23:34 user nova-compute[71229]: WARNING nova.compute.manager [req-8e197f36-1694-4a85-bfce-d228fe6a0a42 req-3594471a-3417-46ca-bef1-c96097c37d8a service nova] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Received unexpected event network-vif-plugged-41b19aaa-a4cf-494a-97e9-c3a081d24d80 for instance with vm_state deleted and task_state None.
Apr 11 15:23:37 user nova-compute[71229]: DEBUG nova.compute.manager [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tKFecpPZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8d84862f-b710-48b1-9275-93fc799cf1f9', 'attached_at': '', 'detached_at': '', 'volume_id': '761a1221-3eec-47f9-8a05-9eb545bede26', 'serial': '761a1221-3eec-47f9-8a05-9eb545bede26'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KnDtHpAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '33e46e47-d157-4f4d-b7cf-96f42888f78c'}, 'status': 'reserved', 'instance': '8d84862f-b710-48b1-9275-93fc799cf1f9', 'attached_at': '', 'detached_at': '', 'volume_id': '33e46e47-d157-4f4d-b7cf-96f42888f78c', 'serial'} {{(pid=71229) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tKFecpPZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:23:37 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:23:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:23:37 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:23:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:23:37 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 15:23:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d624043a-3e52-4634-a195-db00d9d19d06]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 15:23:37 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 -p 172.16.0.220:3260 --interface default --op new {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc6cf6d-9d37-44b9-b447-7d74eb276b17]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26] added\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26] added
Apr 11 15:23:37 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f30cf0-2aec-49d2-8740-40c91697bd39]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25d2ff9-d573-42ed-bcda-b2c322378595]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tKFecpPZ {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tKFecpPZ" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5dc3cfb-81c9-4cd8-866c-b23534161a67]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tKFecpPZ'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f28d12-962e-4a1a-8826-a15164197eb3]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e84cabe-73d1-43b0-b5e7-aba06e5935e1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)
Apr 11 15:23:37 user nova-compute[71229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)
Apr 11 15:23:37 user nova-compute[71229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)
Apr 11 15:23:37 user nova-compute[71229]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c (non-flash)
Apr 11 15:23:37 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)
Apr 11 15:23:37 user nova-compute[71229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)
Apr 11 15:23:37 user nova-compute[71229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)
Apr 11 15:23:37 user nova-compute[71229]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c (non-flash)
Apr 11 15:23:37 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 -p 172.16.0.220:3260 --login {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdacc12-a08e-4a2b-9b38-5a1589464fc4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26, portal: 172.16.0.220,3260]
Apr 11 15:23:37 user nova-compute[71229]: Login to [iface: default, target: iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26, portal: 172.16.0.220,3260] successful.
Apr 11 15:23:37 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dfe4eb9-ecfe-4baf-8555-e421f9d81f03]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b15494-d49e-4683-866b-b451edcee182]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 (non-flash)
Apr 11 15:23:37 user nova-compute[71229]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)
Apr 11 15:23:37 user nova-compute[71229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)
Apr 11 15:23:37 user nova-compute[71229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)
Apr 11 15:23:37 user nova-compute[71229]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c (non-flash)
Apr 11 15:23:37 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 (non-flash)
Apr 11 15:23:37 user nova-compute[71229]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)
Apr 11 15:23:37 user nova-compute[71229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)
Apr 11 15:23:37 user nova-compute[71229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)
Apr 11 15:23:37 user nova-compute[71229]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c (non-flash)
Apr 11 15:23:37 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] HCTL ('36', '-', '-', 0) found on session 11 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb7eb81-b8cd-49f2-904d-c94caf18bf63]: (4, ('- - 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:37 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Searching for a device in session 11 and hctl ['36', '*', '*', 0] yield: None {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:23:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:38 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Searching for a device in session 11 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:23:38 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tKFecpPZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 15:23:38 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:23:38 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23234623061393439', 'path': '/dev/sde'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:23:38 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234623061393439', 'path': '/dev/sde'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 15:23:38 user nova-compute[71229]: DEBUG nova.objects.instance [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Lazy-loading 'flavor' on Instance uuid 8d84862f-b710-48b1-9275-93fc799cf1f9 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:23:39 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] COPY block job progress, current cursor: 6291456 final cursor: 1073741824 {{(pid=71229) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 15:23:39 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] COPY block job progress, current cursor: 117440512 final cursor: 1073741824 {{(pid=71229) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 15:23:39 user nova-compute[71229]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681226604.6173434, 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea => Stopped> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:23:39 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] VM Stopped (Lifecycle Event)
Apr 11 15:23:39 user nova-compute[71229]: DEBUG nova.compute.manager [None req-42b559a0-e1e8-4251-9c2b-80b84cdb9fe6 None None] [instance: 3bd4e3ea-2df2-48f8-96bd-8f8219c73bea] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:23:40 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] COPY block job progress, current cursor: 277872640 final cursor: 1073741824 {{(pid=71229) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 15:23:40 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] COPY block job progress, current cursor: 467664896 final cursor: 1073741824 {{(pid=71229) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 15:23:41 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] COPY block job progress, current cursor: 676331520 final cursor: 1073741824 {{(pid=71229) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 15:23:41 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] COPY block job progress, current cursor: 855638016 final cursor: 1073741824 {{(pid=71229) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 15:23:42 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] COPY block job progress, current cursor: 1041235968 final cursor: 1073741824 {{(pid=71229) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 15:23:42 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71229) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 15:23:42 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 15:23:42 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KnDtHpAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '33e46e47-d157-4f4d-b7cf-96f42888f78c': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:23:42 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:23:42 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:23:42 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:23:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:42 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3fd66d-751d-46ba-bc34-bf5f2a79ba31]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:42 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 15:23:42 user nova-compute[71229]: No targets found.
Apr 11 15:23:42 user nova-compute[71229]: iSNS:
Apr 11 15:23:42 user nova-compute[71229]: No targets found.
Apr 11 15:23:42 user nova-compute[71229]: STATIC:
Apr 11 15:23:42 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26
Apr 11 15:23:42 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:23:42 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:23:42 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d
Apr 11 15:23:42 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:23:42 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:23:42 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c
Apr 11 15:23:42 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:23:42 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:23:42 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487
Apr 11 15:23:42 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:23:42 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:23:42 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c
Apr 11 15:23:42 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:23:42 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:23:42 user nova-compute[71229]: FIRMWARE:
Apr 11 15:23:42 user nova-compute[71229]: No targets found.
Apr 11 15:23:42 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:23:42 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 15:23:42 user nova-compute[71229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 15:23:42 user nova-compute[71229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71229) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 15:23:42 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c', 0)] {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 15:23:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:42 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce5301f-9aed-4c9a-9435-41c2fa959531]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:42 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[876b4bfa-39ac-402d-a89c-2457f2a57dc4]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:42 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 (non-flash)
Apr 11 15:23:42 user nova-compute[71229]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)
Apr 11 15:23:42 user nova-compute[71229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)
Apr 11 15:23:42 user nova-compute[71229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)
Apr 11 15:23:42 user nova-compute[71229]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c (non-flash)
Apr 11 15:23:42 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:23:42 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 (non-flash)
Apr 11 15:23:42 user nova-compute[71229]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)
Apr 11 15:23:42 user nova-compute[71229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)
Apr 11 15:23:42 user nova-compute[71229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)
Apr 11 15:23:42 user nova-compute[71229]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c (non-flash)
Apr 11 15:23:42 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:23:42 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb5c3abeb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c'): ({'sdf'}, set())}) {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 15:23:42 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Removing single pathed devices sdf {{(pid=71229) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 15:23:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:42 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3682a186-8952-4936-b296-52b9c7399fb7]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:42 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[779e3673-d5dd-4883-bacb-27d5447bca11]: (4, ('ok\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:42 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Flushing IO for device /dev/sdf {{(pid=71229) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 15:23:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:42 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd02b9f-ea10-4180-a7b0-5dba0b036afb]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:42 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71229) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 15:23:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:42 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb2969c-ba5c-4a6c-9ac9-e7a7ce6ff7d7]: (4, ('1', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:42 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 15:23:42 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] SCSI volumes sdf have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 15:23:42 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c')] {{(pid=71229) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 15:23:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:42 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ac51e7-1d80-450c-b067-ac6642436b2f]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:42 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c -p 172.16.0.220:3260 --logout {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:42 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6c45b5-f1c9-4870-af13-35e723b2ddd3]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:42 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c, portal: 172.16.0.220,3260]
Apr 11 15:23:42 user nova-compute[71229]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c, portal: 172.16.0.220,3260] successful.
Apr 11 15:23:42 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c -p 172.16.0.220:3260 --op delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33e46e47-d157-4f4d-b7cf-96f42888f78c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:43 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fe66d8-5d30-4534-9301-716d6559cea2]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:43 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:43 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:23:43 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] <== disconnect_volume: return (302ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:23:43 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 15:23:43 user nova-compute[71229]: DEBUG nova.compute.manager [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tKFecpPZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '8d84862f-b710-48b1-9275-93fc799cf1f9', 'attached_at': '', 'detached_at': '', 'volume_id': '761a1221-3eec-47f9-8a05-9eb545bede26', 'serial'} {{(pid=71229) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 11 15:23:43 user nova-compute[71229]: DEBUG nova.compute.manager [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] swap_volume: removing Cinder connection for volume 33e46e47-d157-4f4d-b7cf-96f42888f78c {{(pid=71229) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 11 15:23:43 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:23:43 user nova-compute[71229]: DEBUG nova.compute.manager [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] swap_volume: Updating volume 33e46e47-d157-4f4d-b7cf-96f42888f78c BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "tKFecpPZ", "auth_password": "WOt95CfkcSx6BF", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "761a1221-3eec-47f9-8a05-9eb545bede26"}, "status": "reserved", "instance": "8d84862f-b710-48b1-9275-93fc799cf1f9", "attached_at": "", "detached_at": "", "volume_id": "761a1221-3eec-47f9-8a05-9eb545bede26", "serial": "761a1221-3eec-47f9-8a05-9eb545bede26"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '761a1221-3eec-47f9-8a05-9eb545bede26', 'no_device': None, 'attachment_id': '0a606ff5-8d89-4544-a6ff-d3ab7b3a788b'} {{(pid=71229) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 11 15:23:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8dc5f160-8d86-4cb0-8120-33c91b9ca57c tempest-TestVolumeSwap-909138511 tempest-TestVolumeSwap-909138511-project-admin] Lock "8d84862f-b710-48b1-9275-93fc799cf1f9" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 10.761s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:23:44 user nova-compute[71229]: DEBUG nova.compute.manager [req-09f8f58a-8a75-4cd0-8844-471ad8f92e28 req-1d6a817a-067b-4130-917e-227f6d8d9bab service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received event network-changed-ee21c1bf-90da-44fe-b6f2-26132b87c5ed {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:23:44 user nova-compute[71229]: DEBUG nova.compute.manager [req-09f8f58a-8a75-4cd0-8844-471ad8f92e28 req-1d6a817a-067b-4130-917e-227f6d8d9bab service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Refreshing instance network info cache due to event network-changed-ee21c1bf-90da-44fe-b6f2-26132b87c5ed. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:23:44 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-09f8f58a-8a75-4cd0-8844-471ad8f92e28 req-1d6a817a-067b-4130-917e-227f6d8d9bab service nova] Acquiring lock "refresh_cache-cda43d26-e2f7-4e86-b850-b914957c9b57" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:23:44 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-09f8f58a-8a75-4cd0-8844-471ad8f92e28 req-1d6a817a-067b-4130-917e-227f6d8d9bab service nova] Acquired lock "refresh_cache-cda43d26-e2f7-4e86-b850-b914957c9b57" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:23:44 user nova-compute[71229]: DEBUG nova.network.neutron [req-09f8f58a-8a75-4cd0-8844-471ad8f92e28 req-1d6a817a-067b-4130-917e-227f6d8d9bab service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Refreshing network info cache for port ee21c1bf-90da-44fe-b6f2-26132b87c5ed {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:23:45 user nova-compute[71229]: DEBUG nova.network.neutron [req-09f8f58a-8a75-4cd0-8844-471ad8f92e28 req-1d6a817a-067b-4130-917e-227f6d8d9bab service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Updated VIF entry in instance network info cache for port ee21c1bf-90da-44fe-b6f2-26132b87c5ed. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:23:45 user nova-compute[71229]: DEBUG nova.network.neutron [req-09f8f58a-8a75-4cd0-8844-471ad8f92e28 req-1d6a817a-067b-4130-917e-227f6d8d9bab service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Updating instance_info_cache with network_info: [{"id": "ee21c1bf-90da-44fe-b6f2-26132b87c5ed", "address": "fa:16:3e:3b:86:be", "network": {"id": "f10dfc9b-ad09-4bc9-9240-e6696b8f1b0e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-603478497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee21c1bf-90", "ovs_interfaceid": "ee21c1bf-90da-44fe-b6f2-26132b87c5ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2ac99ade-56b1-4865-b997-a9f8ef0a760b", "address": "fa:16:3e:b5:b8:ec", "network": {"id": "69cdc817-44c9-4420-acb7-e8aebab58bcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-667852060", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac99ade-56", "ovs_interfaceid": "2ac99ade-56b1-4865-b997-a9f8ef0a760b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "097c3cb1-bc8f-42c3-be49-73d500fdbc39", "address": "fa:16:3e:2b:4b:c2", "network": {"id": "69cdc817-44c9-4420-acb7-e8aebab58bcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-667852060", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap097c3cb1-bc", "ovs_interfaceid": "097c3cb1-bc8f-42c3-be49-73d500fdbc39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "65d1d6cb-a27f-4eae-822e-459770a9a587", "address": "fa:16:3e:02:0d:ff", "network": {"id": "69cdc817-44c9-4420-acb7-e8aebab58bcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-667852060", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d1d6cb-a2", "ovs_interfaceid": "65d1d6cb-a27f-4eae-822e-459770a9a587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9f2f28e-bb0a-4d1b-a831-e2c493521408", "address": "fa:16:3e:75:c7:7f", "network": {"id": "69cdc817-44c9-4420-acb7-e8aebab58bcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-667852060", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f2f28e-bb", "ovs_interfaceid": "d9f2f28e-bb0a-4d1b-a831-e2c493521408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6d794bc3-2136-4b88-92e5-4703eb113b6d", "address": "fa:16:3e:b0:b7:48", "network": {"id": "0065e8ee-5334-4ab3-8c58-6a2e6f9954f2", "bridge": "br-int", "label": "tempest-device-tagging-net2-447570772", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d794bc3-21", "ovs_interfaceid": "6d794bc3-2136-4b88-92e5-4703eb113b6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e9f0f991-6f64-45e6-9ce7-3f279f5ce31f", "address": "fa:16:3e:41:d4:9a", "network": {"id": "0065e8ee-5334-4ab3-8c58-6a2e6f9954f2", "bridge": "br-int", "label": "tempest-device-tagging-net2-447570772", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9f0f991-6f", "ovs_interfaceid": "e9f0f991-6f64-45e6-9ce7-3f279f5ce31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:23:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-09f8f58a-8a75-4cd0-8844-471ad8f92e28 req-1d6a817a-067b-4130-917e-227f6d8d9bab service nova] Releasing lock "refresh_cache-cda43d26-e2f7-4e86-b850-b914957c9b57" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:23:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-52a81fbe-e232-4093-9009-700afafcee18 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Acquiring lock "8d84862f-b710-48b1-9275-93fc799cf1f9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-52a81fbe-e232-4093-9009-700afafcee18 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "8d84862f-b710-48b1-9275-93fc799cf1f9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:45 user nova-compute[71229]: INFO nova.compute.manager [None req-52a81fbe-e232-4093-9009-700afafcee18 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Detaching volume 761a1221-3eec-47f9-8a05-9eb545bede26
Apr 11 15:23:45 user nova-compute[71229]: INFO nova.virt.block_device [None req-52a81fbe-e232-4093-9009-700afafcee18 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Attempting to driver detach volume 761a1221-3eec-47f9-8a05-9eb545bede26 from mountpoint /dev/vdb
Apr 11 15:23:45 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-52a81fbe-e232-4093-9009-700afafcee18 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Attempting to detach device vdb from instance 8d84862f-b710-48b1-9275-93fc799cf1f9 from the persistent domain config. {{(pid=71229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 15:23:45 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-52a81fbe-e232-4093-9009-700afafcee18 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 15:23:45 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:23:45 user nova-compute[71229]:   <source dev="/dev/sde"/>
Apr 11 15:23:45 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 15:23:45 user nova-compute[71229]:   <serial>761a1221-3eec-47f9-8a05-9eb545bede26</serial>
Apr 11 15:23:45 user nova-compute[71229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 15:23:45 user nova-compute[71229]: </disk>
Apr 11 15:23:45 user nova-compute[71229]:  {{(pid=71229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 15:23:45 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-52a81fbe-e232-4093-9009-700afafcee18 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Successfully detached device vdb from instance 8d84862f-b710-48b1-9275-93fc799cf1f9 from the persistent domain config.
Apr 11 15:23:45 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-52a81fbe-e232-4093-9009-700afafcee18 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8d84862f-b710-48b1-9275-93fc799cf1f9 from the live domain config. {{(pid=71229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 15:23:45 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-52a81fbe-e232-4093-9009-700afafcee18 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 15:23:45 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:23:45 user nova-compute[71229]:   <source dev="/dev/sde"/>
Apr 11 15:23:45 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 15:23:45 user nova-compute[71229]:   <serial>761a1221-3eec-47f9-8a05-9eb545bede26</serial>
Apr 11 15:23:45 user nova-compute[71229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 15:23:45 user nova-compute[71229]: </disk>
Apr 11 15:23:45 user nova-compute[71229]:  {{(pid=71229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 15:23:45 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Received event <DeviceRemovedEvent: 1681226625.8213086, 8d84862f-b710-48b1-9275-93fc799cf1f9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71229) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 15:23:45 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-52a81fbe-e232-4093-9009-700afafcee18 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8d84862f-b710-48b1-9275-93fc799cf1f9 {{(pid=71229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 15:23:45 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-52a81fbe-e232-4093-9009-700afafcee18 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Successfully detached device vdb from instance 8d84862f-b710-48b1-9275-93fc799cf1f9 from the live domain config.
Apr 11 15:23:45 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52a81fbe-e232-4093-9009-700afafcee18 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 15:23:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a81fbe-e232-4093-9009-700afafcee18 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tKFecpPZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': '761a1221-3eec-47f9-8a05-9eb545bede26': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:23:45 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-52a81fbe-e232-4093-9009-700afafcee18 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:23:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-52a81fbe-e232-4093-9009-700afafcee18 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:23:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-52a81fbe-e232-4093-9009-700afafcee18 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:23:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:45 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc47552-dcab-44f9-be79-2fb4b89a652f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a81fbe-e232-4093-9009-700afafcee18 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 15:23:45 user nova-compute[71229]: No targets found.
Apr 11 15:23:45 user nova-compute[71229]: iSNS:
Apr 11 15:23:45 user nova-compute[71229]: No targets found.
Apr 11 15:23:45 user nova-compute[71229]: STATIC:
Apr 11 15:23:45 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26
Apr 11 15:23:45 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:23:45 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:23:45 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d
Apr 11 15:23:45 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:23:45 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:23:45 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487
Apr 11 15:23:45 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:23:45 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:23:45 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c
Apr 11 15:23:45 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:23:45 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:23:45 user nova-compute[71229]: FIRMWARE:
Apr 11 15:23:45 user nova-compute[71229]: No targets found.
Apr 11 15:23:45 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:23:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a81fbe-e232-4093-9009-700afafcee18 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 15:23:45 user nova-compute[71229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 15:23:45 user nova-compute[71229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71229) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 15:23:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a81fbe-e232-4093-9009-700afafcee18 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26', 0)] {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 15:23:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:45 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5785aa-cac5-47af-aa51-80577943dcee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:45 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6820ec8c-88ff-4dbd-a132-26216064cf2d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a81fbe-e232-4093-9009-700afafcee18 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 (non-flash)
Apr 11 15:23:45 user nova-compute[71229]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)
Apr 11 15:23:45 user nova-compute[71229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)
Apr 11 15:23:45 user nova-compute[71229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)
Apr 11 15:23:45 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:23:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a81fbe-e232-4093-9009-700afafcee18 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 (non-flash)
Apr 11 15:23:45 user nova-compute[71229]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)
Apr 11 15:23:45 user nova-compute[71229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)
Apr 11 15:23:45 user nova-compute[71229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)
Apr 11 15:23:45 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:23:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a81fbe-e232-4093-9009-700afafcee18 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb5c19b0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26'): ({'sde'}, set())}) {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 15:23:45 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-52a81fbe-e232-4093-9009-700afafcee18 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Removing single pathed devices sde {{(pid=71229) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 15:23:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:45 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8c32de-fdde-49b0-b3a4-6008fc3815a6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:45 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[075d5e2a-d608-4f2e-b3a1-759ad9edc586]: (4, ('ok\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:45 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-52a81fbe-e232-4093-9009-700afafcee18 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Flushing IO for device /dev/sde {{(pid=71229) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 15:23:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:45 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[52744af3-1a5d-4f74-a953-b8bea0646f2b]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:45 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-52a81fbe-e232-4093-9009-700afafcee18 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71229) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 15:23:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08ba3b6-ac4a-43eb-8873-246754a0f62e]: (4, ('1', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-52a81fbe-e232-4093-9009-700afafcee18 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-52a81fbe-e232-4093-9009-700afafcee18 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] SCSI volumes sde have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a81fbe-e232-4093-9009-700afafcee18 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26')] {{(pid=71229) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a6fa05-f25a-4846-9cf7-ed28aeb4ddb7]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a81fbe-e232-4093-9009-700afafcee18 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 -p 172.16.0.220:3260 --logout {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Acquiring lock "cda43d26-e2f7-4e86-b850-b914957c9b57" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Acquiring lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:23:46 user nova-compute[71229]: INFO nova.compute.manager [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Terminating instance
Apr 11 15:23:46 user nova-compute[71229]: DEBUG nova.compute.manager [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Start destroying the instance on the hypervisor. {{(pid=71229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9d0529-338a-4429-8e4d-78a43ed6db01]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a81fbe-e232-4093-9009-700afafcee18 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26, portal: 172.16.0.220,3260]
Apr 11 15:23:46 user nova-compute[71229]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26, portal: 172.16.0.220,3260] successful.
Apr 11 15:23:46 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 -p 172.16.0.220:3260 --op delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:761a1221-3eec-47f9-8a05-9eb545bede26 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9313adc5-f983-45a6-83c0-64beeb48c7c7]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a81fbe-e232-4093-9009-700afafcee18 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-52a81fbe-e232-4093-9009-700afafcee18 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a81fbe-e232-4093-9009-700afafcee18 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] <== disconnect_volume: return (311ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52a81fbe-e232-4093-9009-700afafcee18 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG nova.compute.manager [req-59475931-8df3-461d-80f9-6397674dad9b req-cfd66b2e-a9b6-4972-9c74-44e4dacef10f service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received event network-vif-unplugged-ee21c1bf-90da-44fe-b6f2-26132b87c5ed {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-59475931-8df3-461d-80f9-6397674dad9b req-cfd66b2e-a9b6-4972-9c74-44e4dacef10f service nova] Acquiring lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-59475931-8df3-461d-80f9-6397674dad9b req-cfd66b2e-a9b6-4972-9c74-44e4dacef10f service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-59475931-8df3-461d-80f9-6397674dad9b req-cfd66b2e-a9b6-4972-9c74-44e4dacef10f service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG nova.compute.manager [req-59475931-8df3-461d-80f9-6397674dad9b req-cfd66b2e-a9b6-4972-9c74-44e4dacef10f service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] No waiting events found dispatching network-vif-unplugged-ee21c1bf-90da-44fe-b6f2-26132b87c5ed {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG nova.compute.manager [req-59475931-8df3-461d-80f9-6397674dad9b req-cfd66b2e-a9b6-4972-9c74-44e4dacef10f service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received event network-vif-unplugged-ee21c1bf-90da-44fe-b6f2-26132b87c5ed for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG nova.compute.manager [req-a7e2d0d3-e29c-4bc0-a080-63c6f02a672c req-43389355-26d8-44df-bf08-7b31ecaa6500 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received event network-vif-unplugged-2ac99ade-56b1-4865-b997-a9f8ef0a760b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a7e2d0d3-e29c-4bc0-a080-63c6f02a672c req-43389355-26d8-44df-bf08-7b31ecaa6500 service nova] Acquiring lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a7e2d0d3-e29c-4bc0-a080-63c6f02a672c req-43389355-26d8-44df-bf08-7b31ecaa6500 service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a7e2d0d3-e29c-4bc0-a080-63c6f02a672c req-43389355-26d8-44df-bf08-7b31ecaa6500 service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG nova.compute.manager [req-a7e2d0d3-e29c-4bc0-a080-63c6f02a672c req-43389355-26d8-44df-bf08-7b31ecaa6500 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] No waiting events found dispatching network-vif-unplugged-2ac99ade-56b1-4865-b997-a9f8ef0a760b {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG nova.compute.manager [req-a7e2d0d3-e29c-4bc0-a080-63c6f02a672c req-43389355-26d8-44df-bf08-7b31ecaa6500 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received event network-vif-unplugged-2ac99ade-56b1-4865-b997-a9f8ef0a760b for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:47 user nova-compute[71229]: DEBUG nova.compute.manager [req-fc72d3e5-a43e-462f-aa18-6435086cc8ab req-b68aeb05-72a3-47d7-9f92-70f5443b7867 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received event network-vif-unplugged-6d794bc3-2136-4b88-92e5-4703eb113b6d {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:23:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-fc72d3e5-a43e-462f-aa18-6435086cc8ab req-b68aeb05-72a3-47d7-9f92-70f5443b7867 service nova] Acquiring lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-fc72d3e5-a43e-462f-aa18-6435086cc8ab req-b68aeb05-72a3-47d7-9f92-70f5443b7867 service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-fc72d3e5-a43e-462f-aa18-6435086cc8ab req-b68aeb05-72a3-47d7-9f92-70f5443b7867 service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:23:47 user nova-compute[71229]: DEBUG nova.compute.manager [req-fc72d3e5-a43e-462f-aa18-6435086cc8ab req-b68aeb05-72a3-47d7-9f92-70f5443b7867 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] No waiting events found dispatching network-vif-unplugged-6d794bc3-2136-4b88-92e5-4703eb113b6d {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:23:47 user nova-compute[71229]: DEBUG nova.compute.manager [req-fc72d3e5-a43e-462f-aa18-6435086cc8ab req-b68aeb05-72a3-47d7-9f92-70f5443b7867 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received event network-vif-unplugged-6d794bc3-2136-4b88-92e5-4703eb113b6d for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 15:23:47 user nova-compute[71229]: DEBUG nova.objects.instance [None req-52a81fbe-e232-4093-9009-700afafcee18 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lazy-loading 'flavor' on Instance uuid 8d84862f-b710-48b1-9275-93fc799cf1f9 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:23:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-52a81fbe-e232-4093-9009-700afafcee18 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "8d84862f-b710-48b1-9275-93fc799cf1f9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.785s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:23:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:47 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Instance destroyed successfully.
Apr 11 15:23:47 user nova-compute[71229]: DEBUG nova.objects.instance [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lazy-loading 'resources' on Instance uuid cda43d26-e2f7-4e86-b850-b914957c9b57 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:23:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T15:21:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1171936509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1171936509',id=9,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPnuW6ogctwbnKiG/DdSHSi9VgV3vyQxSlprDZSCcAll42WGSndepoNq81o5lA3ENttdnb+uA8SJzEVin1fvRiPZ5AZG/PDhtEvtRNFaLWWnzYWXpsGmE8Y+m9wccFHrw==',key_name='tempest-keypair-1831001595',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:22:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e64015226c19441d87f3a6999a3a8db8',ramdisk_id='',reservation_id='r-u9ytaiu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-441311830',owner_user_name='tempest-TaggedBootDevicesTest_v242-441311830-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:22:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31d206ed111842fd95ce5eb5b3835a48',uuid=cda43d26-e2f7-4e86-b850-b914957c9b57,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee21c1bf-90da-44fe-b6f2-26132b87c5ed", "address": "fa:16:3e:3b:86:be", "network": {"id": "f10dfc9b-ad09-4bc9-9240-e6696b8f1b0e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-603478497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee21c1bf-90", "ovs_interfaceid": "ee21c1bf-90da-44fe-b6f2-26132b87c5ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:23:47 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Converting VIF {"id": "ee21c1bf-90da-44fe-b6f2-26132b87c5ed", "address": "fa:16:3e:3b:86:be", "network": {"id": "f10dfc9b-ad09-4bc9-9240-e6696b8f1b0e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-603478497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee21c1bf-90", "ovs_interfaceid": "ee21c1bf-90da-44fe-b6f2-26132b87c5ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:23:47 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:86:be,bridge_name='br-int',has_traffic_filtering=True,id=ee21c1bf-90da-44fe-b6f2-26132b87c5ed,network=Network(f10dfc9b-ad09-4bc9-9240-e6696b8f1b0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee21c1bf-90') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:23:47 user nova-compute[71229]: DEBUG os_vif [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:86:be,bridge_name='br-int',has_traffic_filtering=True,id=ee21c1bf-90da-44fe-b6f2-26132b87c5ed,network=Network(f10dfc9b-ad09-4bc9-9240-e6696b8f1b0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee21c1bf-90') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:23:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee21c1bf-90, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:23:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:23:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:47 user nova-compute[71229]: INFO os_vif [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:86:be,bridge_name='br-int',has_traffic_filtering=True,id=ee21c1bf-90da-44fe-b6f2-26132b87c5ed,network=Network(f10dfc9b-ad09-4bc9-9240-e6696b8f1b0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee21c1bf-90')
Apr 11 15:23:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T15:21:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1171936509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1171936509',id=9,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPnuW6ogctwbnKiG/DdSHSi9VgV3vyQxSlprDZSCcAll42WGSndepoNq81o5lA3ENttdnb+uA8SJzEVin1fvRiPZ5AZG/PDhtEvtRNFaLWWnzYWXpsGmE8Y+m9wccFHrw==',key_name='tempest-keypair-1831001595',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:22:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e64015226c19441d87f3a6999a3a8db8',ramdisk_id='',reservation_id='r-u9ytaiu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-441311830',owner_user_name='tempest-TaggedBootDevicesTest_v242-441311830-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:22:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31d206ed111842fd95ce5eb5b3835a48',uuid=cda43d26-e2f7-4e86-b850-b914957c9b57,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ac99ade-56b1-4865-b997-a9f8ef0a760b", "address": "fa:16:3e:b5:b8:ec", "network": {"id": "69cdc817-44c9-4420-acb7-e8aebab58bcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-667852060", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac99ade-56", "ovs_interfaceid": "2ac99ade-56b1-4865-b997-a9f8ef0a760b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:23:47 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Converting VIF {"id": "2ac99ade-56b1-4865-b997-a9f8ef0a760b", "address": "fa:16:3e:b5:b8:ec", "network": {"id": "69cdc817-44c9-4420-acb7-e8aebab58bcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-667852060", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac99ade-56", "ovs_interfaceid": "2ac99ade-56b1-4865-b997-a9f8ef0a760b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:23:47 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:b8:ec,bridge_name='br-int',has_traffic_filtering=True,id=2ac99ade-56b1-4865-b997-a9f8ef0a760b,network=Network(69cdc817-44c9-4420-acb7-e8aebab58bcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2ac99ade-56') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:23:47 user nova-compute[71229]: DEBUG os_vif [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:b8:ec,bridge_name='br-int',has_traffic_filtering=True,id=2ac99ade-56b1-4865-b997-a9f8ef0a760b,network=Network(69cdc817-44c9-4420-acb7-e8aebab58bcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2ac99ade-56') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:23:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ac99ade-56, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:23:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:23:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:47 user nova-compute[71229]: INFO os_vif [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:b8:ec,bridge_name='br-int',has_traffic_filtering=True,id=2ac99ade-56b1-4865-b997-a9f8ef0a760b,network=Network(69cdc817-44c9-4420-acb7-e8aebab58bcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2ac99ade-56')
Apr 11 15:23:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T15:21:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1171936509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1171936509',id=9,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPnuW6ogctwbnKiG/DdSHSi9VgV3vyQxSlprDZSCcAll42WGSndepoNq81o5lA3ENttdnb+uA8SJzEVin1fvRiPZ5AZG/PDhtEvtRNFaLWWnzYWXpsGmE8Y+m9wccFHrw==',key_name='tempest-keypair-1831001595',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:22:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e64015226c19441d87f3a6999a3a8db8',ramdisk_id='',reservation_id='r-u9ytaiu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-441311830',owner_user_name='tempest-TaggedBootDevicesTest_v242-441311830-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:22:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31d206ed111842fd95ce5eb5b3835a48',uuid=cda43d26-e2f7-4e86-b850-b914957c9b57,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "097c3cb1-bc8f-42c3-be49-73d500fdbc39", "address": "fa:16:3e:2b:4b:c2", "network": {"id": "69cdc817-44c9-4420-acb7-e8aebab58bcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-667852060", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap097c3cb1-bc", "ovs_interfaceid": "097c3cb1-bc8f-42c3-be49-73d500fdbc39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:23:47 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Converting VIF {"id": "097c3cb1-bc8f-42c3-be49-73d500fdbc39", "address": "fa:16:3e:2b:4b:c2", "network": {"id": "69cdc817-44c9-4420-acb7-e8aebab58bcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-667852060", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap097c3cb1-bc", "ovs_interfaceid": "097c3cb1-bc8f-42c3-be49-73d500fdbc39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:23:47 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:4b:c2,bridge_name='br-int',has_traffic_filtering=True,id=097c3cb1-bc8f-42c3-be49-73d500fdbc39,network=Network(69cdc817-44c9-4420-acb7-e8aebab58bcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap097c3cb1-bc') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:23:47 user nova-compute[71229]: DEBUG os_vif [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:4b:c2,bridge_name='br-int',has_traffic_filtering=True,id=097c3cb1-bc8f-42c3-be49-73d500fdbc39,network=Network(69cdc817-44c9-4420-acb7-e8aebab58bcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap097c3cb1-bc') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:23:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap097c3cb1-bc, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:23:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:23:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:47 user nova-compute[71229]: INFO os_vif [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:4b:c2,bridge_name='br-int',has_traffic_filtering=True,id=097c3cb1-bc8f-42c3-be49-73d500fdbc39,network=Network(69cdc817-44c9-4420-acb7-e8aebab58bcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap097c3cb1-bc')
Apr 11 15:23:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T15:21:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1171936509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1171936509',id=9,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPnuW6ogctwbnKiG/DdSHSi9VgV3vyQxSlprDZSCcAll42WGSndepoNq81o5lA3ENttdnb+uA8SJzEVin1fvRiPZ5AZG/PDhtEvtRNFaLWWnzYWXpsGmE8Y+m9wccFHrw==',key_name='tempest-keypair-1831001595',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:22:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e64015226c19441d87f3a6999a3a8db8',ramdisk_id='',reservation_id='r-u9ytaiu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-441311830',owner_user_name='tempest-TaggedBootDevicesTest_v242-441311830-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:22:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31d206ed111842fd95ce5eb5b3835a48',uuid=cda43d26-e2f7-4e86-b850-b914957c9b57,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "65d1d6cb-a27f-4eae-822e-459770a9a587", "address": "fa:16:3e:02:0d:ff", "network": {"id": "69cdc817-44c9-4420-acb7-e8aebab58bcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-667852060", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d1d6cb-a2", "ovs_interfaceid": "65d1d6cb-a27f-4eae-822e-459770a9a587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:23:47 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Converting VIF {"id": "65d1d6cb-a27f-4eae-822e-459770a9a587", "address": "fa:16:3e:02:0d:ff", "network": {"id": "69cdc817-44c9-4420-acb7-e8aebab58bcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-667852060", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d1d6cb-a2", "ovs_interfaceid": "65d1d6cb-a27f-4eae-822e-459770a9a587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:23:47 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:0d:ff,bridge_name='br-int',has_traffic_filtering=True,id=65d1d6cb-a27f-4eae-822e-459770a9a587,network=Network(69cdc817-44c9-4420-acb7-e8aebab58bcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65d1d6cb-a2') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:23:47 user nova-compute[71229]: DEBUG os_vif [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:0d:ff,bridge_name='br-int',has_traffic_filtering=True,id=65d1d6cb-a27f-4eae-822e-459770a9a587,network=Network(69cdc817-44c9-4420-acb7-e8aebab58bcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65d1d6cb-a2') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:23:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap65d1d6cb-a2, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:23:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:48 user nova-compute[71229]: INFO os_vif [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:0d:ff,bridge_name='br-int',has_traffic_filtering=True,id=65d1d6cb-a27f-4eae-822e-459770a9a587,network=Network(69cdc817-44c9-4420-acb7-e8aebab58bcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65d1d6cb-a2')
Apr 11 15:23:48 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T15:21:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1171936509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1171936509',id=9,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPnuW6ogctwbnKiG/DdSHSi9VgV3vyQxSlprDZSCcAll42WGSndepoNq81o5lA3ENttdnb+uA8SJzEVin1fvRiPZ5AZG/PDhtEvtRNFaLWWnzYWXpsGmE8Y+m9wccFHrw==',key_name='tempest-keypair-1831001595',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:22:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e64015226c19441d87f3a6999a3a8db8',ramdisk_id='',reservation_id='r-u9ytaiu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-441311830',owner_user_name='tempest-TaggedBootDevicesTest_v242-441311830-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:22:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31d206ed111842fd95ce5eb5b3835a48',uuid=cda43d26-e2f7-4e86-b850-b914957c9b57,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9f2f28e-bb0a-4d1b-a831-e2c493521408", "address": "fa:16:3e:75:c7:7f", "network": {"id": "69cdc817-44c9-4420-acb7-e8aebab58bcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-667852060", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f2f28e-bb", "ovs_interfaceid": "d9f2f28e-bb0a-4d1b-a831-e2c493521408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Converting VIF {"id": "d9f2f28e-bb0a-4d1b-a831-e2c493521408", "address": "fa:16:3e:75:c7:7f", "network": {"id": "69cdc817-44c9-4420-acb7-e8aebab58bcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-667852060", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f2f28e-bb", "ovs_interfaceid": "d9f2f28e-bb0a-4d1b-a831-e2c493521408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:c7:7f,bridge_name='br-int',has_traffic_filtering=True,id=d9f2f28e-bb0a-4d1b-a831-e2c493521408,network=Network(69cdc817-44c9-4420-acb7-e8aebab58bcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9f2f28e-bb') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_vif [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:c7:7f,bridge_name='br-int',has_traffic_filtering=True,id=d9f2f28e-bb0a-4d1b-a831-e2c493521408,network=Network(69cdc817-44c9-4420-acb7-e8aebab58bcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9f2f28e-bb') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9f2f28e-bb, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:48 user nova-compute[71229]: INFO os_vif [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:c7:7f,bridge_name='br-int',has_traffic_filtering=True,id=d9f2f28e-bb0a-4d1b-a831-e2c493521408,network=Network(69cdc817-44c9-4420-acb7-e8aebab58bcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9f2f28e-bb')
Apr 11 15:23:48 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T15:21:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1171936509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1171936509',id=9,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPnuW6ogctwbnKiG/DdSHSi9VgV3vyQxSlprDZSCcAll42WGSndepoNq81o5lA3ENttdnb+uA8SJzEVin1fvRiPZ5AZG/PDhtEvtRNFaLWWnzYWXpsGmE8Y+m9wccFHrw==',key_name='tempest-keypair-1831001595',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:22:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e64015226c19441d87f3a6999a3a8db8',ramdisk_id='',reservation_id='r-u9ytaiu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-441311830',owner_user_name='tempest-TaggedBootDevicesTest_v242-441311830-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:22:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31d206ed111842fd95ce5eb5b3835a48',uuid=cda43d26-e2f7-4e86-b850-b914957c9b57,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d794bc3-2136-4b88-92e5-4703eb113b6d", "address": "fa:16:3e:b0:b7:48", "network": {"id": "0065e8ee-5334-4ab3-8c58-6a2e6f9954f2", "bridge": "br-int", "label": "tempest-device-tagging-net2-447570772", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d794bc3-21", "ovs_interfaceid": "6d794bc3-2136-4b88-92e5-4703eb113b6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Converting VIF {"id": "6d794bc3-2136-4b88-92e5-4703eb113b6d", "address": "fa:16:3e:b0:b7:48", "network": {"id": "0065e8ee-5334-4ab3-8c58-6a2e6f9954f2", "bridge": "br-int", "label": "tempest-device-tagging-net2-447570772", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d794bc3-21", "ovs_interfaceid": "6d794bc3-2136-4b88-92e5-4703eb113b6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:b7:48,bridge_name='br-int',has_traffic_filtering=True,id=6d794bc3-2136-4b88-92e5-4703eb113b6d,network=Network(0065e8ee-5334-4ab3-8c58-6a2e6f9954f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d794bc3-21') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_vif [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:b7:48,bridge_name='br-int',has_traffic_filtering=True,id=6d794bc3-2136-4b88-92e5-4703eb113b6d,network=Network(0065e8ee-5334-4ab3-8c58-6a2e6f9954f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d794bc3-21') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d794bc3-21, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:48 user nova-compute[71229]: INFO os_vif [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:b7:48,bridge_name='br-int',has_traffic_filtering=True,id=6d794bc3-2136-4b88-92e5-4703eb113b6d,network=Network(0065e8ee-5334-4ab3-8c58-6a2e6f9954f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d794bc3-21')
Apr 11 15:23:48 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T15:21:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1171936509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1171936509',id=9,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPnuW6ogctwbnKiG/DdSHSi9VgV3vyQxSlprDZSCcAll42WGSndepoNq81o5lA3ENttdnb+uA8SJzEVin1fvRiPZ5AZG/PDhtEvtRNFaLWWnzYWXpsGmE8Y+m9wccFHrw==',key_name='tempest-keypair-1831001595',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:22:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e64015226c19441d87f3a6999a3a8db8',ramdisk_id='',reservation_id='r-u9ytaiu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-441311830',owner_user_name='tempest-TaggedBootDevicesTest_v242-441311830-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:22:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31d206ed111842fd95ce5eb5b3835a48',uuid=cda43d26-e2f7-4e86-b850-b914957c9b57,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9f0f991-6f64-45e6-9ce7-3f279f5ce31f", "address": "fa:16:3e:41:d4:9a", "network": {"id": "0065e8ee-5334-4ab3-8c58-6a2e6f9954f2", "bridge": "br-int", "label": "tempest-device-tagging-net2-447570772", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9f0f991-6f", "ovs_interfaceid": "e9f0f991-6f64-45e6-9ce7-3f279f5ce31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Converting VIF {"id": "e9f0f991-6f64-45e6-9ce7-3f279f5ce31f", "address": "fa:16:3e:41:d4:9a", "network": {"id": "0065e8ee-5334-4ab3-8c58-6a2e6f9954f2", "bridge": "br-int", "label": "tempest-device-tagging-net2-447570772", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9f0f991-6f", "ovs_interfaceid": "e9f0f991-6f64-45e6-9ce7-3f279f5ce31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:d4:9a,bridge_name='br-int',has_traffic_filtering=True,id=e9f0f991-6f64-45e6-9ce7-3f279f5ce31f,network=Network(0065e8ee-5334-4ab3-8c58-6a2e6f9954f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9f0f991-6f') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_vif [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:d4:9a,bridge_name='br-int',has_traffic_filtering=True,id=e9f0f991-6f64-45e6-9ce7-3f279f5ce31f,network=Network(0065e8ee-5334-4ab3-8c58-6a2e6f9954f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9f0f991-6f') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9f0f991-6f, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:23:48 user nova-compute[71229]: INFO os_vif [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:d4:9a,bridge_name='br-int',has_traffic_filtering=True,id=e9f0f991-6f64-45e6-9ce7-3f279f5ce31f,network=Network(0065e8ee-5334-4ab3-8c58-6a2e6f9954f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9f0f991-6f')
Apr 11 15:23:48 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UVqYIxlh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:23:48 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eaa3540-543c-4861-bf02-a38146b21b66]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 15:23:48 user nova-compute[71229]: No targets found.
Apr 11 15:23:48 user nova-compute[71229]: iSNS:
Apr 11 15:23:48 user nova-compute[71229]: No targets found.
Apr 11 15:23:48 user nova-compute[71229]: STATIC:
Apr 11 15:23:48 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d
Apr 11 15:23:48 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:23:48 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:23:48 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487
Apr 11 15:23:48 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:23:48 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:23:48 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c
Apr 11 15:23:48 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:23:48 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:23:48 user nova-compute[71229]: FIRMWARE:
Apr 11 15:23:48 user nova-compute[71229]: No targets found.
Apr 11 15:23:48 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 15:23:48 user nova-compute[71229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 15:23:48 user nova-compute[71229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71229) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d', 0)] {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba1e1b8-b23e-4b43-8262-f4c0f71b24c8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[670136df-ff2b-429f-ae63-1855923ca908]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)
Apr 11 15:23:48 user nova-compute[71229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)
Apr 11 15:23:48 user nova-compute[71229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)
Apr 11 15:23:48 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d (non-flash)
Apr 11 15:23:48 user nova-compute[71229]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)
Apr 11 15:23:48 user nova-compute[71229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)
Apr 11 15:23:48 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb5c144f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d'): ({'sdb'}, set())}) {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Removing single pathed devices sdb {{(pid=71229) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef317cb5-8a02-4242-ada4-0f01a2ff3090]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[701cb7c3-f726-48a5-967d-deed70e13968]: (4, ('ok\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Flushing IO for device /dev/sdb {{(pid=71229) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0986e6-41fa-48b9-babf-21b6cb093135]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71229) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8ab31c-4672-49ff-9812-fb920309682d]: (4, ('1', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] SCSI volumes sdb have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d')] {{(pid=71229) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0790ead3-f09e-43f9-b999-ec859143419b]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d -p 172.16.0.220:3260 --logout {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681226613.3592148, 2b2c294d-49b2-41bf-89d0-17a560e7741f => Stopped> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:23:48 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] VM Stopped (Lifecycle Event)
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62fa829-cc24-413e-a2e6-2f83404e7e31]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d, portal: 172.16.0.220,3260]
Apr 11 15:23:48 user nova-compute[71229]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d, portal: 172.16.0.220,3260] successful.
Apr 11 15:23:48 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d -p 172.16.0.220:3260 --op delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG nova.compute.manager [None req-5d2d2689-8b03-4e56-8185-6904796f51f9 None None] [instance: 2b2c294d-49b2-41bf-89d0-17a560e7741f] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25935fb7-f8be-4263-8b3b-42330253644d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[65007e87-9021-4a5d-b373-c56e17fe2eef]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] <== disconnect_volume: return (312ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dlckRVJh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:23:48 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe397cd-ba2a-43d1-a74b-9137db4f8490]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 15:23:48 user nova-compute[71229]: No targets found.
Apr 11 15:23:48 user nova-compute[71229]: iSNS:
Apr 11 15:23:48 user nova-compute[71229]: No targets found.
Apr 11 15:23:48 user nova-compute[71229]: STATIC:
Apr 11 15:23:48 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487
Apr 11 15:23:48 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:23:48 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:23:48 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c
Apr 11 15:23:48 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:23:48 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:23:48 user nova-compute[71229]: FIRMWARE:
Apr 11 15:23:48 user nova-compute[71229]: No targets found.
Apr 11 15:23:48 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 15:23:48 user nova-compute[71229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 15:23:48 user nova-compute[71229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71229) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487', 0)] {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[dade7b55-3949-45ac-8132-aef368076537]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f98657-3431-4f50-bd04-bfc6d1b81106]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)
Apr 11 15:23:48 user nova-compute[71229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)
Apr 11 15:23:48 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 (non-flash)
Apr 11 15:23:48 user nova-compute[71229]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)
Apr 11 15:23:48 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb5c3b05e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487'): ({'sdc'}, set())}) {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Removing single pathed devices sdc {{(pid=71229) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8299acf-c1df-4e1d-bf32-0fbc7cf62098]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[01132710-e047-4139-89a0-5f8f2eb178bb]: (4, ('ok\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Flushing IO for device /dev/sdc {{(pid=71229) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3b80b1-b6a8-483b-865b-3492be55fe14]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71229) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.029s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8142c4-ca13-435f-b1c2-282d94abad3f]: (4, ('1', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] SCSI volumes sdc have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487')] {{(pid=71229) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[588b2776-de58-4258-95e2-c56a10018f61]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 -p 172.16.0.220:3260 --logout {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG nova.compute.manager [req-878559d8-1af6-4ae1-a127-8db703c2f81e req-986c0305-2819-4b03-a755-21c065eebc62 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received event network-vif-plugged-ee21c1bf-90da-44fe-b6f2-26132b87c5ed {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-878559d8-1af6-4ae1-a127-8db703c2f81e req-986c0305-2819-4b03-a755-21c065eebc62 service nova] Acquiring lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-878559d8-1af6-4ae1-a127-8db703c2f81e req-986c0305-2819-4b03-a755-21c065eebc62 service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-878559d8-1af6-4ae1-a127-8db703c2f81e req-986c0305-2819-4b03-a755-21c065eebc62 service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG nova.compute.manager [req-878559d8-1af6-4ae1-a127-8db703c2f81e req-986c0305-2819-4b03-a755-21c065eebc62 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] No waiting events found dispatching network-vif-plugged-ee21c1bf-90da-44fe-b6f2-26132b87c5ed {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:23:48 user nova-compute[71229]: WARNING nova.compute.manager [req-878559d8-1af6-4ae1-a127-8db703c2f81e req-986c0305-2819-4b03-a755-21c065eebc62 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received unexpected event network-vif-plugged-ee21c1bf-90da-44fe-b6f2-26132b87c5ed for instance with vm_state active and task_state deleting.
Apr 11 15:23:48 user nova-compute[71229]: DEBUG nova.compute.manager [req-878559d8-1af6-4ae1-a127-8db703c2f81e req-986c0305-2819-4b03-a755-21c065eebc62 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received event network-vif-unplugged-097c3cb1-bc8f-42c3-be49-73d500fdbc39 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-878559d8-1af6-4ae1-a127-8db703c2f81e req-986c0305-2819-4b03-a755-21c065eebc62 service nova] Acquiring lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-878559d8-1af6-4ae1-a127-8db703c2f81e req-986c0305-2819-4b03-a755-21c065eebc62 service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-878559d8-1af6-4ae1-a127-8db703c2f81e req-986c0305-2819-4b03-a755-21c065eebc62 service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG nova.compute.manager [req-878559d8-1af6-4ae1-a127-8db703c2f81e req-986c0305-2819-4b03-a755-21c065eebc62 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] No waiting events found dispatching network-vif-unplugged-097c3cb1-bc8f-42c3-be49-73d500fdbc39 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG nova.compute.manager [req-878559d8-1af6-4ae1-a127-8db703c2f81e req-986c0305-2819-4b03-a755-21c065eebc62 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received event network-vif-unplugged-097c3cb1-bc8f-42c3-be49-73d500fdbc39 for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG nova.compute.manager [req-878559d8-1af6-4ae1-a127-8db703c2f81e req-986c0305-2819-4b03-a755-21c065eebc62 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received event network-vif-plugged-097c3cb1-bc8f-42c3-be49-73d500fdbc39 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-878559d8-1af6-4ae1-a127-8db703c2f81e req-986c0305-2819-4b03-a755-21c065eebc62 service nova] Acquiring lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-878559d8-1af6-4ae1-a127-8db703c2f81e req-986c0305-2819-4b03-a755-21c065eebc62 service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-878559d8-1af6-4ae1-a127-8db703c2f81e req-986c0305-2819-4b03-a755-21c065eebc62 service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG nova.compute.manager [req-878559d8-1af6-4ae1-a127-8db703c2f81e req-986c0305-2819-4b03-a755-21c065eebc62 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] No waiting events found dispatching network-vif-plugged-097c3cb1-bc8f-42c3-be49-73d500fdbc39 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:23:48 user nova-compute[71229]: WARNING nova.compute.manager [req-878559d8-1af6-4ae1-a127-8db703c2f81e req-986c0305-2819-4b03-a755-21c065eebc62 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received unexpected event network-vif-plugged-097c3cb1-bc8f-42c3-be49-73d500fdbc39 for instance with vm_state active and task_state deleting.
Apr 11 15:23:48 user nova-compute[71229]: DEBUG nova.compute.manager [req-878559d8-1af6-4ae1-a127-8db703c2f81e req-986c0305-2819-4b03-a755-21c065eebc62 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received event network-vif-unplugged-d9f2f28e-bb0a-4d1b-a831-e2c493521408 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-878559d8-1af6-4ae1-a127-8db703c2f81e req-986c0305-2819-4b03-a755-21c065eebc62 service nova] Acquiring lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-878559d8-1af6-4ae1-a127-8db703c2f81e req-986c0305-2819-4b03-a755-21c065eebc62 service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-878559d8-1af6-4ae1-a127-8db703c2f81e req-986c0305-2819-4b03-a755-21c065eebc62 service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG nova.compute.manager [req-878559d8-1af6-4ae1-a127-8db703c2f81e req-986c0305-2819-4b03-a755-21c065eebc62 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] No waiting events found dispatching network-vif-unplugged-d9f2f28e-bb0a-4d1b-a831-e2c493521408 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG nova.compute.manager [req-878559d8-1af6-4ae1-a127-8db703c2f81e req-986c0305-2819-4b03-a755-21c065eebc62 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received event network-vif-unplugged-d9f2f28e-bb0a-4d1b-a831-e2c493521408 for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG nova.compute.manager [req-878559d8-1af6-4ae1-a127-8db703c2f81e req-986c0305-2819-4b03-a755-21c065eebc62 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received event network-vif-plugged-d9f2f28e-bb0a-4d1b-a831-e2c493521408 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-878559d8-1af6-4ae1-a127-8db703c2f81e req-986c0305-2819-4b03-a755-21c065eebc62 service nova] Acquiring lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-878559d8-1af6-4ae1-a127-8db703c2f81e req-986c0305-2819-4b03-a755-21c065eebc62 service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-878559d8-1af6-4ae1-a127-8db703c2f81e req-986c0305-2819-4b03-a755-21c065eebc62 service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG nova.compute.manager [req-878559d8-1af6-4ae1-a127-8db703c2f81e req-986c0305-2819-4b03-a755-21c065eebc62 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] No waiting events found dispatching network-vif-plugged-d9f2f28e-bb0a-4d1b-a831-e2c493521408 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:23:48 user nova-compute[71229]: WARNING nova.compute.manager [req-878559d8-1af6-4ae1-a127-8db703c2f81e req-986c0305-2819-4b03-a755-21c065eebc62 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received unexpected event network-vif-plugged-d9f2f28e-bb0a-4d1b-a831-e2c493521408 for instance with vm_state active and task_state deleting.
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a99511-1b80-44ba-8daa-2f1c291d6a2c]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487, portal: 172.16.0.220,3260]
Apr 11 15:23:48 user nova-compute[71229]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487, portal: 172.16.0.220,3260] successful.
Apr 11 15:23:48 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 -p 172.16.0.220:3260 --op delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG nova.compute.manager [req-b5c6d887-ef09-4d87-8145-e1b5fa869f35 req-d71805a1-dffd-4667-9ac4-4bc0b671d6b6 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received event network-vif-plugged-2ac99ade-56b1-4865-b997-a9f8ef0a760b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-b5c6d887-ef09-4d87-8145-e1b5fa869f35 req-d71805a1-dffd-4667-9ac4-4bc0b671d6b6 service nova] Acquiring lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-b5c6d887-ef09-4d87-8145-e1b5fa869f35 req-d71805a1-dffd-4667-9ac4-4bc0b671d6b6 service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-b5c6d887-ef09-4d87-8145-e1b5fa869f35 req-d71805a1-dffd-4667-9ac4-4bc0b671d6b6 service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG nova.compute.manager [req-b5c6d887-ef09-4d87-8145-e1b5fa869f35 req-d71805a1-dffd-4667-9ac4-4bc0b671d6b6 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] No waiting events found dispatching network-vif-plugged-2ac99ade-56b1-4865-b997-a9f8ef0a760b {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:23:48 user nova-compute[71229]: WARNING nova.compute.manager [req-b5c6d887-ef09-4d87-8145-e1b5fa869f35 req-d71805a1-dffd-4667-9ac4-4bc0b671d6b6 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received unexpected event network-vif-plugged-2ac99ade-56b1-4865-b997-a9f8ef0a760b for instance with vm_state active and task_state deleting.
Apr 11 15:23:48 user nova-compute[71229]: DEBUG nova.compute.manager [req-b5c6d887-ef09-4d87-8145-e1b5fa869f35 req-d71805a1-dffd-4667-9ac4-4bc0b671d6b6 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received event network-vif-unplugged-65d1d6cb-a27f-4eae-822e-459770a9a587 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-b5c6d887-ef09-4d87-8145-e1b5fa869f35 req-d71805a1-dffd-4667-9ac4-4bc0b671d6b6 service nova] Acquiring lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-b5c6d887-ef09-4d87-8145-e1b5fa869f35 req-d71805a1-dffd-4667-9ac4-4bc0b671d6b6 service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-b5c6d887-ef09-4d87-8145-e1b5fa869f35 req-d71805a1-dffd-4667-9ac4-4bc0b671d6b6 service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG nova.compute.manager [req-b5c6d887-ef09-4d87-8145-e1b5fa869f35 req-d71805a1-dffd-4667-9ac4-4bc0b671d6b6 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] No waiting events found dispatching network-vif-unplugged-65d1d6cb-a27f-4eae-822e-459770a9a587 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG nova.compute.manager [req-b5c6d887-ef09-4d87-8145-e1b5fa869f35 req-d71805a1-dffd-4667-9ac4-4bc0b671d6b6 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received event network-vif-unplugged-65d1d6cb-a27f-4eae-822e-459770a9a587 for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG nova.compute.manager [req-b5c6d887-ef09-4d87-8145-e1b5fa869f35 req-d71805a1-dffd-4667-9ac4-4bc0b671d6b6 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received event network-vif-plugged-65d1d6cb-a27f-4eae-822e-459770a9a587 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-b5c6d887-ef09-4d87-8145-e1b5fa869f35 req-d71805a1-dffd-4667-9ac4-4bc0b671d6b6 service nova] Acquiring lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-b5c6d887-ef09-4d87-8145-e1b5fa869f35 req-d71805a1-dffd-4667-9ac4-4bc0b671d6b6 service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-b5c6d887-ef09-4d87-8145-e1b5fa869f35 req-d71805a1-dffd-4667-9ac4-4bc0b671d6b6 service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG nova.compute.manager [req-b5c6d887-ef09-4d87-8145-e1b5fa869f35 req-d71805a1-dffd-4667-9ac4-4bc0b671d6b6 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] No waiting events found dispatching network-vif-plugged-65d1d6cb-a27f-4eae-822e-459770a9a587 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:23:48 user nova-compute[71229]: WARNING nova.compute.manager [req-b5c6d887-ef09-4d87-8145-e1b5fa869f35 req-d71805a1-dffd-4667-9ac4-4bc0b671d6b6 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received unexpected event network-vif-plugged-65d1d6cb-a27f-4eae-822e-459770a9a587 for instance with vm_state active and task_state deleting.
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9255f82-4f06-40f7-8c74-41549e0ae487 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdfd1035-2cf9-4c8c-8687-afa740ca2945]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] <== disconnect_volume: return (270ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VoTjrUcu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:23:48 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6941af-1163-4dde-bb0a-0f4a1ccc7d5b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 15:23:48 user nova-compute[71229]: No targets found.
Apr 11 15:23:48 user nova-compute[71229]: iSNS:
Apr 11 15:23:48 user nova-compute[71229]: No targets found.
Apr 11 15:23:48 user nova-compute[71229]: STATIC:
Apr 11 15:23:48 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c
Apr 11 15:23:48 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:23:48 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:23:48 user nova-compute[71229]: FIRMWARE:
Apr 11 15:23:48 user nova-compute[71229]: No targets found.
Apr 11 15:23:48 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 15:23:48 user nova-compute[71229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 15:23:48 user nova-compute[71229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71229) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c', 0)] {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b52be8d-37ab-44be-abba-683c7f03e12b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01e439d-9954-42bc-9ed2-bee89fdbfc33]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)
Apr 11 15:23:48 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c (non-flash)
Apr 11 15:23:48 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb69c6d480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c'): ({'sdd'}, set())}) {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Removing single pathed devices sdd {{(pid=71229) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[82033698-50e7-4204-ae4d-8193ffa69156]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[04bc1160-5b63-472e-b01d-3348c12090dc]: (4, ('ok\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Flushing IO for device /dev/sdd {{(pid=71229) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[056cf5e4-9cce-4c76-a4fd-7e46e345d60e]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71229) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.028s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[26606128-6a3c-4d05-aa94-1a80a25cc018]: (4, ('1', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] SCSI volumes sdd have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c')] {{(pid=71229) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7e2dec-3d21-44c6-8850-282e61ef1fa0]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c -p 172.16.0.220:3260 --logout {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6098c30-c0ee-48c9-944f-c7dd6f0110ce]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c, portal: 172.16.0.220,3260]
Apr 11 15:23:48 user nova-compute[71229]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c, portal: 172.16.0.220,3260] successful.
Apr 11 15:23:48 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c -p 172.16.0.220:3260 --op delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8e39010-7dc1-43ac-8b13-222b2f4e824c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bec8b3-ba63-4058-8259-42917673ce13]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.258s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] <== disconnect_volume: return (260ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 15:23:48 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Deleting instance files /opt/stack/data/nova/instances/cda43d26-e2f7-4e86-b850-b914957c9b57_del
Apr 11 15:23:48 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Deletion of /opt/stack/data/nova/instances/cda43d26-e2f7-4e86-b850-b914957c9b57_del complete
Apr 11 15:23:48 user nova-compute[71229]: INFO nova.compute.manager [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Took 2.89 seconds to destroy the instance on the hypervisor.
Apr 11 15:23:48 user nova-compute[71229]: DEBUG oslo.service.loopingcall [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71229) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG nova.compute.manager [-] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Deallocating network for instance {{(pid=71229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 15:23:48 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] deallocate_for_instance() {{(pid=71229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 15:23:49 user nova-compute[71229]: DEBUG nova.compute.manager [req-ff832b1d-1b9e-4b39-a150-bbbf933defcf req-f50a14eb-e3ed-4f89-990f-ef83ce36fdc5 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received event network-vif-plugged-6d794bc3-2136-4b88-92e5-4703eb113b6d {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:23:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-ff832b1d-1b9e-4b39-a150-bbbf933defcf req-f50a14eb-e3ed-4f89-990f-ef83ce36fdc5 service nova] Acquiring lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-ff832b1d-1b9e-4b39-a150-bbbf933defcf req-f50a14eb-e3ed-4f89-990f-ef83ce36fdc5 service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-ff832b1d-1b9e-4b39-a150-bbbf933defcf req-f50a14eb-e3ed-4f89-990f-ef83ce36fdc5 service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:23:49 user nova-compute[71229]: DEBUG nova.compute.manager [req-ff832b1d-1b9e-4b39-a150-bbbf933defcf req-f50a14eb-e3ed-4f89-990f-ef83ce36fdc5 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] No waiting events found dispatching network-vif-plugged-6d794bc3-2136-4b88-92e5-4703eb113b6d {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:23:49 user nova-compute[71229]: WARNING nova.compute.manager [req-ff832b1d-1b9e-4b39-a150-bbbf933defcf req-f50a14eb-e3ed-4f89-990f-ef83ce36fdc5 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received unexpected event network-vif-plugged-6d794bc3-2136-4b88-92e5-4703eb113b6d for instance with vm_state active and task_state deleting.
Apr 11 15:23:49 user nova-compute[71229]: DEBUG nova.compute.manager [req-ff832b1d-1b9e-4b39-a150-bbbf933defcf req-f50a14eb-e3ed-4f89-990f-ef83ce36fdc5 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received event network-vif-unplugged-e9f0f991-6f64-45e6-9ce7-3f279f5ce31f {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:23:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-ff832b1d-1b9e-4b39-a150-bbbf933defcf req-f50a14eb-e3ed-4f89-990f-ef83ce36fdc5 service nova] Acquiring lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-ff832b1d-1b9e-4b39-a150-bbbf933defcf req-f50a14eb-e3ed-4f89-990f-ef83ce36fdc5 service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-ff832b1d-1b9e-4b39-a150-bbbf933defcf req-f50a14eb-e3ed-4f89-990f-ef83ce36fdc5 service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:23:49 user nova-compute[71229]: DEBUG nova.compute.manager [req-ff832b1d-1b9e-4b39-a150-bbbf933defcf req-f50a14eb-e3ed-4f89-990f-ef83ce36fdc5 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] No waiting events found dispatching network-vif-unplugged-e9f0f991-6f64-45e6-9ce7-3f279f5ce31f {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:23:49 user nova-compute[71229]: DEBUG nova.compute.manager [req-ff832b1d-1b9e-4b39-a150-bbbf933defcf req-f50a14eb-e3ed-4f89-990f-ef83ce36fdc5 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received event network-vif-unplugged-e9f0f991-6f64-45e6-9ce7-3f279f5ce31f for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 15:23:49 user nova-compute[71229]: DEBUG nova.compute.manager [req-ff832b1d-1b9e-4b39-a150-bbbf933defcf req-f50a14eb-e3ed-4f89-990f-ef83ce36fdc5 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received event network-vif-plugged-e9f0f991-6f64-45e6-9ce7-3f279f5ce31f {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:23:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-ff832b1d-1b9e-4b39-a150-bbbf933defcf req-f50a14eb-e3ed-4f89-990f-ef83ce36fdc5 service nova] Acquiring lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-ff832b1d-1b9e-4b39-a150-bbbf933defcf req-f50a14eb-e3ed-4f89-990f-ef83ce36fdc5 service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-ff832b1d-1b9e-4b39-a150-bbbf933defcf req-f50a14eb-e3ed-4f89-990f-ef83ce36fdc5 service nova] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:23:49 user nova-compute[71229]: DEBUG nova.compute.manager [req-ff832b1d-1b9e-4b39-a150-bbbf933defcf req-f50a14eb-e3ed-4f89-990f-ef83ce36fdc5 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] No waiting events found dispatching network-vif-plugged-e9f0f991-6f64-45e6-9ce7-3f279f5ce31f {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:23:49 user nova-compute[71229]: WARNING nova.compute.manager [req-ff832b1d-1b9e-4b39-a150-bbbf933defcf req-f50a14eb-e3ed-4f89-990f-ef83ce36fdc5 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received unexpected event network-vif-plugged-e9f0f991-6f64-45e6-9ce7-3f279f5ce31f for instance with vm_state active and task_state deleting.
Apr 11 15:23:50 user nova-compute[71229]: DEBUG nova.compute.manager [req-8a247a61-a4bd-40cb-8748-72bd6180a958 req-248aa0d4-5764-41ec-8781-aee8736a1d66 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received event network-vif-deleted-ee21c1bf-90da-44fe-b6f2-26132b87c5ed {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:23:50 user nova-compute[71229]: INFO nova.compute.manager [req-8a247a61-a4bd-40cb-8748-72bd6180a958 req-248aa0d4-5764-41ec-8781-aee8736a1d66 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Neutron deleted interface ee21c1bf-90da-44fe-b6f2-26132b87c5ed; detaching it from the instance and deleting it from the info cache
Apr 11 15:23:50 user nova-compute[71229]: DEBUG nova.network.neutron [req-8a247a61-a4bd-40cb-8748-72bd6180a958 req-248aa0d4-5764-41ec-8781-aee8736a1d66 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Updating instance_info_cache with network_info: [{"id": "2ac99ade-56b1-4865-b997-a9f8ef0a760b", "address": "fa:16:3e:b5:b8:ec", "network": {"id": "69cdc817-44c9-4420-acb7-e8aebab58bcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-667852060", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac99ade-56", "ovs_interfaceid": "2ac99ade-56b1-4865-b997-a9f8ef0a760b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "097c3cb1-bc8f-42c3-be49-73d500fdbc39", "address": "fa:16:3e:2b:4b:c2", "network": {"id": "69cdc817-44c9-4420-acb7-e8aebab58bcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-667852060", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap097c3cb1-bc", "ovs_interfaceid": "097c3cb1-bc8f-42c3-be49-73d500fdbc39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "65d1d6cb-a27f-4eae-822e-459770a9a587", "address": "fa:16:3e:02:0d:ff", "network": {"id": "69cdc817-44c9-4420-acb7-e8aebab58bcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-667852060", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d1d6cb-a2", "ovs_interfaceid": "65d1d6cb-a27f-4eae-822e-459770a9a587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9f2f28e-bb0a-4d1b-a831-e2c493521408", "address": "fa:16:3e:75:c7:7f", "network": {"id": "69cdc817-44c9-4420-acb7-e8aebab58bcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-667852060", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f2f28e-bb", "ovs_interfaceid": "d9f2f28e-bb0a-4d1b-a831-e2c493521408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6d794bc3-2136-4b88-92e5-4703eb113b6d", "address": "fa:16:3e:b0:b7:48", "network": {"id": "0065e8ee-5334-4ab3-8c58-6a2e6f9954f2", "bridge": "br-int", "label": "tempest-device-tagging-net2-447570772", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d794bc3-21", "ovs_interfaceid": "6d794bc3-2136-4b88-92e5-4703eb113b6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e9f0f991-6f64-45e6-9ce7-3f279f5ce31f", "address": "fa:16:3e:41:d4:9a", "network": {"id": "0065e8ee-5334-4ab3-8c58-6a2e6f9954f2", "bridge": "br-int", "label": "tempest-device-tagging-net2-447570772", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e64015226c19441d87f3a6999a3a8db8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9f0f991-6f", "ovs_interfaceid": "e9f0f991-6f64-45e6-9ce7-3f279f5ce31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:23:50 user nova-compute[71229]: DEBUG nova.compute.manager [req-8a247a61-a4bd-40cb-8748-72bd6180a958 req-248aa0d4-5764-41ec-8781-aee8736a1d66 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Detach interface failed, port_id=ee21c1bf-90da-44fe-b6f2-26132b87c5ed, reason: Instance cda43d26-e2f7-4e86-b850-b914957c9b57 could not be found. {{(pid=71229) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 15:23:51 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:51 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:52 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:23:52 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Took 3.78 seconds to deallocate network for instance.
Apr 11 15:23:52 user nova-compute[71229]: DEBUG nova.compute.manager [req-63cee9d3-8e75-4c36-bcd8-10fbf80c90bc req-f04f14ea-5bbe-4f38-9567-f33bc402c480 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received event network-vif-deleted-e9f0f991-6f64-45e6-9ce7-3f279f5ce31f {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:23:52 user nova-compute[71229]: DEBUG nova.compute.manager [req-63cee9d3-8e75-4c36-bcd8-10fbf80c90bc req-f04f14ea-5bbe-4f38-9567-f33bc402c480 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received event network-vif-deleted-d9f2f28e-bb0a-4d1b-a831-e2c493521408 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:23:52 user nova-compute[71229]: DEBUG nova.compute.manager [req-63cee9d3-8e75-4c36-bcd8-10fbf80c90bc req-f04f14ea-5bbe-4f38-9567-f33bc402c480 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received event network-vif-deleted-65d1d6cb-a27f-4eae-822e-459770a9a587 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:23:52 user nova-compute[71229]: DEBUG nova.compute.manager [req-63cee9d3-8e75-4c36-bcd8-10fbf80c90bc req-f04f14ea-5bbe-4f38-9567-f33bc402c480 service nova] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Received event network-vif-deleted-6d794bc3-2136-4b88-92e5-4703eb113b6d {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:23:53 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:53 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "b0d90fd2-6a95-43c4-8756-e82071d99154" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:53 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "b0d90fd2-6a95-43c4-8756-e82071d99154" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:53 user nova-compute[71229]: DEBUG nova.compute.manager [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Starting instance... {{(pid=71229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 15:23:53 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:53 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:53 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 15:23:53 user nova-compute[71229]: INFO nova.compute.claims [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Claim successful on node user
Apr 11 15:23:53 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:23:53 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:23:53 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.294s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:23:53 user nova-compute[71229]: DEBUG nova.compute.manager [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Start building networks asynchronously for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 15:23:53 user nova-compute[71229]: DEBUG nova.compute.manager [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Allocating IP information in the background. {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 15:23:53 user nova-compute[71229]: DEBUG nova.network.neutron [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] allocate_for_instance() {{(pid=71229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 15:23:53 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 15:23:53 user nova-compute[71229]: DEBUG nova.compute.manager [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Start building block device mappings for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 15:23:53 user nova-compute[71229]: INFO nova.virt.block_device [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Booting with blank volume at /dev/vda
Apr 11 15:23:53 user nova-compute[71229]: DEBUG nova.policy [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71229) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 15:23:54 user nova-compute[71229]: DEBUG nova.network.neutron [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Successfully created port: 4718fa68-0eb9-4592-8c43-981438e3d0b8 {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 15:23:55 user nova-compute[71229]: DEBUG nova.network.neutron [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Successfully updated port: 4718fa68-0eb9-4592-8c43-981438e3d0b8 {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:23:55 user nova-compute[71229]: INFO nova.compute.manager [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Took 2.44 seconds to detach 3 volumes for instance.
Apr 11 15:23:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "refresh_cache-b0d90fd2-6a95-43c4-8756-e82071d99154" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:23:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquired lock "refresh_cache-b0d90fd2-6a95-43c4-8756-e82071d99154" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:23:55 user nova-compute[71229]: DEBUG nova.network.neutron [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:23:55 user nova-compute[71229]: DEBUG nova.compute.manager [req-80e01595-cfc0-4a5c-a1e6-64b8307328ee req-880cd608-9a98-4378-9d2e-117fe8d4ac09 service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Received event network-changed-4718fa68-0eb9-4592-8c43-981438e3d0b8 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:23:55 user nova-compute[71229]: DEBUG nova.compute.manager [req-80e01595-cfc0-4a5c-a1e6-64b8307328ee req-880cd608-9a98-4378-9d2e-117fe8d4ac09 service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Refreshing instance network info cache due to event network-changed-4718fa68-0eb9-4592-8c43-981438e3d0b8. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:23:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-80e01595-cfc0-4a5c-a1e6-64b8307328ee req-880cd608-9a98-4378-9d2e-117fe8d4ac09 service nova] Acquiring lock "refresh_cache-b0d90fd2-6a95-43c4-8756-e82071d99154" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:23:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:55 user nova-compute[71229]: DEBUG nova.network.neutron [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:23:55 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:23:55 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:23:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.229s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:23:55 user nova-compute[71229]: INFO nova.scheduler.client.report [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Deleted allocations for instance cda43d26-e2f7-4e86-b850-b914957c9b57
Apr 11 15:23:55 user nova-compute[71229]: DEBUG nova.network.neutron [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Updating instance_info_cache with network_info: [{"id": "4718fa68-0eb9-4592-8c43-981438e3d0b8", "address": "fa:16:3e:e4:28:3b", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4718fa68-0e", "ovs_interfaceid": "4718fa68-0eb9-4592-8c43-981438e3d0b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:23:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Releasing lock "refresh_cache-b0d90fd2-6a95-43c4-8756-e82071d99154" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:23:55 user nova-compute[71229]: DEBUG nova.compute.manager [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Instance network_info: |[{"id": "4718fa68-0eb9-4592-8c43-981438e3d0b8", "address": "fa:16:3e:e4:28:3b", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4718fa68-0e", "ovs_interfaceid": "4718fa68-0eb9-4592-8c43-981438e3d0b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 15:23:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-80e01595-cfc0-4a5c-a1e6-64b8307328ee req-880cd608-9a98-4378-9d2e-117fe8d4ac09 service nova] Acquired lock "refresh_cache-b0d90fd2-6a95-43c4-8756-e82071d99154" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:23:55 user nova-compute[71229]: DEBUG nova.network.neutron [req-80e01595-cfc0-4a5c-a1e6-64b8307328ee req-880cd608-9a98-4378-9d2e-117fe8d4ac09 service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Refreshing network info cache for port 4718fa68-0eb9-4592-8c43-981438e3d0b8 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:23:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b6126552-82e2-4c49-8b47-a17f85d02f23 tempest-TaggedBootDevicesTest_v242-441311830 tempest-TaggedBootDevicesTest_v242-441311830-project-member] Lock "cda43d26-e2f7-4e86-b850-b914957c9b57" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.540s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:23:56 user nova-compute[71229]: DEBUG nova.network.neutron [req-80e01595-cfc0-4a5c-a1e6-64b8307328ee req-880cd608-9a98-4378-9d2e-117fe8d4ac09 service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Updated VIF entry in instance network info cache for port 4718fa68-0eb9-4592-8c43-981438e3d0b8. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:23:56 user nova-compute[71229]: DEBUG nova.network.neutron [req-80e01595-cfc0-4a5c-a1e6-64b8307328ee req-880cd608-9a98-4378-9d2e-117fe8d4ac09 service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Updating instance_info_cache with network_info: [{"id": "4718fa68-0eb9-4592-8c43-981438e3d0b8", "address": "fa:16:3e:e4:28:3b", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4718fa68-0e", "ovs_interfaceid": "4718fa68-0eb9-4592-8c43-981438e3d0b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:23:56 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-80e01595-cfc0-4a5c-a1e6-64b8307328ee req-880cd608-9a98-4378-9d2e-117fe8d4ac09 service nova] Releasing lock "refresh_cache-b0d90fd2-6a95-43c4-8756-e82071d99154" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:23:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:57 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Acquiring lock "068f10b4-086e-4af7-a53e-f6ece73d01e4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:57 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "068f10b4-086e-4af7-a53e-f6ece73d01e4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:57 user nova-compute[71229]: DEBUG nova.compute.manager [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Starting instance... {{(pid=71229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 15:23:57 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:57 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:57 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 15:23:57 user nova-compute[71229]: INFO nova.compute.claims [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Claim successful on node user
Apr 11 15:23:57 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:23:57 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:23:57 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:57 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.297s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:23:57 user nova-compute[71229]: DEBUG nova.compute.manager [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Start building networks asynchronously for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 15:23:57 user nova-compute[71229]: DEBUG nova.compute.manager [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Allocating IP information in the background. {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 15:23:57 user nova-compute[71229]: DEBUG nova.network.neutron [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] allocate_for_instance() {{(pid=71229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 15:23:57 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 15:23:57 user nova-compute[71229]: DEBUG nova.compute.manager [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Start building block device mappings for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 15:23:58 user nova-compute[71229]: DEBUG nova.compute.manager [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Start spawning the instance on the hypervisor. {{(pid=71229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 15:23:58 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Creating instance directory {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 15:23:58 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Creating image(s)
Apr 11 15:23:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Acquiring lock "/opt/stack/data/nova/instances/068f10b4-086e-4af7-a53e-f6ece73d01e4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "/opt/stack/data/nova/instances/068f10b4-086e-4af7-a53e-f6ece73d01e4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "/opt/stack/data/nova/instances/068f10b4-086e-4af7-a53e-f6ece73d01e4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:23:58 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:23:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:58 user nova-compute[71229]: DEBUG nova.policy [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'acc44d2042554ca0b0bde4b2de5b566a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a341ccfc0b4f08bb2e97083143dd40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71229) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 15:23:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.144s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Acquiring lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.133s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/068f10b4-086e-4af7-a53e-f6ece73d01e4/disk 1073741824 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/068f10b4-086e-4af7-a53e-f6ece73d01e4/disk 1073741824" returned: 0 in 0.050s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:58 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:23:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:23:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:58 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:23:58 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 15:23:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "refresh_cache-6a805345-374c-4326-9e8f-39bfc7947a35" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:23:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquired lock "refresh_cache-6a805345-374c-4326-9e8f-39bfc7947a35" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:23:58 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Forcefully refreshing network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 15:23:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.141s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:58 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Checking if we can resize image /opt/stack/data/nova/instances/068f10b4-086e-4af7-a53e-f6ece73d01e4/disk. size=1073741824 {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 15:23:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/068f10b4-086e-4af7-a53e-f6ece73d01e4/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/068f10b4-086e-4af7-a53e-f6ece73d01e4/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:58 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Cannot resize image /opt/stack/data/nova/instances/068f10b4-086e-4af7-a53e-f6ece73d01e4/disk to a smaller size. {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 15:23:58 user nova-compute[71229]: DEBUG nova.objects.instance [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lazy-loading 'migration_context' on Instance uuid 068f10b4-086e-4af7-a53e-f6ece73d01e4 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:23:58 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Created local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 15:23:58 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Ensure instance console log exists: /opt/stack/data/nova/instances/068f10b4-086e-4af7-a53e-f6ece73d01e4/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 15:23:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:23:59 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Updating instance_info_cache with network_info: [{"id": "d8c64197-b034-4f38-821d-ba030f1fca6b", "address": "fa:16:3e:0f:f8:cb", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c64197-b0", "ovs_interfaceid": "d8c64197-b034-4f38-821d-ba030f1fca6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:23:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Releasing lock "refresh_cache-6a805345-374c-4326-9e8f-39bfc7947a35" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:23:59 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Updated the network info_cache for instance {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 15:23:59 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:23:59 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:23:59 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:23:59 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:23:59 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:23:59 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:23:59 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 15:23:59 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:23:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:23:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:23:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:23:59 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 15:23:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:59 user nova-compute[71229]: DEBUG nova.network.neutron [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Successfully created port: 7774938e-52d1-4c9a-8bc5-db84a905791b {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 15:23:59 user nova-compute[71229]: DEBUG os_brick.utils [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:23:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:59 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eee30d3-8309-477e-8b34-75630366b86d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d55e24a97c90\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d84862f-b710-48b1-9275-93fc799cf1f9/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:59 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[82979011-ee8a-4c98-96bf-382e8a0a98b7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:59 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[354784ca-df88-466d-b5a3-41beaa6d9787]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:59 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[da089469-0454-4326-96cc-c349b7a4f13d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Running cmd (subprocess): nvme version {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] 'nvme version' failed. Not Retrying. {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:23:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] nvme not present on system {{(pid=71229) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 15:23:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:23:59 user nova-compute[71229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 15:23:59 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c44d9b-6edb-4d2e-8135-e3c19b6904b3]: (4, '') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:23:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71229) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 15:23:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 15:23:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] LIGHTOS: no hostnqn found. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 15:23:59 user nova-compute[71229]: DEBUG os_brick.utils [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d55e24a97c90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:23:59 user nova-compute[71229]: DEBUG nova.virt.block_device [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Updating existing volume attachment record: bf049eeb-6a44-4515-bd14-2291e1eb4280 {{(pid=71229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 15:23:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d84862f-b710-48b1-9275-93fc799cf1f9/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d84862f-b710-48b1-9275-93fc799cf1f9/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:23:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d84862f-b710-48b1-9275-93fc799cf1f9/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:23:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a06747-0f43-4731-87e6-40629c382a6b/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a06747-0f43-4731-87e6-40629c382a6b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a06747-0f43-4731-87e6-40629c382a6b/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a06747-0f43-4731-87e6-40629c382a6b/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:00 user nova-compute[71229]: DEBUG nova.network.neutron [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Successfully updated port: 7774938e-52d1-4c9a-8bc5-db84a905791b {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:24:00 user nova-compute[71229]: DEBUG nova.compute.manager [req-5a8b542f-f374-40d6-ab32-3d632acae26d req-b6e7d844-3150-4085-9a4f-814452ce09d1 service nova] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Received event network-changed-7774938e-52d1-4c9a-8bc5-db84a905791b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:24:00 user nova-compute[71229]: DEBUG nova.compute.manager [req-5a8b542f-f374-40d6-ab32-3d632acae26d req-b6e7d844-3150-4085-9a4f-814452ce09d1 service nova] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Refreshing instance network info cache due to event network-changed-7774938e-52d1-4c9a-8bc5-db84a905791b. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:24:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-5a8b542f-f374-40d6-ab32-3d632acae26d req-b6e7d844-3150-4085-9a4f-814452ce09d1 service nova] Acquiring lock "refresh_cache-068f10b4-086e-4af7-a53e-f6ece73d01e4" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:24:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-5a8b542f-f374-40d6-ab32-3d632acae26d req-b6e7d844-3150-4085-9a4f-814452ce09d1 service nova] Acquired lock "refresh_cache-068f10b4-086e-4af7-a53e-f6ece73d01e4" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:24:00 user nova-compute[71229]: DEBUG nova.network.neutron [req-5a8b542f-f374-40d6-ab32-3d632acae26d req-b6e7d844-3150-4085-9a4f-814452ce09d1 service nova] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Refreshing network info cache for port 7774938e-52d1-4c9a-8bc5-db84a905791b {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:24:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Acquiring lock "refresh_cache-068f10b4-086e-4af7-a53e-f6ece73d01e4" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:24:00 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:24:00 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:24:00 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8450MB free_disk=26.390216827392578GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 15:24:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:24:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:24:00 user nova-compute[71229]: DEBUG nova.network.neutron [req-5a8b542f-f374-40d6-ab32-3d632acae26d req-b6e7d844-3150-4085-9a4f-814452ce09d1 service nova] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance de1a45fd-27be-4438-80a4-2f3a100643c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 6a805345-374c-4326-9e8f-39bfc7947a35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 8d84862f-b710-48b1-9275-93fc799cf1f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance f3a06747-0f43-4731-87e6-40629c382a6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance b0d90fd2-6a95-43c4-8756-e82071d99154 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 068f10b4-086e-4af7-a53e-f6ece73d01e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=1280MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG nova.network.neutron [req-5a8b542f-f374-40d6-ab32-3d632acae26d req-b6e7d844-3150-4085-9a4f-814452ce09d1 service nova] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.364s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-5a8b542f-f374-40d6-ab32-3d632acae26d req-b6e7d844-3150-4085-9a4f-814452ce09d1 service nova] Releasing lock "refresh_cache-068f10b4-086e-4af7-a53e-f6ece73d01e4" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Acquired lock "refresh_cache-068f10b4-086e-4af7-a53e-f6ece73d01e4" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG nova.network.neutron [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG nova.network.neutron [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG nova.network.neutron [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Updating instance_info_cache with network_info: [{"id": "7774938e-52d1-4c9a-8bc5-db84a905791b", "address": "fa:16:3e:87:e3:63", "network": {"id": "5b9dc948-4f8b-460a-bc87-04cf194f5c08", "bridge": "br-int", "label": "tempest-VolumesActionsTest-712454576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b4a341ccfc0b4f08bb2e97083143dd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7774938e-52", "ovs_interfaceid": "7774938e-52d1-4c9a-8bc5-db84a905791b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Releasing lock "refresh_cache-068f10b4-086e-4af7-a53e-f6ece73d01e4" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG nova.compute.manager [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Instance network_info: |[{"id": "7774938e-52d1-4c9a-8bc5-db84a905791b", "address": "fa:16:3e:87:e3:63", "network": {"id": "5b9dc948-4f8b-460a-bc87-04cf194f5c08", "bridge": "br-int", "label": "tempest-VolumesActionsTest-712454576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b4a341ccfc0b4f08bb2e97083143dd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7774938e-52", "ovs_interfaceid": "7774938e-52d1-4c9a-8bc5-db84a905791b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Start _get_guest_xml network_info=[{"id": "7774938e-52d1-4c9a-8bc5-db84a905791b", "address": "fa:16:3e:87:e3:63", "network": {"id": "5b9dc948-4f8b-460a-bc87-04cf194f5c08", "bridge": "br-int", "label": "tempest-VolumesActionsTest-712454576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b4a341ccfc0b4f08bb2e97083143dd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7774938e-52", "ovs_interfaceid": "7774938e-52d1-4c9a-8bc5-db84a905791b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '52fe638c-5ada-47d5-b376-233bfa808a37'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:24:01 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:24:01 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:24:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:23:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1438339496',display_name='tempest-VolumesActionsTest-instance-1438339496',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1438339496',id=11,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4a341ccfc0b4f08bb2e97083143dd40',ramdisk_id='',reservation_id='r-0diowjg5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1278032672',owner_user_name='tempest-VolumesActionsTest-1278032672-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:23:58Z,user_data=None,user_id='acc44d2042554ca0b0bde4b2de5b566a',uuid=068f10b4-086e-4af7-a53e-f6ece73d01e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7774938e-52d1-4c9a-8bc5-db84a905791b", "address": "fa:16:3e:87:e3:63", "network": {"id": "5b9dc948-4f8b-460a-bc87-04cf194f5c08", "bridge": "br-int", "label": "tempest-VolumesActionsTest-712454576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b4a341ccfc0b4f08bb2e97083143dd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7774938e-52", "ovs_interfaceid": "7774938e-52d1-4c9a-8bc5-db84a905791b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Converting VIF {"id": "7774938e-52d1-4c9a-8bc5-db84a905791b", "address": "fa:16:3e:87:e3:63", "network": {"id": "5b9dc948-4f8b-460a-bc87-04cf194f5c08", "bridge": "br-int", "label": "tempest-VolumesActionsTest-712454576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b4a341ccfc0b4f08bb2e97083143dd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7774938e-52", "ovs_interfaceid": "7774938e-52d1-4c9a-8bc5-db84a905791b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:e3:63,bridge_name='br-int',has_traffic_filtering=True,id=7774938e-52d1-4c9a-8bc5-db84a905791b,network=Network(5b9dc948-4f8b-460a-bc87-04cf194f5c08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7774938e-52') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG nova.objects.instance [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lazy-loading 'pci_devices' on Instance uuid 068f10b4-086e-4af7-a53e-f6ece73d01e4 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:24:01 user nova-compute[71229]:   <uuid>068f10b4-086e-4af7-a53e-f6ece73d01e4</uuid>
Apr 11 15:24:01 user nova-compute[71229]:   <name>instance-0000000b</name>
Apr 11 15:24:01 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:24:01 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:24:01 user nova-compute[71229]:   <metadata>
Apr 11 15:24:01 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:24:01 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:24:01 user nova-compute[71229]:       <nova:name>tempest-VolumesActionsTest-instance-1438339496</nova:name>
Apr 11 15:24:01 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:24:01</nova:creationTime>
Apr 11 15:24:01 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:24:01 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:24:01 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:24:01 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:24:01 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:24:01 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:24:01 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:24:01 user nova-compute[71229]:       <nova:owner>
Apr 11 15:24:01 user nova-compute[71229]:         <nova:user uuid="acc44d2042554ca0b0bde4b2de5b566a">tempest-VolumesActionsTest-1278032672-project-member</nova:user>
Apr 11 15:24:01 user nova-compute[71229]:         <nova:project uuid="b4a341ccfc0b4f08bb2e97083143dd40">tempest-VolumesActionsTest-1278032672</nova:project>
Apr 11 15:24:01 user nova-compute[71229]:       </nova:owner>
Apr 11 15:24:01 user nova-compute[71229]:       <nova:root type="image" uuid="52fe638c-5ada-47d5-b376-233bfa808a37"/>
Apr 11 15:24:01 user nova-compute[71229]:       <nova:ports>
Apr 11 15:24:01 user nova-compute[71229]:         <nova:port uuid="7774938e-52d1-4c9a-8bc5-db84a905791b">
Apr 11 15:24:01 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.2" ipVersion="4"/>
Apr 11 15:24:01 user nova-compute[71229]:         </nova:port>
Apr 11 15:24:01 user nova-compute[71229]:       </nova:ports>
Apr 11 15:24:01 user nova-compute[71229]:     </nova:instance>
Apr 11 15:24:01 user nova-compute[71229]:   </metadata>
Apr 11 15:24:01 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:24:01 user nova-compute[71229]:     <system>
Apr 11 15:24:01 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:24:01 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:24:01 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:24:01 user nova-compute[71229]:       <entry name="serial">068f10b4-086e-4af7-a53e-f6ece73d01e4</entry>
Apr 11 15:24:01 user nova-compute[71229]:       <entry name="uuid">068f10b4-086e-4af7-a53e-f6ece73d01e4</entry>
Apr 11 15:24:01 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:24:01 user nova-compute[71229]:     </system>
Apr 11 15:24:01 user nova-compute[71229]:   </sysinfo>
Apr 11 15:24:01 user nova-compute[71229]:   <os>
Apr 11 15:24:01 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:24:01 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 15:24:01 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:24:01 user nova-compute[71229]:   </os>
Apr 11 15:24:01 user nova-compute[71229]:   <features>
Apr 11 15:24:01 user nova-compute[71229]:     <acpi/>
Apr 11 15:24:01 user nova-compute[71229]:     <apic/>
Apr 11 15:24:01 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:24:01 user nova-compute[71229]:   </features>
Apr 11 15:24:01 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:24:01 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:24:01 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:24:01 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:24:01 user nova-compute[71229]:   </clock>
Apr 11 15:24:01 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:24:01 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:24:01 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:24:01 user nova-compute[71229]:   </cpu>
Apr 11 15:24:01 user nova-compute[71229]:   <devices>
Apr 11 15:24:01 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 15:24:01 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 15:24:01 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/068f10b4-086e-4af7-a53e-f6ece73d01e4/disk"/>
Apr 11 15:24:01 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:24:01 user nova-compute[71229]:     </disk>
Apr 11 15:24:01 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:24:01 user nova-compute[71229]:       <mac address="fa:16:3e:87:e3:63"/>
Apr 11 15:24:01 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:24:01 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:24:01 user nova-compute[71229]:       <target dev="tap7774938e-52"/>
Apr 11 15:24:01 user nova-compute[71229]:     </interface>
Apr 11 15:24:01 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:24:01 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/068f10b4-086e-4af7-a53e-f6ece73d01e4/console.log" append="off"/>
Apr 11 15:24:01 user nova-compute[71229]:     </serial>
Apr 11 15:24:01 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:24:01 user nova-compute[71229]:     <video>
Apr 11 15:24:01 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:24:01 user nova-compute[71229]:     </video>
Apr 11 15:24:01 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:24:01 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:24:01 user nova-compute[71229]:     </rng>
Apr 11 15:24:01 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:24:01 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:24:01 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:24:01 user nova-compute[71229]:     </memballoon>
Apr 11 15:24:01 user nova-compute[71229]:   </devices>
Apr 11 15:24:01 user nova-compute[71229]: </domain>
Apr 11 15:24:01 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:23:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1438339496',display_name='tempest-VolumesActionsTest-instance-1438339496',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1438339496',id=11,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4a341ccfc0b4f08bb2e97083143dd40',ramdisk_id='',reservation_id='r-0diowjg5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1278032672',owner_user_name='tempest-VolumesActionsTest-1278032672-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:23:58Z,user_data=None,user_id='acc44d2042554ca0b0bde4b2de5b566a',uuid=068f10b4-086e-4af7-a53e-f6ece73d01e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7774938e-52d1-4c9a-8bc5-db84a905791b", "address": "fa:16:3e:87:e3:63", "network": {"id": "5b9dc948-4f8b-460a-bc87-04cf194f5c08", "bridge": "br-int", "label": "tempest-VolumesActionsTest-712454576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b4a341ccfc0b4f08bb2e97083143dd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7774938e-52", "ovs_interfaceid": "7774938e-52d1-4c9a-8bc5-db84a905791b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Converting VIF {"id": "7774938e-52d1-4c9a-8bc5-db84a905791b", "address": "fa:16:3e:87:e3:63", "network": {"id": "5b9dc948-4f8b-460a-bc87-04cf194f5c08", "bridge": "br-int", "label": "tempest-VolumesActionsTest-712454576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b4a341ccfc0b4f08bb2e97083143dd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7774938e-52", "ovs_interfaceid": "7774938e-52d1-4c9a-8bc5-db84a905791b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:e3:63,bridge_name='br-int',has_traffic_filtering=True,id=7774938e-52d1-4c9a-8bc5-db84a905791b,network=Network(5b9dc948-4f8b-460a-bc87-04cf194f5c08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7774938e-52') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG os_vif [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:e3:63,bridge_name='br-int',has_traffic_filtering=True,id=7774938e-52d1-4c9a-8bc5-db84a905791b,network=Network(5b9dc948-4f8b-460a-bc87-04cf194f5c08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7774938e-52') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7774938e-52, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7774938e-52, col_values=(('external_ids', {'iface-id': '7774938e-52d1-4c9a-8bc5-db84a905791b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:e3:63', 'vm-uuid': '068f10b4-086e-4af7-a53e-f6ece73d01e4'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:01 user nova-compute[71229]: INFO os_vif [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:e3:63,bridge_name='br-int',has_traffic_filtering=True,id=7774938e-52d1-4c9a-8bc5-db84a905791b,network=Network(5b9dc948-4f8b-460a-bc87-04cf194f5c08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7774938e-52')
Apr 11 15:24:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:24:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] No VIF found with MAC fa:16:3e:87:e3:63, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:24:02 user nova-compute[71229]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681226627.7818236, cda43d26-e2f7-4e86-b850-b914957c9b57 => Stopped> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:24:02 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] VM Stopped (Lifecycle Event)
Apr 11 15:24:02 user nova-compute[71229]: DEBUG nova.compute.manager [None req-7c38301a-505e-4e9f-9dec-e0488a42bb67 None None] [instance: cda43d26-e2f7-4e86-b850-b914957c9b57] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:24:03 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:03 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:03 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:03 user nova-compute[71229]: DEBUG nova.compute.manager [req-1b0b6637-3b82-492b-8534-66a0c6a635f3 req-def02f8a-b709-4799-a0c9-69b1141fe602 service nova] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Received event network-vif-plugged-7774938e-52d1-4c9a-8bc5-db84a905791b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:24:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-1b0b6637-3b82-492b-8534-66a0c6a635f3 req-def02f8a-b709-4799-a0c9-69b1141fe602 service nova] Acquiring lock "068f10b4-086e-4af7-a53e-f6ece73d01e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:24:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-1b0b6637-3b82-492b-8534-66a0c6a635f3 req-def02f8a-b709-4799-a0c9-69b1141fe602 service nova] Lock "068f10b4-086e-4af7-a53e-f6ece73d01e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:24:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-1b0b6637-3b82-492b-8534-66a0c6a635f3 req-def02f8a-b709-4799-a0c9-69b1141fe602 service nova] Lock "068f10b4-086e-4af7-a53e-f6ece73d01e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:24:03 user nova-compute[71229]: DEBUG nova.compute.manager [req-1b0b6637-3b82-492b-8534-66a0c6a635f3 req-def02f8a-b709-4799-a0c9-69b1141fe602 service nova] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] No waiting events found dispatching network-vif-plugged-7774938e-52d1-4c9a-8bc5-db84a905791b {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:24:03 user nova-compute[71229]: WARNING nova.compute.manager [req-1b0b6637-3b82-492b-8534-66a0c6a635f3 req-def02f8a-b709-4799-a0c9-69b1141fe602 service nova] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Received unexpected event network-vif-plugged-7774938e-52d1-4c9a-8bc5-db84a905791b for instance with vm_state building and task_state spawning.
Apr 11 15:24:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG nova.compute.manager [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Starting instance... {{(pid=71229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG nova.compute.manager [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Start spawning the instance on the hypervisor. {{(pid=71229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Creating instance directory {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 15:24:04 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Creating image(s)
Apr 11 15:24:04 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Did not create local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Ensure instance console log exists: /opt/stack/data/nova/instances/b0d90fd2-6a95-43c4-8756-e82071d99154/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Start _get_guest_xml network_info=[{"id": "4718fa68-0eb9-4592-8c43-981438e3d0b8", "address": "fa:16:3e:e4:28:3b", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4718fa68-0e", "ovs_interfaceid": "4718fa68-0eb9-4592-8c43-981438e3d0b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QxVsBWUp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b0d90fd2-6a95-43c4-8756-e82071d99154', 'attached_at': '', 'detached_at': '', 'volume_id': '65c1d870-4696-4892-9abe-b305824a04eb', 'serial': '65c1d870-4696-4892-9abe-b305824a04eb'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'bf049eeb-6a44-4515-bd14-2291e1eb4280', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:24:04 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:24:04 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:24:04 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QxVsBWUp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:24:04 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:24:04 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:24:04 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:24:04 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:24:04 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 15:24:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 15:24:04 user nova-compute[71229]: INFO nova.compute.claims [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Claim successful on node user
Apr 11 15:24:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2c7714-2381-416b-8367-d9cb41c43fdc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 15:24:04 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb -p 172.16.0.220:3260 --interface default --op new {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[658b6d25-cf31-4e1f-8879-109be74e0b40]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb] added\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb] added
Apr 11 15:24:04 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d3ca76-68c4-4a6b-abbf-c57aa9f2ad88]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a30daeb-3e40-499d-889d-884ef7a299ea]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QxVsBWUp {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QxVsBWUp" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbe75bf-a6bd-4d5b-aad2-b36c16d6eab0]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QxVsBWUp'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9003c952-6ae0-439e-a864-163f60e6b04b]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e331ec-bcf2-4875-a85e-01fbb65a148f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 11 15:24:04 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 11 15:24:04 user nova-compute[71229]:  {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:24:04 user nova-compute[71229]: WARNING os_brick.initiator.connectors.iscsi [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 11 15:24:04 user nova-compute[71229]: 
Apr 11 15:24:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb -p 172.16.0.220:3260 --login {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c92c29e-c88b-46f8-bb34-36c797794f2c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb, portal: 172.16.0.220,3260]
Apr 11 15:24:04 user nova-compute[71229]: Login to [iface: default, target: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb, portal: 172.16.0.220,3260] successful.
Apr 11 15:24:04 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad447305-67db-4a31-bad4-3eb5509307e8]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e0b29b-4277-471c-8120-8a99437bbb62]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:24:04 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:24:04 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] HCTL ('33', '-', '-', 0) found on session 12 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf23010d-c841-4aef-8754-f14c1ebc70eb]: (4, ('- - 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QxVsBWUp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.336s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG nova.compute.manager [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Start building networks asynchronously for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG nova.compute.manager [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Allocating IP information in the background. {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG nova.network.neutron [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] allocate_for_instance() {{(pid=71229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 15:24:04 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 15:24:04 user nova-compute[71229]: DEBUG nova.compute.manager [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Start building block device mappings for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG nova.policy [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '88d988d9ce0a41669b7c487ac07b4cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b9b79fb98441fd9f1b5df54471f0bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71229) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG nova.compute.manager [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Start spawning the instance on the hypervisor. {{(pid=71229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Creating instance directory {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 15:24:04 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Creating image(s)
Apr 11 15:24:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "/opt/stack/data/nova/instances/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "/opt/stack/data/nova/instances/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "/opt/stack/data/nova/instances/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.132s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:24:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.141s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/disk 1073741824 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/disk 1073741824" returned: 0 in 0.053s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.146s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/disk. size=1073741824 {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681226645.3286064, 068f10b4-086e-4af7-a53e-f6ece73d01e4 => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:24:05 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] VM Resumed (Lifecycle Event)
Apr 11 15:24:05 user nova-compute[71229]: DEBUG nova.compute.manager [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Guest created on hypervisor {{(pid=71229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 15:24:05 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Instance spawned successfully.
Apr 11 15:24:05 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:24:05 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:24:05 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681226645.3328314, 068f10b4-086e-4af7-a53e-f6ece73d01e4 => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:24:05 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] VM Started (Lifecycle Event)
Apr 11 15:24:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Cannot resize image /opt/stack/data/nova/instances/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/disk to a smaller size. {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG nova.objects.instance [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lazy-loading 'migration_context' on Instance uuid 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Found default for hw_cdrom_bus of ide {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Found default for hw_disk_bus of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Found default for hw_input_bus of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Found default for hw_pointer_model of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Found default for hw_video_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Found default for hw_vif_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Created local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Ensure instance console log exists: /opt/stack/data/nova/instances/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG nova.compute.manager [req-2aee0eac-f75e-46dc-a71d-e5d1b5be9196 req-dc2b8933-5ca7-43dc-863d-fe2868abb5a3 service nova] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Received event network-vif-plugged-7774938e-52d1-4c9a-8bc5-db84a905791b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2aee0eac-f75e-46dc-a71d-e5d1b5be9196 req-dc2b8933-5ca7-43dc-863d-fe2868abb5a3 service nova] Acquiring lock "068f10b4-086e-4af7-a53e-f6ece73d01e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2aee0eac-f75e-46dc-a71d-e5d1b5be9196 req-dc2b8933-5ca7-43dc-863d-fe2868abb5a3 service nova] Lock "068f10b4-086e-4af7-a53e-f6ece73d01e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2aee0eac-f75e-46dc-a71d-e5d1b5be9196 req-dc2b8933-5ca7-43dc-863d-fe2868abb5a3 service nova] Lock "068f10b4-086e-4af7-a53e-f6ece73d01e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG nova.compute.manager [req-2aee0eac-f75e-46dc-a71d-e5d1b5be9196 req-dc2b8933-5ca7-43dc-863d-fe2868abb5a3 service nova] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] No waiting events found dispatching network-vif-plugged-7774938e-52d1-4c9a-8bc5-db84a905791b {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:24:05 user nova-compute[71229]: WARNING nova.compute.manager [req-2aee0eac-f75e-46dc-a71d-e5d1b5be9196 req-dc2b8933-5ca7-43dc-863d-fe2868abb5a3 service nova] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Received unexpected event network-vif-plugged-7774938e-52d1-4c9a-8bc5-db84a905791b for instance with vm_state building and task_state spawning.
Apr 11 15:24:05 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:24:05 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:24:05 user nova-compute[71229]: INFO nova.compute.manager [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Took 7.42 seconds to spawn the instance on the hypervisor.
Apr 11 15:24:05 user nova-compute[71229]: DEBUG nova.compute.manager [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23035613564313763', 'path': '/dev/sdb'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035613564313763', 'path': '/dev/sdb'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:23:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-785051320',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-785051320',id=10,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ddc05e9bf5ab426982ccb3092ad596e4',ramdisk_id='',reservation_id='r-cxnpum04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1907753459',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:23:54Z,user_data=None,user_id='1d60ce27bfad4d7c9b976e834df35ad4',uuid=b0d90fd2-6a95-43c4-8756-e82071d99154,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4718fa68-0eb9-4592-8c43-981438e3d0b8", "address": "fa:16:3e:e4:28:3b", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4718fa68-0e", "ovs_interfaceid": "4718fa68-0eb9-4592-8c43-981438e3d0b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Converting VIF {"id": "4718fa68-0eb9-4592-8c43-981438e3d0b8", "address": "fa:16:3e:e4:28:3b", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4718fa68-0e", "ovs_interfaceid": "4718fa68-0eb9-4592-8c43-981438e3d0b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:28:3b,bridge_name='br-int',has_traffic_filtering=True,id=4718fa68-0eb9-4592-8c43-981438e3d0b8,network=Network(1cf4cec3-ff08-4320-89e4-aa7e8cf75eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4718fa68-0e') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG nova.objects.instance [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lazy-loading 'pci_devices' on Instance uuid b0d90fd2-6a95-43c4-8756-e82071d99154 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:24:05 user nova-compute[71229]:   <uuid>b0d90fd2-6a95-43c4-8756-e82071d99154</uuid>
Apr 11 15:24:05 user nova-compute[71229]:   <name>instance-0000000a</name>
Apr 11 15:24:05 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:24:05 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:24:05 user nova-compute[71229]:   <metadata>
Apr 11 15:24:05 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:24:05 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:24:05 user nova-compute[71229]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-785051320</nova:name>
Apr 11 15:24:05 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:24:04</nova:creationTime>
Apr 11 15:24:05 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:24:05 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:24:05 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:24:05 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:24:05 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:24:05 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:24:05 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:24:05 user nova-compute[71229]:       <nova:owner>
Apr 11 15:24:05 user nova-compute[71229]:         <nova:user uuid="1d60ce27bfad4d7c9b976e834df35ad4">tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member</nova:user>
Apr 11 15:24:05 user nova-compute[71229]:         <nova:project uuid="ddc05e9bf5ab426982ccb3092ad596e4">tempest-ServerBootFromVolumeStableRescueTest-1907753459</nova:project>
Apr 11 15:24:05 user nova-compute[71229]:       </nova:owner>
Apr 11 15:24:05 user nova-compute[71229]:       <nova:root type="image" uuid="52fe638c-5ada-47d5-b376-233bfa808a37"/>
Apr 11 15:24:05 user nova-compute[71229]:       <nova:ports>
Apr 11 15:24:05 user nova-compute[71229]:         <nova:port uuid="4718fa68-0eb9-4592-8c43-981438e3d0b8">
Apr 11 15:24:05 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 11 15:24:05 user nova-compute[71229]:         </nova:port>
Apr 11 15:24:05 user nova-compute[71229]:       </nova:ports>
Apr 11 15:24:05 user nova-compute[71229]:     </nova:instance>
Apr 11 15:24:05 user nova-compute[71229]:   </metadata>
Apr 11 15:24:05 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:24:05 user nova-compute[71229]:     <system>
Apr 11 15:24:05 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:24:05 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:24:05 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:24:05 user nova-compute[71229]:       <entry name="serial">b0d90fd2-6a95-43c4-8756-e82071d99154</entry>
Apr 11 15:24:05 user nova-compute[71229]:       <entry name="uuid">b0d90fd2-6a95-43c4-8756-e82071d99154</entry>
Apr 11 15:24:05 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:24:05 user nova-compute[71229]:     </system>
Apr 11 15:24:05 user nova-compute[71229]:   </sysinfo>
Apr 11 15:24:05 user nova-compute[71229]:   <os>
Apr 11 15:24:05 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:24:05 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 15:24:05 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:24:05 user nova-compute[71229]:   </os>
Apr 11 15:24:05 user nova-compute[71229]:   <features>
Apr 11 15:24:05 user nova-compute[71229]:     <acpi/>
Apr 11 15:24:05 user nova-compute[71229]:     <apic/>
Apr 11 15:24:05 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:24:05 user nova-compute[71229]:   </features>
Apr 11 15:24:05 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:24:05 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:24:05 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:24:05 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:24:05 user nova-compute[71229]:   </clock>
Apr 11 15:24:05 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:24:05 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:24:05 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:24:05 user nova-compute[71229]:   </cpu>
Apr 11 15:24:05 user nova-compute[71229]:   <devices>
Apr 11 15:24:05 user nova-compute[71229]:     <disk type="block" device="disk">
Apr 11 15:24:05 user nova-compute[71229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:24:05 user nova-compute[71229]:       <source dev="/dev/sdb"/>
Apr 11 15:24:05 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:24:05 user nova-compute[71229]:       <serial>65c1d870-4696-4892-9abe-b305824a04eb</serial>
Apr 11 15:24:05 user nova-compute[71229]:     </disk>
Apr 11 15:24:05 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:24:05 user nova-compute[71229]:       <mac address="fa:16:3e:e4:28:3b"/>
Apr 11 15:24:05 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:24:05 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:24:05 user nova-compute[71229]:       <target dev="tap4718fa68-0e"/>
Apr 11 15:24:05 user nova-compute[71229]:     </interface>
Apr 11 15:24:05 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:24:05 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/b0d90fd2-6a95-43c4-8756-e82071d99154/console.log" append="off"/>
Apr 11 15:24:05 user nova-compute[71229]:     </serial>
Apr 11 15:24:05 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:24:05 user nova-compute[71229]:     <video>
Apr 11 15:24:05 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:24:05 user nova-compute[71229]:     </video>
Apr 11 15:24:05 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:24:05 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:24:05 user nova-compute[71229]:     </rng>
Apr 11 15:24:05 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:24:05 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:24:05 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:24:05 user nova-compute[71229]:     </memballoon>
Apr 11 15:24:05 user nova-compute[71229]:   </devices>
Apr 11 15:24:05 user nova-compute[71229]: </domain>
Apr 11 15:24:05 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:23:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-785051320',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-785051320',id=10,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ddc05e9bf5ab426982ccb3092ad596e4',ramdisk_id='',reservation_id='r-cxnpum04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1907753459',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:23:54Z,user_data=None,user_id='1d60ce27bfad4d7c9b976e834df35ad4',uuid=b0d90fd2-6a95-43c4-8756-e82071d99154,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4718fa68-0eb9-4592-8c43-981438e3d0b8", "address": "fa:16:3e:e4:28:3b", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4718fa68-0e", "ovs_interfaceid": "4718fa68-0eb9-4592-8c43-981438e3d0b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Converting VIF {"id": "4718fa68-0eb9-4592-8c43-981438e3d0b8", "address": "fa:16:3e:e4:28:3b", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4718fa68-0e", "ovs_interfaceid": "4718fa68-0eb9-4592-8c43-981438e3d0b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:28:3b,bridge_name='br-int',has_traffic_filtering=True,id=4718fa68-0eb9-4592-8c43-981438e3d0b8,network=Network(1cf4cec3-ff08-4320-89e4-aa7e8cf75eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4718fa68-0e') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG os_vif [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:28:3b,bridge_name='br-int',has_traffic_filtering=True,id=4718fa68-0eb9-4592-8c43-981438e3d0b8,network=Network(1cf4cec3-ff08-4320-89e4-aa7e8cf75eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4718fa68-0e') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4718fa68-0e, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4718fa68-0e, col_values=(('external_ids', {'iface-id': '4718fa68-0eb9-4592-8c43-981438e3d0b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:28:3b', 'vm-uuid': 'b0d90fd2-6a95-43c4-8756-e82071d99154'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:05 user nova-compute[71229]: INFO os_vif [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:28:3b,bridge_name='br-int',has_traffic_filtering=True,id=4718fa68-0eb9-4592-8c43-981438e3d0b8,network=Network(1cf4cec3-ff08-4320-89e4-aa7e8cf75eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4718fa68-0e')
Apr 11 15:24:05 user nova-compute[71229]: INFO nova.compute.manager [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Took 8.06 seconds to build instance.
Apr 11 15:24:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c7ea558e-84df-4336-bb7a-a3234aa940fb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "068f10b4-086e-4af7-a53e-f6ece73d01e4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.144s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG nova.network.neutron [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Successfully created port: 1ad8234a-3f96-43a0-9dea-862e6efcda73 {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:24:05 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] No VIF found with MAC fa:16:3e:e4:28:3b, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:24:06 user nova-compute[71229]: DEBUG nova.network.neutron [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Successfully updated port: 1ad8234a-3f96-43a0-9dea-862e6efcda73 {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:24:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "refresh_cache-1e01618b-2aa4-4b56-b1a2-0d6e25e3075d" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:24:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquired lock "refresh_cache-1e01618b-2aa4-4b56-b1a2-0d6e25e3075d" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:24:06 user nova-compute[71229]: DEBUG nova.network.neutron [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:24:06 user nova-compute[71229]: DEBUG nova.compute.manager [req-ca06187a-6ac5-4fc0-9ee7-df48ced09813 req-9c686669-86ea-49ad-8601-a0291b7c2f32 service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Received event network-changed-1ad8234a-3f96-43a0-9dea-862e6efcda73 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:24:06 user nova-compute[71229]: DEBUG nova.compute.manager [req-ca06187a-6ac5-4fc0-9ee7-df48ced09813 req-9c686669-86ea-49ad-8601-a0291b7c2f32 service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Refreshing instance network info cache due to event network-changed-1ad8234a-3f96-43a0-9dea-862e6efcda73. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:24:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-ca06187a-6ac5-4fc0-9ee7-df48ced09813 req-9c686669-86ea-49ad-8601-a0291b7c2f32 service nova] Acquiring lock "refresh_cache-1e01618b-2aa4-4b56-b1a2-0d6e25e3075d" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:24:06 user nova-compute[71229]: DEBUG nova.network.neutron [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:24:06 user nova-compute[71229]: DEBUG nova.network.neutron [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Updating instance_info_cache with network_info: [{"id": "1ad8234a-3f96-43a0-9dea-862e6efcda73", "address": "fa:16:3e:54:20:be", "network": {"id": "15a1a586-0100-4057-8501-5c5a282d4063", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834988552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b9b79fb98441fd9f1b5df54471f0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad8234a-3f", "ovs_interfaceid": "1ad8234a-3f96-43a0-9dea-862e6efcda73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:24:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Releasing lock "refresh_cache-1e01618b-2aa4-4b56-b1a2-0d6e25e3075d" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:24:06 user nova-compute[71229]: DEBUG nova.compute.manager [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Instance network_info: |[{"id": "1ad8234a-3f96-43a0-9dea-862e6efcda73", "address": "fa:16:3e:54:20:be", "network": {"id": "15a1a586-0100-4057-8501-5c5a282d4063", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834988552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b9b79fb98441fd9f1b5df54471f0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad8234a-3f", "ovs_interfaceid": "1ad8234a-3f96-43a0-9dea-862e6efcda73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 15:24:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-ca06187a-6ac5-4fc0-9ee7-df48ced09813 req-9c686669-86ea-49ad-8601-a0291b7c2f32 service nova] Acquired lock "refresh_cache-1e01618b-2aa4-4b56-b1a2-0d6e25e3075d" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:24:06 user nova-compute[71229]: DEBUG nova.network.neutron [req-ca06187a-6ac5-4fc0-9ee7-df48ced09813 req-9c686669-86ea-49ad-8601-a0291b7c2f32 service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Refreshing network info cache for port 1ad8234a-3f96-43a0-9dea-862e6efcda73 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:24:06 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Start _get_guest_xml network_info=[{"id": "1ad8234a-3f96-43a0-9dea-862e6efcda73", "address": "fa:16:3e:54:20:be", "network": {"id": "15a1a586-0100-4057-8501-5c5a282d4063", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834988552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b9b79fb98441fd9f1b5df54471f0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad8234a-3f", "ovs_interfaceid": "1ad8234a-3f96-43a0-9dea-862e6efcda73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '52fe638c-5ada-47d5-b376-233bfa808a37'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:24:06 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:24:06 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:24:06 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:24:06 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:24:06 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:24:06 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:24:06 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:24:06 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:24:06 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:24:06 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:24:06 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:24:06 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:24:06 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:24:06 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:24:06 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:24:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1772068587',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1772068587',id=12,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsR3rBvaQjIOxYeSz3NLQVsG9AGAuW2r0O6Mjm+I+MgG/J7ZAhRru4tm3W0cW0RBt+UkxQ8v87/p6J8fnQe0XnKTLliPQO8+NI0fNGxiZv5WBaJ+k0gvozLOf39XTzY+Q==',key_name='tempest-keypair-2006224467',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63b9b79fb98441fd9f1b5df54471f0bd',ramdisk_id='',reservation_id='r-vjwljds2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1785499036',owner_user_name='tempest-AttachVolumeShelveTestJSON-1785499036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:24:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88d988d9ce0a41669b7c487ac07b4cfe',uuid=1e01618b-2aa4-4b56-b1a2-0d6e25e3075d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ad8234a-3f96-43a0-9dea-862e6efcda73", "address": "fa:16:3e:54:20:be", "network": {"id": "15a1a586-0100-4057-8501-5c5a282d4063", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834988552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b9b79fb98441fd9f1b5df54471f0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad8234a-3f", "ovs_interfaceid": "1ad8234a-3f96-43a0-9dea-862e6efcda73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:24:06 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Converting VIF {"id": "1ad8234a-3f96-43a0-9dea-862e6efcda73", "address": "fa:16:3e:54:20:be", "network": {"id": "15a1a586-0100-4057-8501-5c5a282d4063", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834988552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b9b79fb98441fd9f1b5df54471f0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad8234a-3f", "ovs_interfaceid": "1ad8234a-3f96-43a0-9dea-862e6efcda73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:24:06 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:20:be,bridge_name='br-int',has_traffic_filtering=True,id=1ad8234a-3f96-43a0-9dea-862e6efcda73,network=Network(15a1a586-0100-4057-8501-5c5a282d4063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad8234a-3f') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:24:06 user nova-compute[71229]: DEBUG nova.objects.instance [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:24:06 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:24:06 user nova-compute[71229]:   <uuid>1e01618b-2aa4-4b56-b1a2-0d6e25e3075d</uuid>
Apr 11 15:24:06 user nova-compute[71229]:   <name>instance-0000000c</name>
Apr 11 15:24:06 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:24:06 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:24:06 user nova-compute[71229]:   <metadata>
Apr 11 15:24:06 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:24:06 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:24:06 user nova-compute[71229]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1772068587</nova:name>
Apr 11 15:24:06 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:24:06</nova:creationTime>
Apr 11 15:24:06 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:24:06 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:24:06 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:24:06 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:24:06 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:24:06 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:24:06 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:24:06 user nova-compute[71229]:       <nova:owner>
Apr 11 15:24:06 user nova-compute[71229]:         <nova:user uuid="88d988d9ce0a41669b7c487ac07b4cfe">tempest-AttachVolumeShelveTestJSON-1785499036-project-member</nova:user>
Apr 11 15:24:06 user nova-compute[71229]:         <nova:project uuid="63b9b79fb98441fd9f1b5df54471f0bd">tempest-AttachVolumeShelveTestJSON-1785499036</nova:project>
Apr 11 15:24:06 user nova-compute[71229]:       </nova:owner>
Apr 11 15:24:06 user nova-compute[71229]:       <nova:root type="image" uuid="52fe638c-5ada-47d5-b376-233bfa808a37"/>
Apr 11 15:24:06 user nova-compute[71229]:       <nova:ports>
Apr 11 15:24:06 user nova-compute[71229]:         <nova:port uuid="1ad8234a-3f96-43a0-9dea-862e6efcda73">
Apr 11 15:24:06 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 11 15:24:06 user nova-compute[71229]:         </nova:port>
Apr 11 15:24:06 user nova-compute[71229]:       </nova:ports>
Apr 11 15:24:06 user nova-compute[71229]:     </nova:instance>
Apr 11 15:24:06 user nova-compute[71229]:   </metadata>
Apr 11 15:24:06 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:24:06 user nova-compute[71229]:     <system>
Apr 11 15:24:06 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:24:06 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:24:06 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:24:06 user nova-compute[71229]:       <entry name="serial">1e01618b-2aa4-4b56-b1a2-0d6e25e3075d</entry>
Apr 11 15:24:06 user nova-compute[71229]:       <entry name="uuid">1e01618b-2aa4-4b56-b1a2-0d6e25e3075d</entry>
Apr 11 15:24:06 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:24:06 user nova-compute[71229]:     </system>
Apr 11 15:24:06 user nova-compute[71229]:   </sysinfo>
Apr 11 15:24:06 user nova-compute[71229]:   <os>
Apr 11 15:24:06 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:24:06 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 15:24:06 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:24:06 user nova-compute[71229]:   </os>
Apr 11 15:24:06 user nova-compute[71229]:   <features>
Apr 11 15:24:06 user nova-compute[71229]:     <acpi/>
Apr 11 15:24:06 user nova-compute[71229]:     <apic/>
Apr 11 15:24:06 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:24:06 user nova-compute[71229]:   </features>
Apr 11 15:24:06 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:24:06 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:24:06 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:24:06 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:24:06 user nova-compute[71229]:   </clock>
Apr 11 15:24:06 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:24:06 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:24:06 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:24:06 user nova-compute[71229]:   </cpu>
Apr 11 15:24:06 user nova-compute[71229]:   <devices>
Apr 11 15:24:06 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 15:24:06 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 15:24:06 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/disk"/>
Apr 11 15:24:06 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:24:06 user nova-compute[71229]:     </disk>
Apr 11 15:24:06 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:24:06 user nova-compute[71229]:       <mac address="fa:16:3e:54:20:be"/>
Apr 11 15:24:06 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:24:06 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:24:06 user nova-compute[71229]:       <target dev="tap1ad8234a-3f"/>
Apr 11 15:24:06 user nova-compute[71229]:     </interface>
Apr 11 15:24:06 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:24:06 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/console.log" append="off"/>
Apr 11 15:24:06 user nova-compute[71229]:     </serial>
Apr 11 15:24:06 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:24:06 user nova-compute[71229]:     <video>
Apr 11 15:24:06 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:24:06 user nova-compute[71229]:     </video>
Apr 11 15:24:06 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:24:06 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:24:06 user nova-compute[71229]:     </rng>
Apr 11 15:24:06 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:24:06 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:24:06 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:24:06 user nova-compute[71229]:     </memballoon>
Apr 11 15:24:06 user nova-compute[71229]:   </devices>
Apr 11 15:24:06 user nova-compute[71229]: </domain>
Apr 11 15:24:06 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:24:06 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:24:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1772068587',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1772068587',id=12,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsR3rBvaQjIOxYeSz3NLQVsG9AGAuW2r0O6Mjm+I+MgG/J7ZAhRru4tm3W0cW0RBt+UkxQ8v87/p6J8fnQe0XnKTLliPQO8+NI0fNGxiZv5WBaJ+k0gvozLOf39XTzY+Q==',key_name='tempest-keypair-2006224467',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63b9b79fb98441fd9f1b5df54471f0bd',ramdisk_id='',reservation_id='r-vjwljds2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1785499036',owner_user_name='tempest-AttachVolumeShelveTestJSON-1785499036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:24:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88d988d9ce0a41669b7c487ac07b4cfe',uuid=1e01618b-2aa4-4b56-b1a2-0d6e25e3075d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ad8234a-3f96-43a0-9dea-862e6efcda73", "address": "fa:16:3e:54:20:be", "network": {"id": "15a1a586-0100-4057-8501-5c5a282d4063", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834988552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b9b79fb98441fd9f1b5df54471f0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad8234a-3f", "ovs_interfaceid": "1ad8234a-3f96-43a0-9dea-862e6efcda73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:24:06 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Converting VIF {"id": "1ad8234a-3f96-43a0-9dea-862e6efcda73", "address": "fa:16:3e:54:20:be", "network": {"id": "15a1a586-0100-4057-8501-5c5a282d4063", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834988552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b9b79fb98441fd9f1b5df54471f0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad8234a-3f", "ovs_interfaceid": "1ad8234a-3f96-43a0-9dea-862e6efcda73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:24:06 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:20:be,bridge_name='br-int',has_traffic_filtering=True,id=1ad8234a-3f96-43a0-9dea-862e6efcda73,network=Network(15a1a586-0100-4057-8501-5c5a282d4063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad8234a-3f') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:24:06 user nova-compute[71229]: DEBUG os_vif [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:20:be,bridge_name='br-int',has_traffic_filtering=True,id=1ad8234a-3f96-43a0-9dea-862e6efcda73,network=Network(15a1a586-0100-4057-8501-5c5a282d4063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad8234a-3f') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:24:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:24:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:24:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ad8234a-3f, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:24:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1ad8234a-3f, col_values=(('external_ids', {'iface-id': '1ad8234a-3f96-43a0-9dea-862e6efcda73', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:20:be', 'vm-uuid': '1e01618b-2aa4-4b56-b1a2-0d6e25e3075d'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:24:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:24:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:06 user nova-compute[71229]: INFO os_vif [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:20:be,bridge_name='br-int',has_traffic_filtering=True,id=1ad8234a-3f96-43a0-9dea-862e6efcda73,network=Network(15a1a586-0100-4057-8501-5c5a282d4063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad8234a-3f')
Apr 11 15:24:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:07 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:24:07 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] No VIF found with MAC fa:16:3e:54:20:be, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:24:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:07 user nova-compute[71229]: DEBUG nova.network.neutron [req-ca06187a-6ac5-4fc0-9ee7-df48ced09813 req-9c686669-86ea-49ad-8601-a0291b7c2f32 service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Updated VIF entry in instance network info cache for port 1ad8234a-3f96-43a0-9dea-862e6efcda73. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:24:07 user nova-compute[71229]: DEBUG nova.network.neutron [req-ca06187a-6ac5-4fc0-9ee7-df48ced09813 req-9c686669-86ea-49ad-8601-a0291b7c2f32 service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Updating instance_info_cache with network_info: [{"id": "1ad8234a-3f96-43a0-9dea-862e6efcda73", "address": "fa:16:3e:54:20:be", "network": {"id": "15a1a586-0100-4057-8501-5c5a282d4063", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834988552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b9b79fb98441fd9f1b5df54471f0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad8234a-3f", "ovs_interfaceid": "1ad8234a-3f96-43a0-9dea-862e6efcda73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:24:07 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-ca06187a-6ac5-4fc0-9ee7-df48ced09813 req-9c686669-86ea-49ad-8601-a0291b7c2f32 service nova] Releasing lock "refresh_cache-1e01618b-2aa4-4b56-b1a2-0d6e25e3075d" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:24:07 user nova-compute[71229]: DEBUG nova.compute.manager [req-1c595469-b498-49ca-9186-e59b2fcde567 req-d8c86e5d-5d70-48d7-8eda-ea12a1dfafb6 service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Received event network-vif-plugged-4718fa68-0eb9-4592-8c43-981438e3d0b8 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:24:07 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-1c595469-b498-49ca-9186-e59b2fcde567 req-d8c86e5d-5d70-48d7-8eda-ea12a1dfafb6 service nova] Acquiring lock "b0d90fd2-6a95-43c4-8756-e82071d99154-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:24:07 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-1c595469-b498-49ca-9186-e59b2fcde567 req-d8c86e5d-5d70-48d7-8eda-ea12a1dfafb6 service nova] Lock "b0d90fd2-6a95-43c4-8756-e82071d99154-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:24:07 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-1c595469-b498-49ca-9186-e59b2fcde567 req-d8c86e5d-5d70-48d7-8eda-ea12a1dfafb6 service nova] Lock "b0d90fd2-6a95-43c4-8756-e82071d99154-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:24:07 user nova-compute[71229]: DEBUG nova.compute.manager [req-1c595469-b498-49ca-9186-e59b2fcde567 req-d8c86e5d-5d70-48d7-8eda-ea12a1dfafb6 service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] No waiting events found dispatching network-vif-plugged-4718fa68-0eb9-4592-8c43-981438e3d0b8 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:24:07 user nova-compute[71229]: WARNING nova.compute.manager [req-1c595469-b498-49ca-9186-e59b2fcde567 req-d8c86e5d-5d70-48d7-8eda-ea12a1dfafb6 service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Received unexpected event network-vif-plugged-4718fa68-0eb9-4592-8c43-981438e3d0b8 for instance with vm_state building and task_state spawning.
Apr 11 15:24:08 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:08 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:08 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:09 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:09 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:09 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:09 user nova-compute[71229]: DEBUG nova.compute.manager [req-31de49af-2ee3-4b87-852d-5660c741f86b req-dfec4518-190b-411b-adbc-9ec8b09c1622 service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Received event network-vif-plugged-4718fa68-0eb9-4592-8c43-981438e3d0b8 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:24:09 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-31de49af-2ee3-4b87-852d-5660c741f86b req-dfec4518-190b-411b-adbc-9ec8b09c1622 service nova] Acquiring lock "b0d90fd2-6a95-43c4-8756-e82071d99154-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:24:09 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-31de49af-2ee3-4b87-852d-5660c741f86b req-dfec4518-190b-411b-adbc-9ec8b09c1622 service nova] Lock "b0d90fd2-6a95-43c4-8756-e82071d99154-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:24:09 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-31de49af-2ee3-4b87-852d-5660c741f86b req-dfec4518-190b-411b-adbc-9ec8b09c1622 service nova] Lock "b0d90fd2-6a95-43c4-8756-e82071d99154-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:24:09 user nova-compute[71229]: DEBUG nova.compute.manager [req-31de49af-2ee3-4b87-852d-5660c741f86b req-dfec4518-190b-411b-adbc-9ec8b09c1622 service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] No waiting events found dispatching network-vif-plugged-4718fa68-0eb9-4592-8c43-981438e3d0b8 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:24:09 user nova-compute[71229]: WARNING nova.compute.manager [req-31de49af-2ee3-4b87-852d-5660c741f86b req-dfec4518-190b-411b-adbc-9ec8b09c1622 service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Received unexpected event network-vif-plugged-4718fa68-0eb9-4592-8c43-981438e3d0b8 for instance with vm_state building and task_state spawning.
Apr 11 15:24:09 user nova-compute[71229]: DEBUG nova.compute.manager [req-31de49af-2ee3-4b87-852d-5660c741f86b req-dfec4518-190b-411b-adbc-9ec8b09c1622 service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Received event network-vif-plugged-1ad8234a-3f96-43a0-9dea-862e6efcda73 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:24:09 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-31de49af-2ee3-4b87-852d-5660c741f86b req-dfec4518-190b-411b-adbc-9ec8b09c1622 service nova] Acquiring lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:24:09 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-31de49af-2ee3-4b87-852d-5660c741f86b req-dfec4518-190b-411b-adbc-9ec8b09c1622 service nova] Lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:24:09 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-31de49af-2ee3-4b87-852d-5660c741f86b req-dfec4518-190b-411b-adbc-9ec8b09c1622 service nova] Lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:24:09 user nova-compute[71229]: DEBUG nova.compute.manager [req-31de49af-2ee3-4b87-852d-5660c741f86b req-dfec4518-190b-411b-adbc-9ec8b09c1622 service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] No waiting events found dispatching network-vif-plugged-1ad8234a-3f96-43a0-9dea-862e6efcda73 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:24:09 user nova-compute[71229]: WARNING nova.compute.manager [req-31de49af-2ee3-4b87-852d-5660c741f86b req-dfec4518-190b-411b-adbc-9ec8b09c1622 service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Received unexpected event network-vif-plugged-1ad8234a-3f96-43a0-9dea-862e6efcda73 for instance with vm_state building and task_state spawning.
Apr 11 15:24:09 user nova-compute[71229]: DEBUG nova.compute.manager [req-31de49af-2ee3-4b87-852d-5660c741f86b req-dfec4518-190b-411b-adbc-9ec8b09c1622 service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Received event network-vif-plugged-1ad8234a-3f96-43a0-9dea-862e6efcda73 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:24:09 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-31de49af-2ee3-4b87-852d-5660c741f86b req-dfec4518-190b-411b-adbc-9ec8b09c1622 service nova] Acquiring lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:24:09 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-31de49af-2ee3-4b87-852d-5660c741f86b req-dfec4518-190b-411b-adbc-9ec8b09c1622 service nova] Lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:24:09 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-31de49af-2ee3-4b87-852d-5660c741f86b req-dfec4518-190b-411b-adbc-9ec8b09c1622 service nova] Lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:24:09 user nova-compute[71229]: DEBUG nova.compute.manager [req-31de49af-2ee3-4b87-852d-5660c741f86b req-dfec4518-190b-411b-adbc-9ec8b09c1622 service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] No waiting events found dispatching network-vif-plugged-1ad8234a-3f96-43a0-9dea-862e6efcda73 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:24:09 user nova-compute[71229]: WARNING nova.compute.manager [req-31de49af-2ee3-4b87-852d-5660c741f86b req-dfec4518-190b-411b-adbc-9ec8b09c1622 service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Received unexpected event network-vif-plugged-1ad8234a-3f96-43a0-9dea-862e6efcda73 for instance with vm_state building and task_state spawning.
Apr 11 15:24:10 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681226650.3743951, b0d90fd2-6a95-43c4-8756-e82071d99154 => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:24:10 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] VM Resumed (Lifecycle Event)
Apr 11 15:24:10 user nova-compute[71229]: DEBUG nova.compute.manager [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 15:24:10 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Guest created on hypervisor {{(pid=71229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 15:24:10 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Instance spawned successfully.
Apr 11 15:24:10 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 15:24:10 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:24:10 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:24:10 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Found default for hw_cdrom_bus of ide {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:24:10 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Found default for hw_disk_bus of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:24:10 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Found default for hw_input_bus of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:24:10 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Found default for hw_pointer_model of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:24:10 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Found default for hw_video_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:24:10 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Found default for hw_vif_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:24:10 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:24:10 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681226650.378766, b0d90fd2-6a95-43c4-8756-e82071d99154 => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:24:10 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] VM Started (Lifecycle Event)
Apr 11 15:24:10 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:24:10 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:24:10 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:24:10 user nova-compute[71229]: INFO nova.compute.manager [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Took 6.37 seconds to spawn the instance on the hypervisor.
Apr 11 15:24:10 user nova-compute[71229]: DEBUG nova.compute.manager [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:24:10 user nova-compute[71229]: INFO nova.compute.manager [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Took 17.14 seconds to build instance.
Apr 11 15:24:10 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-fe51d303-ff7d-434e-8d52-2ddca7d7202e tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "b0d90fd2-6a95-43c4-8756-e82071d99154" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.238s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:24:10 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681226650.8938217, 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:24:10 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] VM Resumed (Lifecycle Event)
Apr 11 15:24:10 user nova-compute[71229]: DEBUG nova.compute.manager [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 15:24:10 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Guest created on hypervisor {{(pid=71229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 15:24:10 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Instance spawned successfully.
Apr 11 15:24:10 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 15:24:10 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:24:10 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:24:10 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Found default for hw_cdrom_bus of ide {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:24:10 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Found default for hw_disk_bus of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:24:10 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Found default for hw_input_bus of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:24:10 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Found default for hw_pointer_model of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:24:10 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Found default for hw_video_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:24:10 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Found default for hw_vif_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:24:10 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:24:10 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681226650.8947551, 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:24:10 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] VM Started (Lifecycle Event)
Apr 11 15:24:10 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:24:10 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:24:10 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:24:11 user nova-compute[71229]: INFO nova.compute.manager [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Took 6.23 seconds to spawn the instance on the hypervisor.
Apr 11 15:24:11 user nova-compute[71229]: DEBUG nova.compute.manager [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:24:11 user nova-compute[71229]: INFO nova.compute.manager [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Took 6.95 seconds to build instance.
Apr 11 15:24:11 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-99c4ba57-4856-470c-b8d9-6091087a9f65 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.040s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:24:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:14 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "b59399aa-f550-41c7-9818-6cb1f271fb52" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:24:14 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "b59399aa-f550-41c7-9818-6cb1f271fb52" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:24:14 user nova-compute[71229]: DEBUG nova.compute.manager [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Starting instance... {{(pid=71229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 15:24:14 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:24:14 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:24:14 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 15:24:14 user nova-compute[71229]: INFO nova.compute.claims [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Claim successful on node user
Apr 11 15:24:15 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:24:15 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:24:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.412s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:24:15 user nova-compute[71229]: DEBUG nova.compute.manager [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Start building networks asynchronously for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 15:24:15 user nova-compute[71229]: DEBUG nova.compute.manager [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Allocating IP information in the background. {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 15:24:15 user nova-compute[71229]: DEBUG nova.network.neutron [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] allocate_for_instance() {{(pid=71229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 15:24:15 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 15:24:15 user nova-compute[71229]: DEBUG nova.compute.manager [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Start building block device mappings for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 15:24:15 user nova-compute[71229]: DEBUG nova.policy [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2717e456dcc941899c48c3c973083bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da140971126a4d298ff718275e7a22ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71229) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 15:24:15 user nova-compute[71229]: DEBUG nova.compute.manager [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Start spawning the instance on the hypervisor. {{(pid=71229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 15:24:15 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Creating instance directory {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 15:24:15 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Creating image(s)
Apr 11 15:24:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "/opt/stack/data/nova/instances/b59399aa-f550-41c7-9818-6cb1f271fb52/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:24:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "/opt/stack/data/nova/instances/b59399aa-f550-41c7-9818-6cb1f271fb52/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:24:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "/opt/stack/data/nova/instances/b59399aa-f550-41c7-9818-6cb1f271fb52/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:24:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.162s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:24:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:24:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.136s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/b59399aa-f550-41c7-9818-6cb1f271fb52/disk 1073741824 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/b59399aa-f550-41c7-9818-6cb1f271fb52/disk 1073741824" returned: 0 in 0.051s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:24:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.140s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:15 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b59399aa-f550-41c7-9818-6cb1f271fb52/disk. size=1073741824 {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 15:24:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b59399aa-f550-41c7-9818-6cb1f271fb52/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:16 user nova-compute[71229]: DEBUG nova.network.neutron [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Successfully created port: ae63c1ed-23df-4140-979f-1756e27a67e1 {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 15:24:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b59399aa-f550-41c7-9818-6cb1f271fb52/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:16 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Cannot resize image /opt/stack/data/nova/instances/b59399aa-f550-41c7-9818-6cb1f271fb52/disk to a smaller size. {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 15:24:16 user nova-compute[71229]: DEBUG nova.objects.instance [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lazy-loading 'migration_context' on Instance uuid b59399aa-f550-41c7-9818-6cb1f271fb52 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:24:16 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Created local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 15:24:16 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Ensure instance console log exists: /opt/stack/data/nova/instances/b59399aa-f550-41c7-9818-6cb1f271fb52/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 15:24:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:24:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:24:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:24:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:16 user nova-compute[71229]: DEBUG nova.network.neutron [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Successfully updated port: ae63c1ed-23df-4140-979f-1756e27a67e1 {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:24:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "refresh_cache-b59399aa-f550-41c7-9818-6cb1f271fb52" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:24:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquired lock "refresh_cache-b59399aa-f550-41c7-9818-6cb1f271fb52" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:24:16 user nova-compute[71229]: DEBUG nova.network.neutron [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:24:16 user nova-compute[71229]: DEBUG nova.compute.manager [req-9c43402e-e62e-4195-9bb6-3bb44bd2320c req-f5eeeecc-95fe-45c1-ba95-62f3594b118a service nova] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Received event network-changed-ae63c1ed-23df-4140-979f-1756e27a67e1 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:24:16 user nova-compute[71229]: DEBUG nova.compute.manager [req-9c43402e-e62e-4195-9bb6-3bb44bd2320c req-f5eeeecc-95fe-45c1-ba95-62f3594b118a service nova] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Refreshing instance network info cache due to event network-changed-ae63c1ed-23df-4140-979f-1756e27a67e1. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:24:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-9c43402e-e62e-4195-9bb6-3bb44bd2320c req-f5eeeecc-95fe-45c1-ba95-62f3594b118a service nova] Acquiring lock "refresh_cache-b59399aa-f550-41c7-9818-6cb1f271fb52" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:24:17 user nova-compute[71229]: DEBUG nova.network.neutron [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:24:17 user nova-compute[71229]: DEBUG nova.network.neutron [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Updating instance_info_cache with network_info: [{"id": "ae63c1ed-23df-4140-979f-1756e27a67e1", "address": "fa:16:3e:a6:73:db", "network": {"id": "f52bd4a9-1843-408b-85af-c2124ad01be7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-593462205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da140971126a4d298ff718275e7a22ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae63c1ed-23", "ovs_interfaceid": "ae63c1ed-23df-4140-979f-1756e27a67e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:24:17 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Releasing lock "refresh_cache-b59399aa-f550-41c7-9818-6cb1f271fb52" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:24:17 user nova-compute[71229]: DEBUG nova.compute.manager [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Instance network_info: |[{"id": "ae63c1ed-23df-4140-979f-1756e27a67e1", "address": "fa:16:3e:a6:73:db", "network": {"id": "f52bd4a9-1843-408b-85af-c2124ad01be7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-593462205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da140971126a4d298ff718275e7a22ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae63c1ed-23", "ovs_interfaceid": "ae63c1ed-23df-4140-979f-1756e27a67e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 15:24:17 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-9c43402e-e62e-4195-9bb6-3bb44bd2320c req-f5eeeecc-95fe-45c1-ba95-62f3594b118a service nova] Acquired lock "refresh_cache-b59399aa-f550-41c7-9818-6cb1f271fb52" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:24:17 user nova-compute[71229]: DEBUG nova.network.neutron [req-9c43402e-e62e-4195-9bb6-3bb44bd2320c req-f5eeeecc-95fe-45c1-ba95-62f3594b118a service nova] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Refreshing network info cache for port ae63c1ed-23df-4140-979f-1756e27a67e1 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:24:17 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Start _get_guest_xml network_info=[{"id": "ae63c1ed-23df-4140-979f-1756e27a67e1", "address": "fa:16:3e:a6:73:db", "network": {"id": "f52bd4a9-1843-408b-85af-c2124ad01be7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-593462205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da140971126a4d298ff718275e7a22ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae63c1ed-23", "ovs_interfaceid": "ae63c1ed-23df-4140-979f-1756e27a67e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '52fe638c-5ada-47d5-b376-233bfa808a37'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:24:17 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:24:17 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:24:17 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:24:17 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:24:17 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:24:17 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:24:17 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:24:17 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:24:17 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:24:17 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:24:17 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:24:17 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:24:17 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:24:17 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:24:17 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:24:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1391795375',display_name='tempest-VolumesAdminNegativeTest-server-1391795375',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1391795375',id=13,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da140971126a4d298ff718275e7a22ec',ramdisk_id='',reservation_id='r-xpk9eb1a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2033224639',owner_user_name='tempest-VolumesAdminNegativeTest-2033224639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:24:15Z,user_data=None,user_id='2717e456dcc941899c48c3c973083bd4',uuid=b59399aa-f550-41c7-9818-6cb1f271fb52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae63c1ed-23df-4140-979f-1756e27a67e1", "address": "fa:16:3e:a6:73:db", "network": {"id": "f52bd4a9-1843-408b-85af-c2124ad01be7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-593462205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da140971126a4d298ff718275e7a22ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae63c1ed-23", "ovs_interfaceid": "ae63c1ed-23df-4140-979f-1756e27a67e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:24:17 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Converting VIF {"id": "ae63c1ed-23df-4140-979f-1756e27a67e1", "address": "fa:16:3e:a6:73:db", "network": {"id": "f52bd4a9-1843-408b-85af-c2124ad01be7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-593462205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da140971126a4d298ff718275e7a22ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae63c1ed-23", "ovs_interfaceid": "ae63c1ed-23df-4140-979f-1756e27a67e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:24:17 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:73:db,bridge_name='br-int',has_traffic_filtering=True,id=ae63c1ed-23df-4140-979f-1756e27a67e1,network=Network(f52bd4a9-1843-408b-85af-c2124ad01be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae63c1ed-23') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:24:17 user nova-compute[71229]: DEBUG nova.objects.instance [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lazy-loading 'pci_devices' on Instance uuid b59399aa-f550-41c7-9818-6cb1f271fb52 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:24:17 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:24:17 user nova-compute[71229]:   <uuid>b59399aa-f550-41c7-9818-6cb1f271fb52</uuid>
Apr 11 15:24:17 user nova-compute[71229]:   <name>instance-0000000d</name>
Apr 11 15:24:17 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:24:17 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:24:17 user nova-compute[71229]:   <metadata>
Apr 11 15:24:17 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:24:17 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:24:17 user nova-compute[71229]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1391795375</nova:name>
Apr 11 15:24:17 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:24:17</nova:creationTime>
Apr 11 15:24:17 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:24:17 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:24:17 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:24:17 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:24:17 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:24:17 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:24:17 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:24:17 user nova-compute[71229]:       <nova:owner>
Apr 11 15:24:17 user nova-compute[71229]:         <nova:user uuid="2717e456dcc941899c48c3c973083bd4">tempest-VolumesAdminNegativeTest-2033224639-project-member</nova:user>
Apr 11 15:24:17 user nova-compute[71229]:         <nova:project uuid="da140971126a4d298ff718275e7a22ec">tempest-VolumesAdminNegativeTest-2033224639</nova:project>
Apr 11 15:24:17 user nova-compute[71229]:       </nova:owner>
Apr 11 15:24:17 user nova-compute[71229]:       <nova:root type="image" uuid="52fe638c-5ada-47d5-b376-233bfa808a37"/>
Apr 11 15:24:17 user nova-compute[71229]:       <nova:ports>
Apr 11 15:24:17 user nova-compute[71229]:         <nova:port uuid="ae63c1ed-23df-4140-979f-1756e27a67e1">
Apr 11 15:24:17 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 11 15:24:17 user nova-compute[71229]:         </nova:port>
Apr 11 15:24:17 user nova-compute[71229]:       </nova:ports>
Apr 11 15:24:17 user nova-compute[71229]:     </nova:instance>
Apr 11 15:24:17 user nova-compute[71229]:   </metadata>
Apr 11 15:24:17 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:24:17 user nova-compute[71229]:     <system>
Apr 11 15:24:17 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:24:17 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:24:17 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:24:17 user nova-compute[71229]:       <entry name="serial">b59399aa-f550-41c7-9818-6cb1f271fb52</entry>
Apr 11 15:24:17 user nova-compute[71229]:       <entry name="uuid">b59399aa-f550-41c7-9818-6cb1f271fb52</entry>
Apr 11 15:24:17 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:24:17 user nova-compute[71229]:     </system>
Apr 11 15:24:17 user nova-compute[71229]:   </sysinfo>
Apr 11 15:24:17 user nova-compute[71229]:   <os>
Apr 11 15:24:17 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:24:17 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 15:24:17 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:24:17 user nova-compute[71229]:   </os>
Apr 11 15:24:17 user nova-compute[71229]:   <features>
Apr 11 15:24:17 user nova-compute[71229]:     <acpi/>
Apr 11 15:24:17 user nova-compute[71229]:     <apic/>
Apr 11 15:24:17 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:24:17 user nova-compute[71229]:   </features>
Apr 11 15:24:17 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:24:17 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:24:17 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:24:17 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:24:17 user nova-compute[71229]:   </clock>
Apr 11 15:24:17 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:24:17 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:24:17 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:24:17 user nova-compute[71229]:   </cpu>
Apr 11 15:24:17 user nova-compute[71229]:   <devices>
Apr 11 15:24:17 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 15:24:17 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 15:24:17 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/b59399aa-f550-41c7-9818-6cb1f271fb52/disk"/>
Apr 11 15:24:17 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:24:17 user nova-compute[71229]:     </disk>
Apr 11 15:24:17 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:24:17 user nova-compute[71229]:       <mac address="fa:16:3e:a6:73:db"/>
Apr 11 15:24:17 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:24:17 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:24:17 user nova-compute[71229]:       <target dev="tapae63c1ed-23"/>
Apr 11 15:24:17 user nova-compute[71229]:     </interface>
Apr 11 15:24:17 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:24:17 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/b59399aa-f550-41c7-9818-6cb1f271fb52/console.log" append="off"/>
Apr 11 15:24:17 user nova-compute[71229]:     </serial>
Apr 11 15:24:17 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:24:17 user nova-compute[71229]:     <video>
Apr 11 15:24:17 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:24:17 user nova-compute[71229]:     </video>
Apr 11 15:24:17 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:24:17 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:24:17 user nova-compute[71229]:     </rng>
Apr 11 15:24:17 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:24:17 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:24:17 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:24:17 user nova-compute[71229]:     </memballoon>
Apr 11 15:24:17 user nova-compute[71229]:   </devices>
Apr 11 15:24:17 user nova-compute[71229]: </domain>
Apr 11 15:24:17 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:24:17 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:24:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1391795375',display_name='tempest-VolumesAdminNegativeTest-server-1391795375',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1391795375',id=13,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da140971126a4d298ff718275e7a22ec',ramdisk_id='',reservation_id='r-xpk9eb1a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2033224639',owner_user_name='tempest-VolumesAdminNegativeTest-2033224639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:24:15Z,user_data=None,user_id='2717e456dcc941899c48c3c973083bd4',uuid=b59399aa-f550-41c7-9818-6cb1f271fb52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae63c1ed-23df-4140-979f-1756e27a67e1", "address": "fa:16:3e:a6:73:db", "network": {"id": "f52bd4a9-1843-408b-85af-c2124ad01be7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-593462205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da140971126a4d298ff718275e7a22ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae63c1ed-23", "ovs_interfaceid": "ae63c1ed-23df-4140-979f-1756e27a67e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:24:17 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Converting VIF {"id": "ae63c1ed-23df-4140-979f-1756e27a67e1", "address": "fa:16:3e:a6:73:db", "network": {"id": "f52bd4a9-1843-408b-85af-c2124ad01be7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-593462205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da140971126a4d298ff718275e7a22ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae63c1ed-23", "ovs_interfaceid": "ae63c1ed-23df-4140-979f-1756e27a67e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:24:17 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:73:db,bridge_name='br-int',has_traffic_filtering=True,id=ae63c1ed-23df-4140-979f-1756e27a67e1,network=Network(f52bd4a9-1843-408b-85af-c2124ad01be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae63c1ed-23') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:24:17 user nova-compute[71229]: DEBUG os_vif [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:73:db,bridge_name='br-int',has_traffic_filtering=True,id=ae63c1ed-23df-4140-979f-1756e27a67e1,network=Network(f52bd4a9-1843-408b-85af-c2124ad01be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae63c1ed-23') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:24:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:24:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:24:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae63c1ed-23, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:24:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapae63c1ed-23, col_values=(('external_ids', {'iface-id': 'ae63c1ed-23df-4140-979f-1756e27a67e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:73:db', 'vm-uuid': 'b59399aa-f550-41c7-9818-6cb1f271fb52'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:24:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:24:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:17 user nova-compute[71229]: INFO os_vif [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:73:db,bridge_name='br-int',has_traffic_filtering=True,id=ae63c1ed-23df-4140-979f-1756e27a67e1,network=Network(f52bd4a9-1843-408b-85af-c2124ad01be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae63c1ed-23')
Apr 11 15:24:17 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:24:17 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] No VIF found with MAC fa:16:3e:a6:73:db, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:24:17 user nova-compute[71229]: DEBUG nova.network.neutron [req-9c43402e-e62e-4195-9bb6-3bb44bd2320c req-f5eeeecc-95fe-45c1-ba95-62f3594b118a service nova] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Updated VIF entry in instance network info cache for port ae63c1ed-23df-4140-979f-1756e27a67e1. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:24:17 user nova-compute[71229]: DEBUG nova.network.neutron [req-9c43402e-e62e-4195-9bb6-3bb44bd2320c req-f5eeeecc-95fe-45c1-ba95-62f3594b118a service nova] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Updating instance_info_cache with network_info: [{"id": "ae63c1ed-23df-4140-979f-1756e27a67e1", "address": "fa:16:3e:a6:73:db", "network": {"id": "f52bd4a9-1843-408b-85af-c2124ad01be7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-593462205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da140971126a4d298ff718275e7a22ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae63c1ed-23", "ovs_interfaceid": "ae63c1ed-23df-4140-979f-1756e27a67e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:24:17 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-9c43402e-e62e-4195-9bb6-3bb44bd2320c req-f5eeeecc-95fe-45c1-ba95-62f3594b118a service nova] Releasing lock "refresh_cache-b59399aa-f550-41c7-9818-6cb1f271fb52" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:24:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:19 user nova-compute[71229]: DEBUG nova.compute.manager [req-347fa1bd-c4bc-4d05-a77a-0cf41d62ce36 req-e2ba6280-03c6-4e90-ba6f-8cd31d230d6e service nova] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Received event network-vif-plugged-ae63c1ed-23df-4140-979f-1756e27a67e1 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:24:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-347fa1bd-c4bc-4d05-a77a-0cf41d62ce36 req-e2ba6280-03c6-4e90-ba6f-8cd31d230d6e service nova] Acquiring lock "b59399aa-f550-41c7-9818-6cb1f271fb52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:24:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-347fa1bd-c4bc-4d05-a77a-0cf41d62ce36 req-e2ba6280-03c6-4e90-ba6f-8cd31d230d6e service nova] Lock "b59399aa-f550-41c7-9818-6cb1f271fb52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:24:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-347fa1bd-c4bc-4d05-a77a-0cf41d62ce36 req-e2ba6280-03c6-4e90-ba6f-8cd31d230d6e service nova] Lock "b59399aa-f550-41c7-9818-6cb1f271fb52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:24:19 user nova-compute[71229]: DEBUG nova.compute.manager [req-347fa1bd-c4bc-4d05-a77a-0cf41d62ce36 req-e2ba6280-03c6-4e90-ba6f-8cd31d230d6e service nova] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] No waiting events found dispatching network-vif-plugged-ae63c1ed-23df-4140-979f-1756e27a67e1 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:24:19 user nova-compute[71229]: WARNING nova.compute.manager [req-347fa1bd-c4bc-4d05-a77a-0cf41d62ce36 req-e2ba6280-03c6-4e90-ba6f-8cd31d230d6e service nova] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Received unexpected event network-vif-plugged-ae63c1ed-23df-4140-979f-1756e27a67e1 for instance with vm_state building and task_state spawning.
Apr 11 15:24:19 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:19 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:20 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681226660.971219, b59399aa-f550-41c7-9818-6cb1f271fb52 => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:24:20 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] VM Resumed (Lifecycle Event)
Apr 11 15:24:20 user nova-compute[71229]: DEBUG nova.compute.manager [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 15:24:20 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Guest created on hypervisor {{(pid=71229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 15:24:20 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Instance spawned successfully.
Apr 11 15:24:20 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 15:24:20 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:24:20 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:24:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Found default for hw_cdrom_bus of ide {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:24:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Found default for hw_disk_bus of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:24:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Found default for hw_input_bus of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:24:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Found default for hw_pointer_model of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:24:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Found default for hw_video_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:24:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Found default for hw_vif_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:24:21 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:24:21 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681226660.97597, b59399aa-f550-41c7-9818-6cb1f271fb52 => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:24:21 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] VM Started (Lifecycle Event)
Apr 11 15:24:21 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:24:21 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:24:21 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:24:21 user nova-compute[71229]: INFO nova.compute.manager [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Took 5.62 seconds to spawn the instance on the hypervisor.
Apr 11 15:24:21 user nova-compute[71229]: DEBUG nova.compute.manager [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:24:21 user nova-compute[71229]: DEBUG nova.compute.manager [req-a1feed28-09ba-494b-ad15-a7c215493426 req-ccbebfce-515f-4971-8abb-463a5a8f64b0 service nova] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Received event network-vif-plugged-ae63c1ed-23df-4140-979f-1756e27a67e1 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:24:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a1feed28-09ba-494b-ad15-a7c215493426 req-ccbebfce-515f-4971-8abb-463a5a8f64b0 service nova] Acquiring lock "b59399aa-f550-41c7-9818-6cb1f271fb52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:24:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a1feed28-09ba-494b-ad15-a7c215493426 req-ccbebfce-515f-4971-8abb-463a5a8f64b0 service nova] Lock "b59399aa-f550-41c7-9818-6cb1f271fb52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:24:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a1feed28-09ba-494b-ad15-a7c215493426 req-ccbebfce-515f-4971-8abb-463a5a8f64b0 service nova] Lock "b59399aa-f550-41c7-9818-6cb1f271fb52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:24:21 user nova-compute[71229]: DEBUG nova.compute.manager [req-a1feed28-09ba-494b-ad15-a7c215493426 req-ccbebfce-515f-4971-8abb-463a5a8f64b0 service nova] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] No waiting events found dispatching network-vif-plugged-ae63c1ed-23df-4140-979f-1756e27a67e1 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:24:21 user nova-compute[71229]: WARNING nova.compute.manager [req-a1feed28-09ba-494b-ad15-a7c215493426 req-ccbebfce-515f-4971-8abb-463a5a8f64b0 service nova] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Received unexpected event network-vif-plugged-ae63c1ed-23df-4140-979f-1756e27a67e1 for instance with vm_state building and task_state spawning.
Apr 11 15:24:21 user nova-compute[71229]: INFO nova.compute.manager [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Took 6.41 seconds to build instance.
Apr 11 15:24:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b3a51d51-cd2e-4be1-bc24-35ea2b2b835b tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "b59399aa-f550-41c7-9818-6cb1f271fb52" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.504s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:24:21 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:27 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:27 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:34 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-080ce5c2-2bf2-4b90-b2fd-46e95c3a5bb8 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Acquiring lock "8d84862f-b710-48b1-9275-93fc799cf1f9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:24:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-080ce5c2-2bf2-4b90-b2fd-46e95c3a5bb8 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "8d84862f-b710-48b1-9275-93fc799cf1f9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:24:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-080ce5c2-2bf2-4b90-b2fd-46e95c3a5bb8 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Acquiring lock "8d84862f-b710-48b1-9275-93fc799cf1f9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:24:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-080ce5c2-2bf2-4b90-b2fd-46e95c3a5bb8 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "8d84862f-b710-48b1-9275-93fc799cf1f9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:24:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-080ce5c2-2bf2-4b90-b2fd-46e95c3a5bb8 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "8d84862f-b710-48b1-9275-93fc799cf1f9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:24:35 user nova-compute[71229]: INFO nova.compute.manager [None req-080ce5c2-2bf2-4b90-b2fd-46e95c3a5bb8 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Terminating instance
Apr 11 15:24:35 user nova-compute[71229]: DEBUG nova.compute.manager [None req-080ce5c2-2bf2-4b90-b2fd-46e95c3a5bb8 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Start destroying the instance on the hypervisor. {{(pid=71229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 15:24:35 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:35 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:36 user nova-compute[71229]: DEBUG nova.compute.manager [req-962fcfcc-9cee-468e-abd8-ff3399bca84c req-67a2a6a6-68e2-44c8-b6ac-803b50d56416 service nova] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Received event network-vif-unplugged-bcba48c0-9931-4249-925c-57cb387499d1 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:24:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-962fcfcc-9cee-468e-abd8-ff3399bca84c req-67a2a6a6-68e2-44c8-b6ac-803b50d56416 service nova] Acquiring lock "8d84862f-b710-48b1-9275-93fc799cf1f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:24:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-962fcfcc-9cee-468e-abd8-ff3399bca84c req-67a2a6a6-68e2-44c8-b6ac-803b50d56416 service nova] Lock "8d84862f-b710-48b1-9275-93fc799cf1f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:24:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-962fcfcc-9cee-468e-abd8-ff3399bca84c req-67a2a6a6-68e2-44c8-b6ac-803b50d56416 service nova] Lock "8d84862f-b710-48b1-9275-93fc799cf1f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:24:36 user nova-compute[71229]: DEBUG nova.compute.manager [req-962fcfcc-9cee-468e-abd8-ff3399bca84c req-67a2a6a6-68e2-44c8-b6ac-803b50d56416 service nova] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] No waiting events found dispatching network-vif-unplugged-bcba48c0-9931-4249-925c-57cb387499d1 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:24:36 user nova-compute[71229]: DEBUG nova.compute.manager [req-962fcfcc-9cee-468e-abd8-ff3399bca84c req-67a2a6a6-68e2-44c8-b6ac-803b50d56416 service nova] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Received event network-vif-unplugged-bcba48c0-9931-4249-925c-57cb387499d1 for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 15:24:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:36 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Instance destroyed successfully.
Apr 11 15:24:36 user nova-compute[71229]: DEBUG nova.objects.instance [None req-080ce5c2-2bf2-4b90-b2fd-46e95c3a5bb8 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lazy-loading 'resources' on Instance uuid 8d84862f-b710-48b1-9275-93fc799cf1f9 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:24:36 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-080ce5c2-2bf2-4b90-b2fd-46e95c3a5bb8 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:21:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1927487601',display_name='tempest-TestVolumeSwap-server-1927487601',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1927487601',id=5,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXe2oYf9bHTZuGSH+I98VCNh4n8J86bhrRtZei09K0Pc1rXzA6ZGLlg6dYTh2vwT7HQFXKOvrkAxNKF8kQZmFeBvV71cpVJ8itjkiYcKvNJUpIPXBRA/2eZnMt0gU1MDg==',key_name='tempest-keypair-445229818',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:21:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f7c88bf2782342c8af04195140d6cd0e',ramdisk_id='',reservation_id='r-1x8pfb2q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1716929011',owner_user_name='tempest-TestVolumeSwap-1716929011-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:21:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2ec75db561b4fec903a1a391c3d03e3',uuid=8d84862f-b710-48b1-9275-93fc799cf1f9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bcba48c0-9931-4249-925c-57cb387499d1", "address": "fa:16:3e:99:2a:86", "network": {"id": "d861c3b4-c929-43bb-83c3-e746f8119831", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2114528813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c88bf2782342c8af04195140d6cd0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcba48c0-99", "ovs_interfaceid": "bcba48c0-9931-4249-925c-57cb387499d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:24:36 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-080ce5c2-2bf2-4b90-b2fd-46e95c3a5bb8 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Converting VIF {"id": "bcba48c0-9931-4249-925c-57cb387499d1", "address": "fa:16:3e:99:2a:86", "network": {"id": "d861c3b4-c929-43bb-83c3-e746f8119831", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2114528813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7c88bf2782342c8af04195140d6cd0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcba48c0-99", "ovs_interfaceid": "bcba48c0-9931-4249-925c-57cb387499d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:24:36 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-080ce5c2-2bf2-4b90-b2fd-46e95c3a5bb8 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:2a:86,bridge_name='br-int',has_traffic_filtering=True,id=bcba48c0-9931-4249-925c-57cb387499d1,network=Network(d861c3b4-c929-43bb-83c3-e746f8119831),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcba48c0-99') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:24:36 user nova-compute[71229]: DEBUG os_vif [None req-080ce5c2-2bf2-4b90-b2fd-46e95c3a5bb8 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:2a:86,bridge_name='br-int',has_traffic_filtering=True,id=bcba48c0-9931-4249-925c-57cb387499d1,network=Network(d861c3b4-c929-43bb-83c3-e746f8119831),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcba48c0-99') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:24:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbcba48c0-99, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:24:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:24:36 user nova-compute[71229]: INFO os_vif [None req-080ce5c2-2bf2-4b90-b2fd-46e95c3a5bb8 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:2a:86,bridge_name='br-int',has_traffic_filtering=True,id=bcba48c0-9931-4249-925c-57cb387499d1,network=Network(d861c3b4-c929-43bb-83c3-e746f8119831),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcba48c0-99')
Apr 11 15:24:36 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-080ce5c2-2bf2-4b90-b2fd-46e95c3a5bb8 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Deleting instance files /opt/stack/data/nova/instances/8d84862f-b710-48b1-9275-93fc799cf1f9_del
Apr 11 15:24:36 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-080ce5c2-2bf2-4b90-b2fd-46e95c3a5bb8 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Deletion of /opt/stack/data/nova/instances/8d84862f-b710-48b1-9275-93fc799cf1f9_del complete
Apr 11 15:24:36 user nova-compute[71229]: INFO nova.compute.manager [None req-080ce5c2-2bf2-4b90-b2fd-46e95c3a5bb8 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Took 0.91 seconds to destroy the instance on the hypervisor.
Apr 11 15:24:36 user nova-compute[71229]: DEBUG oslo.service.loopingcall [None req-080ce5c2-2bf2-4b90-b2fd-46e95c3a5bb8 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71229) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 15:24:36 user nova-compute[71229]: DEBUG nova.compute.manager [-] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Deallocating network for instance {{(pid=71229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 15:24:36 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] deallocate_for_instance() {{(pid=71229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 15:24:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:37 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:24:37 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Took 1.33 seconds to deallocate network for instance.
Apr 11 15:24:37 user nova-compute[71229]: DEBUG nova.compute.manager [req-210090d9-908f-4e25-b465-2295e868c20a req-24c0f29b-b8ca-421c-a311-ed025b4d51d5 service nova] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Received event network-vif-deleted-bcba48c0-9931-4249-925c-57cb387499d1 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:24:37 user nova-compute[71229]: INFO nova.compute.manager [req-210090d9-908f-4e25-b465-2295e868c20a req-24c0f29b-b8ca-421c-a311-ed025b4d51d5 service nova] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Neutron deleted interface bcba48c0-9931-4249-925c-57cb387499d1; detaching it from the instance and deleting it from the info cache
Apr 11 15:24:37 user nova-compute[71229]: DEBUG nova.network.neutron [req-210090d9-908f-4e25-b465-2295e868c20a req-24c0f29b-b8ca-421c-a311-ed025b4d51d5 service nova] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:24:37 user nova-compute[71229]: DEBUG nova.compute.manager [req-210090d9-908f-4e25-b465-2295e868c20a req-24c0f29b-b8ca-421c-a311-ed025b4d51d5 service nova] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Detach interface failed, port_id=bcba48c0-9931-4249-925c-57cb387499d1, reason: Instance 8d84862f-b710-48b1-9275-93fc799cf1f9 could not be found. {{(pid=71229) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 15:24:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-080ce5c2-2bf2-4b90-b2fd-46e95c3a5bb8 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:24:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-080ce5c2-2bf2-4b90-b2fd-46e95c3a5bb8 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:24:38 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-080ce5c2-2bf2-4b90-b2fd-46e95c3a5bb8 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:24:38 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-080ce5c2-2bf2-4b90-b2fd-46e95c3a5bb8 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:24:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-080ce5c2-2bf2-4b90-b2fd-46e95c3a5bb8 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.310s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:24:38 user nova-compute[71229]: INFO nova.scheduler.client.report [None req-080ce5c2-2bf2-4b90-b2fd-46e95c3a5bb8 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Deleted allocations for instance 8d84862f-b710-48b1-9275-93fc799cf1f9
Apr 11 15:24:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-080ce5c2-2bf2-4b90-b2fd-46e95c3a5bb8 tempest-TestVolumeSwap-1716929011 tempest-TestVolumeSwap-1716929011-project-member] Lock "8d84862f-b710-48b1-9275-93fc799cf1f9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.784s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:24:38 user nova-compute[71229]: DEBUG nova.compute.manager [req-e4d32c9d-2dfd-4cd0-9f1e-75a457e21abb req-3cf399b8-0765-4fc0-8d45-e0d97eced22a service nova] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Received event network-vif-plugged-bcba48c0-9931-4249-925c-57cb387499d1 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:24:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e4d32c9d-2dfd-4cd0-9f1e-75a457e21abb req-3cf399b8-0765-4fc0-8d45-e0d97eced22a service nova] Acquiring lock "8d84862f-b710-48b1-9275-93fc799cf1f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:24:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e4d32c9d-2dfd-4cd0-9f1e-75a457e21abb req-3cf399b8-0765-4fc0-8d45-e0d97eced22a service nova] Lock "8d84862f-b710-48b1-9275-93fc799cf1f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:24:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e4d32c9d-2dfd-4cd0-9f1e-75a457e21abb req-3cf399b8-0765-4fc0-8d45-e0d97eced22a service nova] Lock "8d84862f-b710-48b1-9275-93fc799cf1f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:24:38 user nova-compute[71229]: DEBUG nova.compute.manager [req-e4d32c9d-2dfd-4cd0-9f1e-75a457e21abb req-3cf399b8-0765-4fc0-8d45-e0d97eced22a service nova] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] No waiting events found dispatching network-vif-plugged-bcba48c0-9931-4249-925c-57cb387499d1 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:24:38 user nova-compute[71229]: WARNING nova.compute.manager [req-e4d32c9d-2dfd-4cd0-9f1e-75a457e21abb req-3cf399b8-0765-4fc0-8d45-e0d97eced22a service nova] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Received unexpected event network-vif-plugged-bcba48c0-9931-4249-925c-57cb387499d1 for instance with vm_state deleted and task_state None.
Apr 11 15:24:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Acquiring lock "39e3dfb1-bc09-474d-b8cb-f01b11923eae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:24:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "39e3dfb1-bc09-474d-b8cb-f01b11923eae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:24:42 user nova-compute[71229]: DEBUG nova.compute.manager [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Starting instance... {{(pid=71229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 15:24:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:24:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:24:42 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 15:24:42 user nova-compute[71229]: INFO nova.compute.claims [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Claim successful on node user
Apr 11 15:24:42 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:24:42 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:24:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.366s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:24:42 user nova-compute[71229]: DEBUG nova.compute.manager [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Start building networks asynchronously for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 15:24:43 user nova-compute[71229]: DEBUG nova.compute.manager [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Allocating IP information in the background. {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 15:24:43 user nova-compute[71229]: DEBUG nova.network.neutron [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] allocate_for_instance() {{(pid=71229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 15:24:43 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 15:24:43 user nova-compute[71229]: DEBUG nova.compute.manager [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Start building block device mappings for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 15:24:43 user nova-compute[71229]: INFO nova.virt.block_device [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Booting with volume 3132ad02-1f63-469b-b802-d814466b9ad7 at /dev/vda
Apr 11 15:24:43 user nova-compute[71229]: DEBUG nova.policy [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '49e1716b2bb2438b93d46dc8052c788b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ed867a40534b70bf75dc0cc28fdfec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71229) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 15:24:43 user nova-compute[71229]: DEBUG os_brick.utils [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:24:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.028s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:43 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6be0adc-98bb-47a1-99a4-4309364630e3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d55e24a97c90\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:24:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.055s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:43 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a6d77a-2242-4646-af9f-92bc755c7f21]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:24:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.036s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:43 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a827eb-0b16-4f81-9a56-45ccfc5f8a5b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:24:43 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6b0271-c341-4117-957d-0402b86bcebf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:24:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Running cmd (subprocess): nvme version {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] 'nvme version' failed. Not Retrying. {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:24:43 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] nvme not present on system {{(pid=71229) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 15:24:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:24:43 user nova-compute[71229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 15:24:43 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7394cd-bcad-4cd8-ba80-a6bd1c3cf84f]: (4, '') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:24:43 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71229) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 15:24:43 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 15:24:43 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] LIGHTOS: no hostnqn found. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 15:24:43 user nova-compute[71229]: DEBUG os_brick.utils [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] <== get_connector_properties: return (214ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d55e24a97c90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:24:43 user nova-compute[71229]: DEBUG nova.virt.block_device [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Updating existing volume attachment record: 3559e1ce-7956-436c-b369-0dfc14bf74b3 {{(pid=71229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 15:24:44 user nova-compute[71229]: DEBUG nova.network.neutron [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Successfully created port: 21d628ba-6bae-4d98-94df-bb6fbb4f1c24 {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 15:24:45 user nova-compute[71229]: DEBUG nova.network.neutron [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Successfully updated port: 21d628ba-6bae-4d98-94df-bb6fbb4f1c24 {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:24:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Acquiring lock "refresh_cache-39e3dfb1-bc09-474d-b8cb-f01b11923eae" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:24:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Acquired lock "refresh_cache-39e3dfb1-bc09-474d-b8cb-f01b11923eae" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:24:45 user nova-compute[71229]: DEBUG nova.network.neutron [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:24:45 user nova-compute[71229]: DEBUG nova.compute.manager [req-5b3b1c05-d6f4-4307-b811-8daa60279312 req-da484cfd-dfd9-4de6-bd01-7a3494d82398 service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Received event network-changed-21d628ba-6bae-4d98-94df-bb6fbb4f1c24 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:24:45 user nova-compute[71229]: DEBUG nova.compute.manager [req-5b3b1c05-d6f4-4307-b811-8daa60279312 req-da484cfd-dfd9-4de6-bd01-7a3494d82398 service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Refreshing instance network info cache due to event network-changed-21d628ba-6bae-4d98-94df-bb6fbb4f1c24. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:24:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-5b3b1c05-d6f4-4307-b811-8daa60279312 req-da484cfd-dfd9-4de6-bd01-7a3494d82398 service nova] Acquiring lock "refresh_cache-39e3dfb1-bc09-474d-b8cb-f01b11923eae" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:24:45 user nova-compute[71229]: DEBUG nova.network.neutron [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:24:46 user nova-compute[71229]: DEBUG nova.network.neutron [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Updating instance_info_cache with network_info: [{"id": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24", "address": "fa:16:3e:97:55:b0", "network": {"id": "75a41a6a-1c7b-47b0-907e-2015d56f554e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1001895705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ed867a40534b70bf75dc0cc28fdfec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d628ba-6b", "ovs_interfaceid": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:24:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Releasing lock "refresh_cache-39e3dfb1-bc09-474d-b8cb-f01b11923eae" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:24:46 user nova-compute[71229]: DEBUG nova.compute.manager [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Instance network_info: |[{"id": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24", "address": "fa:16:3e:97:55:b0", "network": {"id": "75a41a6a-1c7b-47b0-907e-2015d56f554e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1001895705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ed867a40534b70bf75dc0cc28fdfec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d628ba-6b", "ovs_interfaceid": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 15:24:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-5b3b1c05-d6f4-4307-b811-8daa60279312 req-da484cfd-dfd9-4de6-bd01-7a3494d82398 service nova] Acquired lock "refresh_cache-39e3dfb1-bc09-474d-b8cb-f01b11923eae" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:24:46 user nova-compute[71229]: DEBUG nova.network.neutron [req-5b3b1c05-d6f4-4307-b811-8daa60279312 req-da484cfd-dfd9-4de6-bd01-7a3494d82398 service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Refreshing network info cache for port 21d628ba-6bae-4d98-94df-bb6fbb4f1c24 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:24:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:46 user nova-compute[71229]: DEBUG nova.network.neutron [req-5b3b1c05-d6f4-4307-b811-8daa60279312 req-da484cfd-dfd9-4de6-bd01-7a3494d82398 service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Updated VIF entry in instance network info cache for port 21d628ba-6bae-4d98-94df-bb6fbb4f1c24. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:24:46 user nova-compute[71229]: DEBUG nova.network.neutron [req-5b3b1c05-d6f4-4307-b811-8daa60279312 req-da484cfd-dfd9-4de6-bd01-7a3494d82398 service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Updating instance_info_cache with network_info: [{"id": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24", "address": "fa:16:3e:97:55:b0", "network": {"id": "75a41a6a-1c7b-47b0-907e-2015d56f554e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1001895705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ed867a40534b70bf75dc0cc28fdfec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d628ba-6b", "ovs_interfaceid": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:24:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-5b3b1c05-d6f4-4307-b811-8daa60279312 req-da484cfd-dfd9-4de6-bd01-7a3494d82398 service nova] Releasing lock "refresh_cache-39e3dfb1-bc09-474d-b8cb-f01b11923eae" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG nova.compute.manager [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Start spawning the instance on the hypervisor. {{(pid=71229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Creating instance directory {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 15:24:47 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Creating image(s)
Apr 11 15:24:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Did not create local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Ensure instance console log exists: /opt/stack/data/nova/instances/39e3dfb1-bc09-474d-b8cb-f01b11923eae/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Start _get_guest_xml network_info=[{"id": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24", "address": "fa:16:3e:97:55:b0", "network": {"id": "75a41a6a-1c7b-47b0-907e-2015d56f554e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1001895705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ed867a40534b70bf75dc0cc28fdfec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d628ba-6b", "ovs_interfaceid": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rEkFuIDz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '39e3dfb1-bc09-474d-b8cb-f01b11923eae', 'attached_at': '', 'detached_at': '', 'volume_id': '3132ad02-1f63-469b-b802-d814466b9ad7', 'serial': '3132ad02-1f63-469b-b802-d814466b9ad7'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '3559e1ce-7956-436c-b369-0dfc14bf74b3', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:24:47 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:24:47 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:24:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rEkFuIDz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:24:47 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:24:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:24:47 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:24:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:24:47 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 15:24:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce3dc38-1e25-4686-a0dc-3c4cdddc648e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 15:24:47 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 -p 172.16.0.220:3260 --interface default --op new {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa64896c-684c-4764-9140-255a6a9923e9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7] added\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7] added
Apr 11 15:24:47 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cad3cac-794d-4fff-8b28-80c580ef1148]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06996f7-475d-4f13-89fa-bb1c5487d476]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rEkFuIDz {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rEkFuIDz" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[405aa43c-d152-4be2-a7b0-4e50b3a7c9d4]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rEkFuIDz'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ebd4e8-cac5-47f8-95e5-18e21a109549]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca6a92c-8b4f-45c9-b540-f55e4ea3875c]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:24:47 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:24:47 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 -p 172.16.0.220:3260 --login {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f01c749-385d-4e73-9972-2a7effc11e6e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7, portal: 172.16.0.220,3260]
Apr 11 15:24:47 user nova-compute[71229]: Login to [iface: default, target: iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7, portal: 172.16.0.220,3260] successful.
Apr 11 15:24:47 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cccc6a6-c869-42cd-9468-ceb9e91ff928]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6513229-aa16-439e-9965-6359f408d3e0]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:24:47 user nova-compute[71229]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)
Apr 11 15:24:47 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:24:47 user nova-compute[71229]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)
Apr 11 15:24:47 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] HCTL ('34', '-', '-', 0) found on session 13 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a621af0d-5933-49b9-ba23-d8b10ba0835d]: (4, ('- - 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Searching for a device in session 13 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:24:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rEkFuIDz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 15:24:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:24:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '26434303966343363', 'path': '/dev/sdc'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:24:48 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434303966343363', 'path': '/dev/sdc'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 15:24:48 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:24:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2037395852',display_name='tempest-TestShelveInstance-server-2037395852',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2037395852',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4WD1C8T6tkUEgT5nSc1MsqRgkLNzQRS7RjsK+eCmfdmidOraNTmKvDvSPnsYiAjMuo6nku/oKvPzyy026kIaVTiO+J+8OfPbwUqPSj0x0wpOl+Z+4f+Lo5uETYRrAumQ==',key_name='tempest-TestShelveInstance-1630475072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63ed867a40534b70bf75dc0cc28fdfec',ramdisk_id='',reservation_id='r-vsdu64f3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-602339736',owner_user_name='tempest-TestShelveInstance-602339736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:24:43Z,user_data=None,user_id='49e1716b2bb2438b93d46dc8052c788b',uuid=39e3dfb1-bc09-474d-b8cb-f01b11923eae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24", "address": "fa:16:3e:97:55:b0", "network": {"id": "75a41a6a-1c7b-47b0-907e-2015d56f554e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1001895705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ed867a40534b70bf75dc0cc28fdfec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d628ba-6b", "ovs_interfaceid": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:24:48 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Converting VIF {"id": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24", "address": "fa:16:3e:97:55:b0", "network": {"id": "75a41a6a-1c7b-47b0-907e-2015d56f554e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1001895705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ed867a40534b70bf75dc0cc28fdfec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d628ba-6b", "ovs_interfaceid": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:24:48 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:55:b0,bridge_name='br-int',has_traffic_filtering=True,id=21d628ba-6bae-4d98-94df-bb6fbb4f1c24,network=Network(75a41a6a-1c7b-47b0-907e-2015d56f554e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21d628ba-6b') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:24:48 user nova-compute[71229]: DEBUG nova.objects.instance [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lazy-loading 'pci_devices' on Instance uuid 39e3dfb1-bc09-474d-b8cb-f01b11923eae {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:24:48 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:24:48 user nova-compute[71229]:   <uuid>39e3dfb1-bc09-474d-b8cb-f01b11923eae</uuid>
Apr 11 15:24:48 user nova-compute[71229]:   <name>instance-0000000e</name>
Apr 11 15:24:48 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:24:48 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:24:48 user nova-compute[71229]:   <metadata>
Apr 11 15:24:48 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:24:48 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:24:48 user nova-compute[71229]:       <nova:name>tempest-TestShelveInstance-server-2037395852</nova:name>
Apr 11 15:24:48 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:24:47</nova:creationTime>
Apr 11 15:24:48 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:24:48 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:24:48 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:24:48 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:24:48 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:24:48 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:24:48 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:24:48 user nova-compute[71229]:       <nova:owner>
Apr 11 15:24:48 user nova-compute[71229]:         <nova:user uuid="49e1716b2bb2438b93d46dc8052c788b">tempest-TestShelveInstance-602339736-project-member</nova:user>
Apr 11 15:24:48 user nova-compute[71229]:         <nova:project uuid="63ed867a40534b70bf75dc0cc28fdfec">tempest-TestShelveInstance-602339736</nova:project>
Apr 11 15:24:48 user nova-compute[71229]:       </nova:owner>
Apr 11 15:24:48 user nova-compute[71229]:       <nova:ports>
Apr 11 15:24:48 user nova-compute[71229]:         <nova:port uuid="21d628ba-6bae-4d98-94df-bb6fbb4f1c24">
Apr 11 15:24:48 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 11 15:24:48 user nova-compute[71229]:         </nova:port>
Apr 11 15:24:48 user nova-compute[71229]:       </nova:ports>
Apr 11 15:24:48 user nova-compute[71229]:     </nova:instance>
Apr 11 15:24:48 user nova-compute[71229]:   </metadata>
Apr 11 15:24:48 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:24:48 user nova-compute[71229]:     <system>
Apr 11 15:24:48 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:24:48 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:24:48 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:24:48 user nova-compute[71229]:       <entry name="serial">39e3dfb1-bc09-474d-b8cb-f01b11923eae</entry>
Apr 11 15:24:48 user nova-compute[71229]:       <entry name="uuid">39e3dfb1-bc09-474d-b8cb-f01b11923eae</entry>
Apr 11 15:24:48 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:24:48 user nova-compute[71229]:     </system>
Apr 11 15:24:48 user nova-compute[71229]:   </sysinfo>
Apr 11 15:24:48 user nova-compute[71229]:   <os>
Apr 11 15:24:48 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:24:48 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 15:24:48 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:24:48 user nova-compute[71229]:   </os>
Apr 11 15:24:48 user nova-compute[71229]:   <features>
Apr 11 15:24:48 user nova-compute[71229]:     <acpi/>
Apr 11 15:24:48 user nova-compute[71229]:     <apic/>
Apr 11 15:24:48 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:24:48 user nova-compute[71229]:   </features>
Apr 11 15:24:48 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:24:48 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:24:48 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:24:48 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:24:48 user nova-compute[71229]:   </clock>
Apr 11 15:24:48 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:24:48 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:24:48 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:24:48 user nova-compute[71229]:   </cpu>
Apr 11 15:24:48 user nova-compute[71229]:   <devices>
Apr 11 15:24:48 user nova-compute[71229]:     <disk type="block" device="disk">
Apr 11 15:24:48 user nova-compute[71229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:24:48 user nova-compute[71229]:       <source dev="/dev/sdc"/>
Apr 11 15:24:48 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:24:48 user nova-compute[71229]:       <serial>3132ad02-1f63-469b-b802-d814466b9ad7</serial>
Apr 11 15:24:48 user nova-compute[71229]:     </disk>
Apr 11 15:24:48 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:24:48 user nova-compute[71229]:       <mac address="fa:16:3e:97:55:b0"/>
Apr 11 15:24:48 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:24:48 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:24:48 user nova-compute[71229]:       <target dev="tap21d628ba-6b"/>
Apr 11 15:24:48 user nova-compute[71229]:     </interface>
Apr 11 15:24:48 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:24:48 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/39e3dfb1-bc09-474d-b8cb-f01b11923eae/console.log" append="off"/>
Apr 11 15:24:48 user nova-compute[71229]:     </serial>
Apr 11 15:24:48 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:24:48 user nova-compute[71229]:     <video>
Apr 11 15:24:48 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:24:48 user nova-compute[71229]:     </video>
Apr 11 15:24:48 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:24:48 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:24:48 user nova-compute[71229]:     </rng>
Apr 11 15:24:48 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:24:48 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:24:48 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:24:48 user nova-compute[71229]:     </memballoon>
Apr 11 15:24:48 user nova-compute[71229]:   </devices>
Apr 11 15:24:48 user nova-compute[71229]: </domain>
Apr 11 15:24:48 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:24:49 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:24:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2037395852',display_name='tempest-TestShelveInstance-server-2037395852',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2037395852',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4WD1C8T6tkUEgT5nSc1MsqRgkLNzQRS7RjsK+eCmfdmidOraNTmKvDvSPnsYiAjMuo6nku/oKvPzyy026kIaVTiO+J+8OfPbwUqPSj0x0wpOl+Z+4f+Lo5uETYRrAumQ==',key_name='tempest-TestShelveInstance-1630475072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63ed867a40534b70bf75dc0cc28fdfec',ramdisk_id='',reservation_id='r-vsdu64f3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-602339736',owner_user_name='tempest-TestShelveInstance-602339736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:24:43Z,user_data=None,user_id='49e1716b2bb2438b93d46dc8052c788b',uuid=39e3dfb1-bc09-474d-b8cb-f01b11923eae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24", "address": "fa:16:3e:97:55:b0", "network": {"id": "75a41a6a-1c7b-47b0-907e-2015d56f554e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1001895705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ed867a40534b70bf75dc0cc28fdfec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d628ba-6b", "ovs_interfaceid": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:24:49 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Converting VIF {"id": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24", "address": "fa:16:3e:97:55:b0", "network": {"id": "75a41a6a-1c7b-47b0-907e-2015d56f554e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1001895705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ed867a40534b70bf75dc0cc28fdfec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d628ba-6b", "ovs_interfaceid": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:24:49 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:55:b0,bridge_name='br-int',has_traffic_filtering=True,id=21d628ba-6bae-4d98-94df-bb6fbb4f1c24,network=Network(75a41a6a-1c7b-47b0-907e-2015d56f554e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21d628ba-6b') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:24:49 user nova-compute[71229]: DEBUG os_vif [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:55:b0,bridge_name='br-int',has_traffic_filtering=True,id=21d628ba-6bae-4d98-94df-bb6fbb4f1c24,network=Network(75a41a6a-1c7b-47b0-907e-2015d56f554e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21d628ba-6b') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:24:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:24:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:24:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21d628ba-6b, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:24:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap21d628ba-6b, col_values=(('external_ids', {'iface-id': '21d628ba-6bae-4d98-94df-bb6fbb4f1c24', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:55:b0', 'vm-uuid': '39e3dfb1-bc09-474d-b8cb-f01b11923eae'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:24:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:24:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:49 user nova-compute[71229]: INFO os_vif [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:55:b0,bridge_name='br-int',has_traffic_filtering=True,id=21d628ba-6bae-4d98-94df-bb6fbb4f1c24,network=Network(75a41a6a-1c7b-47b0-907e-2015d56f554e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21d628ba-6b')
Apr 11 15:24:49 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:24:49 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] No VIF found with MAC fa:16:3e:97:55:b0, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:24:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "6a805345-374c-4326-9e8f-39bfc7947a35" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:24:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "6a805345-374c-4326-9e8f-39bfc7947a35" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:24:49 user nova-compute[71229]: DEBUG nova.objects.instance [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lazy-loading 'flavor' on Instance uuid 6a805345-374c-4326-9e8f-39bfc7947a35 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:24:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "6a805345-374c-4326-9e8f-39bfc7947a35" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:24:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "6a805345-374c-4326-9e8f-39bfc7947a35" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:24:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "6a805345-374c-4326-9e8f-39bfc7947a35" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:24:49 user nova-compute[71229]: INFO nova.compute.manager [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Attaching volume cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 to /dev/vdb
Apr 11 15:24:50 user nova-compute[71229]: DEBUG os_brick.utils [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:24:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:50 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f4c0b6-2aad-48ec-995a-e59b426d2fdf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d55e24a97c90\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:24:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:50 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d655390e-4545-4b03-971d-6619fc89cce8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:24:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:50 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[607f196d-7c2e-42a1-bdd3-c91e52271c60]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:24:50 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[45125d1f-83d3-49e7-ae9d-648310239bad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:24:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Running cmd (subprocess): nvme version {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 'nvme version' failed. Not Retrying. {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:24:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] nvme not present on system {{(pid=71229) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 15:24:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:24:50 user nova-compute[71229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 15:24:50 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83afe28-867f-45b9-9285-6ef9524fe121]: (4, '') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:24:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71229) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 15:24:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 15:24:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] LIGHTOS: no hostnqn found. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 15:24:50 user nova-compute[71229]: DEBUG os_brick.utils [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d55e24a97c90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:24:50 user nova-compute[71229]: DEBUG nova.virt.block_device [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Updating existing volume attachment record: 8f520e3c-8d2a-473c-aad3-9ab9de26118f {{(pid=71229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 15:24:50 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:50 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:50 user nova-compute[71229]: DEBUG nova.compute.manager [req-12dbe67b-cb41-4e0d-8eff-2519fb2ef962 req-50d40eca-513c-448b-8368-52ac72b7d0fc service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Received event network-vif-plugged-21d628ba-6bae-4d98-94df-bb6fbb4f1c24 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:24:50 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-12dbe67b-cb41-4e0d-8eff-2519fb2ef962 req-50d40eca-513c-448b-8368-52ac72b7d0fc service nova] Acquiring lock "39e3dfb1-bc09-474d-b8cb-f01b11923eae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:24:50 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-12dbe67b-cb41-4e0d-8eff-2519fb2ef962 req-50d40eca-513c-448b-8368-52ac72b7d0fc service nova] Lock "39e3dfb1-bc09-474d-b8cb-f01b11923eae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:24:50 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-12dbe67b-cb41-4e0d-8eff-2519fb2ef962 req-50d40eca-513c-448b-8368-52ac72b7d0fc service nova] Lock "39e3dfb1-bc09-474d-b8cb-f01b11923eae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:24:50 user nova-compute[71229]: DEBUG nova.compute.manager [req-12dbe67b-cb41-4e0d-8eff-2519fb2ef962 req-50d40eca-513c-448b-8368-52ac72b7d0fc service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] No waiting events found dispatching network-vif-plugged-21d628ba-6bae-4d98-94df-bb6fbb4f1c24 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:24:50 user nova-compute[71229]: WARNING nova.compute.manager [req-12dbe67b-cb41-4e0d-8eff-2519fb2ef962 req-50d40eca-513c-448b-8368-52ac72b7d0fc service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Received unexpected event network-vif-plugged-21d628ba-6bae-4d98-94df-bb6fbb4f1c24 for instance with vm_state building and task_state spawning.
Apr 11 15:24:50 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:50 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:51 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:51 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:51 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:51 user nova-compute[71229]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681226676.4620087, 8d84862f-b710-48b1-9275-93fc799cf1f9 => Stopped> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:24:51 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] VM Stopped (Lifecycle Event)
Apr 11 15:24:51 user nova-compute[71229]: DEBUG nova.compute.manager [None req-ced6cfb8-111f-4fcd-a247-44b0029d6c17 None None] [instance: 8d84862f-b710-48b1-9275-93fc799cf1f9] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:24:52 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681226692.480246, 39e3dfb1-bc09-474d-b8cb-f01b11923eae => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:24:52 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] VM Resumed (Lifecycle Event)
Apr 11 15:24:52 user nova-compute[71229]: DEBUG nova.compute.manager [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 15:24:52 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Guest created on hypervisor {{(pid=71229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 15:24:52 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Instance spawned successfully.
Apr 11 15:24:52 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 15:24:52 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:24:52 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:24:52 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Found default for hw_cdrom_bus of ide {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:24:52 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Found default for hw_disk_bus of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:24:52 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Found default for hw_input_bus of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:24:52 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Found default for hw_pointer_model of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:24:52 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Found default for hw_video_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:24:52 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Found default for hw_vif_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:24:52 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:24:52 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681226692.481602, 39e3dfb1-bc09-474d-b8cb-f01b11923eae => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:24:52 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] VM Started (Lifecycle Event)
Apr 11 15:24:52 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:24:52 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:24:52 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:24:52 user nova-compute[71229]: INFO nova.compute.manager [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Took 5.05 seconds to spawn the instance on the hypervisor.
Apr 11 15:24:52 user nova-compute[71229]: DEBUG nova.compute.manager [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:24:52 user nova-compute[71229]: INFO nova.compute.manager [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Took 10.22 seconds to build instance.
Apr 11 15:24:52 user nova-compute[71229]: DEBUG nova.compute.manager [req-c0d44407-0d0b-4c76-9384-c177d8917c79 req-fb26a3fe-318b-4911-9484-85ce65325f46 service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Received event network-vif-plugged-21d628ba-6bae-4d98-94df-bb6fbb4f1c24 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:24:52 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c0d44407-0d0b-4c76-9384-c177d8917c79 req-fb26a3fe-318b-4911-9484-85ce65325f46 service nova] Acquiring lock "39e3dfb1-bc09-474d-b8cb-f01b11923eae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:24:52 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c0d44407-0d0b-4c76-9384-c177d8917c79 req-fb26a3fe-318b-4911-9484-85ce65325f46 service nova] Lock "39e3dfb1-bc09-474d-b8cb-f01b11923eae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:24:52 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c0d44407-0d0b-4c76-9384-c177d8917c79 req-fb26a3fe-318b-4911-9484-85ce65325f46 service nova] Lock "39e3dfb1-bc09-474d-b8cb-f01b11923eae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:24:52 user nova-compute[71229]: DEBUG nova.compute.manager [req-c0d44407-0d0b-4c76-9384-c177d8917c79 req-fb26a3fe-318b-4911-9484-85ce65325f46 service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] No waiting events found dispatching network-vif-plugged-21d628ba-6bae-4d98-94df-bb6fbb4f1c24 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:24:52 user nova-compute[71229]: WARNING nova.compute.manager [req-c0d44407-0d0b-4c76-9384-c177d8917c79 req-fb26a3fe-318b-4911-9484-85ce65325f46 service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Received unexpected event network-vif-plugged-21d628ba-6bae-4d98-94df-bb6fbb4f1c24 for instance with vm_state active and task_state None.
Apr 11 15:24:52 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-40beb87d-cc64-49c1-b574-a7e5ed146665 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "39e3dfb1-bc09-474d-b8cb-f01b11923eae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.406s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:24:54 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 15:24:54 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'blCPNQzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:24:54 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:24:54 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:24:54 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:24:54 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:24:54 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:24:54 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:24:54 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 15:24:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:54 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb91b72-e994-4b5e-992a-a08a5ce87387]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:24:54 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 15:24:54 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:24:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 -p 172.16.0.220:3260 --interface default --op new {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:54 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ed085c-6cdd-4c28-b3ce-1b8e24b135a2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4] added\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:24:54 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4] added
Apr 11 15:24:54 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:24:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:54 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e2d381-cbb3-4fe6-b5d2-dd2e8c4cfcbe]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:24:54 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:24:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:54 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[552f4c58-98fe-4add-a40f-d2547d277a56]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:24:54 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:24:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v blCPNQzx {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v blCPNQzx" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:54 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[18749846-dcdd-47a9-ae4d-0c865ce5617c]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:24:54 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'blCPNQzx'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:24:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:54 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ba8952-bdc4-4831-91f2-520cdbc8995d]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:24:54 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:24:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:54 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8e06d1-c5aa-4f3b-a060-664a5df1303a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:24:54 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:24:54 user nova-compute[71229]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)
Apr 11 15:24:54 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:24:54 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:24:54 user nova-compute[71229]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)
Apr 11 15:24:54 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:24:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 -p 172.16.0.220:3260 --login {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:54 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb1a95d-ad91-43e2-a68e-582343f39f92]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:24:54 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4, portal: 172.16.0.220,3260]
Apr 11 15:24:54 user nova-compute[71229]: Login to [iface: default, target: iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4, portal: 172.16.0.220,3260] successful.
Apr 11 15:24:54 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:24:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:54 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6a0817-5281-4abf-8f24-36b7609528b7]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:24:54 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:24:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:55 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c113fcac-b7b4-4024-afd2-90b49a462322]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:24:55 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:24:55 user nova-compute[71229]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)
Apr 11 15:24:55 user nova-compute[71229]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 (non-flash)
Apr 11 15:24:55 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:24:55 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:24:55 user nova-compute[71229]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)
Apr 11 15:24:55 user nova-compute[71229]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 (non-flash)
Apr 11 15:24:55 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:24:55 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:24:55 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 15:24:55 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] HCTL ('35', '-', '-', 0) found on session 14 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 15:24:55 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 15:24:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:55 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c485455e-58dd-4f32-a977-8507fb6906c0]: (4, ('- - 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:24:55 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Searching for a device in session 14 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:24:55 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'blCPNQzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 15:24:55 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:24:55 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:24:55 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:24:55 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 15:24:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "refresh_cache-f3a06747-0f43-4731-87e6-40629c382a6b" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:24:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquired lock "refresh_cache-f3a06747-0f43-4731-87e6-40629c382a6b" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:24:55 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Forcefully refreshing network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 15:24:56 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:24:56 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '26234353637313333', 'path': '/dev/sdd'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:24:56 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234353637313333', 'path': '/dev/sdd'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 15:24:56 user nova-compute[71229]: DEBUG nova.objects.instance [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lazy-loading 'flavor' on Instance uuid 6a805345-374c-4326-9e8f-39bfc7947a35 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:24:56 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 15:24:56 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:24:56 user nova-compute[71229]:   <source dev="/dev/sdd"/>
Apr 11 15:24:56 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 15:24:56 user nova-compute[71229]:   <serial>cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4</serial>
Apr 11 15:24:56 user nova-compute[71229]: </disk>
Apr 11 15:24:56 user nova-compute[71229]:  {{(pid=71229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 15:24:56 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Updating instance_info_cache with network_info: [{"id": "a7049f98-5ea1-4167-be7f-3206830f17c4", "address": "fa:16:3e:74:02:c7", "network": {"id": "f52bd4a9-1843-408b-85af-c2124ad01be7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-593462205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da140971126a4d298ff718275e7a22ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7049f98-5e", "ovs_interfaceid": "a7049f98-5ea1-4167-be7f-3206830f17c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:24:56 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Releasing lock "refresh_cache-f3a06747-0f43-4731-87e6-40629c382a6b" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:24:56 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Updated the network info_cache for instance {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 15:24:56 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:24:56 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:24:56 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:24:56 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:24:56 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:24:56 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:24:56 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 15:24:56 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:24:56 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:24:56 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:24:56 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:24:56 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 15:24:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:56 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:24:56 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:24:56 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] No VIF found with MAC fa:16:3e:0f:f8:cb, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:24:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:56 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-9adc4bf6-aa58-462d-9d73-08b477837774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "6a805345-374c-4326-9e8f-39bfc7947a35" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.772s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:24:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:56 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:24:56 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:24:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b59399aa-f550-41c7-9818-6cb1f271fb52/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b59399aa-f550-41c7-9818-6cb1f271fb52/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b59399aa-f550-41c7-9818-6cb1f271fb52/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b59399aa-f550-41c7-9818-6cb1f271fb52/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:57 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:57 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:24:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a06747-0f43-4731-87e6-40629c382a6b/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a06747-0f43-4731-87e6-40629c382a6b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a06747-0f43-4731-87e6-40629c382a6b/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a06747-0f43-4731-87e6-40629c382a6b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/068f10b4-086e-4af7-a53e-f6ece73d01e4/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:58 user nova-compute[71229]: INFO nova.compute.manager [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Rebuilding instance
Apr 11 15:24:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/068f10b4-086e-4af7-a53e-f6ece73d01e4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/068f10b4-086e-4af7-a53e-f6ece73d01e4/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:24:58 user nova-compute[71229]: DEBUG nova.objects.instance [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6a805345-374c-4326-9e8f-39bfc7947a35 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:24:58 user nova-compute[71229]: DEBUG nova.compute.manager [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:24:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/068f10b4-086e-4af7-a53e-f6ece73d01e4/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:24:58 user nova-compute[71229]: DEBUG nova.objects.instance [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lazy-loading 'pci_requests' on Instance uuid 6a805345-374c-4326-9e8f-39bfc7947a35 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:24:58 user nova-compute[71229]: DEBUG nova.objects.instance [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a805345-374c-4326-9e8f-39bfc7947a35 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:24:59 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:59 user nova-compute[71229]: DEBUG nova.objects.instance [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lazy-loading 'resources' on Instance uuid 6a805345-374c-4326-9e8f-39bfc7947a35 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:24:59 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:24:59 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:24:59 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8077MB free_disk=26.364322662353516GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 15:24:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:24:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:24:59 user nova-compute[71229]: DEBUG nova.objects.instance [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lazy-loading 'migration_context' on Instance uuid 6a805345-374c-4326-9e8f-39bfc7947a35 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:24:59 user nova-compute[71229]: DEBUG nova.objects.instance [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71229) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 11 15:24:59 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:59 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance de1a45fd-27be-4438-80a4-2f3a100643c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:24:59 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 6a805345-374c-4326-9e8f-39bfc7947a35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:24:59 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance f3a06747-0f43-4731-87e6-40629c382a6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:24:59 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance b0d90fd2-6a95-43c4-8756-e82071d99154 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:24:59 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 068f10b4-086e-4af7-a53e-f6ece73d01e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:24:59 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:24:59 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance b59399aa-f550-41c7-9818-6cb1f271fb52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:24:59 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 39e3dfb1-bc09-474d-b8cb-f01b11923eae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:24:59 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 15:24:59 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 15:24:59 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:59 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:24:59 user nova-compute[71229]: DEBUG nova.compute.manager [req-f2f3c490-f30e-4b0f-9506-527cbcde2900 req-18f312dd-1dc1-426b-937f-b35140ea2d90 service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Received event network-vif-unplugged-d8c64197-b034-4f38-821d-ba030f1fca6b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:24:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-f2f3c490-f30e-4b0f-9506-527cbcde2900 req-18f312dd-1dc1-426b-937f-b35140ea2d90 service nova] Acquiring lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:24:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-f2f3c490-f30e-4b0f-9506-527cbcde2900 req-18f312dd-1dc1-426b-937f-b35140ea2d90 service nova] Lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:24:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-f2f3c490-f30e-4b0f-9506-527cbcde2900 req-18f312dd-1dc1-426b-937f-b35140ea2d90 service nova] Lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:24:59 user nova-compute[71229]: DEBUG nova.compute.manager [req-f2f3c490-f30e-4b0f-9506-527cbcde2900 req-18f312dd-1dc1-426b-937f-b35140ea2d90 service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] No waiting events found dispatching network-vif-unplugged-d8c64197-b034-4f38-821d-ba030f1fca6b {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:24:59 user nova-compute[71229]: WARNING nova.compute.manager [req-f2f3c490-f30e-4b0f-9506-527cbcde2900 req-18f312dd-1dc1-426b-937f-b35140ea2d90 service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Received unexpected event network-vif-unplugged-d8c64197-b034-4f38-821d-ba030f1fca6b for instance with vm_state active and task_state rebuilding.
Apr 11 15:24:59 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:24:59 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:24:59 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 15:24:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.503s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:25:00 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Instance destroyed successfully.
Apr 11 15:25:00 user nova-compute[71229]: INFO nova.compute.manager [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Detaching volume cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4
Apr 11 15:25:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:00 user nova-compute[71229]: INFO nova.virt.block_device [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Attempting to driver detach volume cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 from mountpoint /dev/vdb
Apr 11 15:25:00 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Attempting to detach device vdb from instance 6a805345-374c-4326-9e8f-39bfc7947a35 from the persistent domain config. {{(pid=71229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 15:25:00 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 15:25:00 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:25:00 user nova-compute[71229]:   <source dev="/dev/sdd"/>
Apr 11 15:25:00 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 15:25:00 user nova-compute[71229]:   <serial>cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4</serial>
Apr 11 15:25:00 user nova-compute[71229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 15:25:00 user nova-compute[71229]: </disk>
Apr 11 15:25:00 user nova-compute[71229]:  {{(pid=71229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 15:25:00 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Successfully detached device vdb from instance 6a805345-374c-4326-9e8f-39bfc7947a35 from the persistent domain config.
Apr 11 15:25:00 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 15:25:00 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'blCPNQzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:25:00 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 11 15:25:00 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:25:00 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:25:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:25:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:25:00 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e30da7-df7c-4db3-acdf-c6fcbbe1bbd0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:25:00 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 15:25:00 user nova-compute[71229]: No targets found.
Apr 11 15:25:00 user nova-compute[71229]: iSNS:
Apr 11 15:25:00 user nova-compute[71229]: No targets found.
Apr 11 15:25:00 user nova-compute[71229]: STATIC:
Apr 11 15:25:00 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb
Apr 11 15:25:00 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:25:00 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:25:00 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4
Apr 11 15:25:00 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:25:00 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:25:00 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7
Apr 11 15:25:00 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:25:00 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:25:00 user nova-compute[71229]: FIRMWARE:
Apr 11 15:25:00 user nova-compute[71229]: No targets found.
Apr 11 15:25:00 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:25:00 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 15:25:00 user nova-compute[71229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 15:25:00 user nova-compute[71229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71229) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 15:25:00 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4', 0)] {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 15:25:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:25:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:25:00 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca04bf1-4bc3-4b38-bd7a-b010da92ff1e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:25:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:25:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:25:00 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d99fd7a-ff05-40cd-b06b-467b01368603]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:25:00 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:25:00 user nova-compute[71229]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)
Apr 11 15:25:00 user nova-compute[71229]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 (non-flash)
Apr 11 15:25:00 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:25:00 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:25:00 user nova-compute[71229]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)
Apr 11 15:25:00 user nova-compute[71229]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 (non-flash)
Apr 11 15:25:00 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:25:00 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb69def520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4'): ({'sdd'}, set())}) {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 15:25:00 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Removing single pathed devices sdd {{(pid=71229) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 15:25:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:25:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:25:00 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[32cc70f9-b41a-4607-a5a9-7ea0e467c817]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:25:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:25:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:25:00 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86d7c6e-b78b-418c-a95c-29be705fa9df]: (4, ('ok\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:25:00 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Flushing IO for device /dev/sdd {{(pid=71229) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 15:25:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:25:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:25:00 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[816535ac-e966-4122-94e3-f9e1bcdbef6d]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:25:00 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71229) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 15:25:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:25:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.060s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:25:00 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e7fd9f-8a2b-4fc5-8dbd-987bcf5b4d6f]: (4, ('1', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:25:00 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 15:25:00 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] SCSI volumes sdd have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 15:25:00 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4')] {{(pid=71229) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 15:25:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:25:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:25:00 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca971106-fa2a-4509-a707-78d592a8152c]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:25:00 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:25:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 -p 172.16.0.220:3260 --logout {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:25:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:25:00 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce800b3-5e24-4c59-a97c-a7a3f1dee940]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:25:00 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4, portal: 172.16.0.220,3260]
Apr 11 15:25:00 user nova-compute[71229]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4, portal: 172.16.0.220,3260] successful.
Apr 11 15:25:00 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:25:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 -p 172.16.0.220:3260 --op delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:25:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:25:00 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[511874cb-5457-45f3-85f3-5e55dfdba4d5]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:25:00 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:25:00 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:25:00 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] <== disconnect_volume: return (329ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:25:00 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 15:25:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:01 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Instance destroyed successfully.
Apr 11 15:25:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:21:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1386574519',display_name='tempest-ServerActionsTestJSON-server-252985182',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1386574519',id=3,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfAJGQ+GOa8zW+jlKgD9Kz6/k6iEv9pZIOIjICzcstJ92AAS94+47mc3fRsqyx5FaTMV9P4lTsW4Fy7tKIAtMpRx0Sl7sa6ttQnPbPhlcYqfbdWbTqmmKi6+BuZpqSknA==',key_name='tempest-keypair-1137963694',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:21:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bb7660e8f76b471487136806ee9eec62',ramdisk_id='',reservation_id='r-hmn5p3xn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1659503440',owner_user_name='tempest-ServerActionsTestJSON-1659503440-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:24:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10720df0ac4f4e62a0a5c9883d600add',uuid=6a805345-374c-4326-9e8f-39bfc7947a35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8c64197-b034-4f38-821d-ba030f1fca6b", "address": "fa:16:3e:0f:f8:cb", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c64197-b0", "ovs_interfaceid": "d8c64197-b034-4f38-821d-ba030f1fca6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:25:01 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Converting VIF {"id": "d8c64197-b034-4f38-821d-ba030f1fca6b", "address": "fa:16:3e:0f:f8:cb", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c64197-b0", "ovs_interfaceid": "d8c64197-b034-4f38-821d-ba030f1fca6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:25:01 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:f8:cb,bridge_name='br-int',has_traffic_filtering=True,id=d8c64197-b034-4f38-821d-ba030f1fca6b,network=Network(1bd215e8-0459-4dd2-893b-096b6e31ac08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c64197-b0') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:25:01 user nova-compute[71229]: DEBUG os_vif [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:f8:cb,bridge_name='br-int',has_traffic_filtering=True,id=d8c64197-b034-4f38-821d-ba030f1fca6b,network=Network(1bd215e8-0459-4dd2-893b-096b6e31ac08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c64197-b0') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:25:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd8c64197-b0, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:25:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:25:01 user nova-compute[71229]: INFO os_vif [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:f8:cb,bridge_name='br-int',has_traffic_filtering=True,id=d8c64197-b034-4f38-821d-ba030f1fca6b,network=Network(1bd215e8-0459-4dd2-893b-096b6e31ac08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c64197-b0')
Apr 11 15:25:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 15:25:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'blCPNQzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:25:01 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 11 15:25:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:25:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:25:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:25:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:25:01 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b1d56d-114f-430d-b379-1f0ab5272db8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:25:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 15:25:01 user nova-compute[71229]: No targets found.
Apr 11 15:25:01 user nova-compute[71229]: iSNS:
Apr 11 15:25:01 user nova-compute[71229]: No targets found.
Apr 11 15:25:01 user nova-compute[71229]: STATIC:
Apr 11 15:25:01 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb
Apr 11 15:25:01 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:25:01 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:25:01 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7
Apr 11 15:25:01 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:25:01 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:25:01 user nova-compute[71229]: FIRMWARE:
Apr 11 15:25:01 user nova-compute[71229]: No targets found.
Apr 11 15:25:01 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:25:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 15:25:01 user nova-compute[71229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 15:25:01 user nova-compute[71229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71229) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 15:25:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4', 0)] {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 15:25:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:25:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:25:01 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c09437-f3c5-46b1-a129-09d125386cd4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:25:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:25:01 user nova-compute[71229]: DEBUG nova.compute.manager [req-0fa91682-e3d4-49f5-a004-31a889e8e44b req-4277ed3a-43f8-4e91-891f-5541267a8c72 service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Received event network-vif-plugged-d8c64197-b034-4f38-821d-ba030f1fca6b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:25:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-0fa91682-e3d4-49f5-a004-31a889e8e44b req-4277ed3a-43f8-4e91-891f-5541267a8c72 service nova] Acquiring lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:25:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-0fa91682-e3d4-49f5-a004-31a889e8e44b req-4277ed3a-43f8-4e91-891f-5541267a8c72 service nova] Lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:25:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-0fa91682-e3d4-49f5-a004-31a889e8e44b req-4277ed3a-43f8-4e91-891f-5541267a8c72 service nova] Lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:25:01 user nova-compute[71229]: DEBUG nova.compute.manager [req-0fa91682-e3d4-49f5-a004-31a889e8e44b req-4277ed3a-43f8-4e91-891f-5541267a8c72 service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] No waiting events found dispatching network-vif-plugged-d8c64197-b034-4f38-821d-ba030f1fca6b {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:25:01 user nova-compute[71229]: WARNING nova.compute.manager [req-0fa91682-e3d4-49f5-a004-31a889e8e44b req-4277ed3a-43f8-4e91-891f-5541267a8c72 service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Received unexpected event network-vif-plugged-d8c64197-b034-4f38-821d-ba030f1fca6b for instance with vm_state active and task_state rebuilding.
Apr 11 15:25:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:25:01 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[03daf2e5-cc8a-4020-ab99-ad28db05bd9b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:25:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:25:01 user nova-compute[71229]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)
Apr 11 15:25:01 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:25:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:25:01 user nova-compute[71229]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)
Apr 11 15:25:01 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:25:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb5c283130>, {}) {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 15:25:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Disconnecting from: [] {{(pid=71229) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 15:25:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.083s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:25:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] <== disconnect_volume: return (84ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:25:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 15:25:01 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Deleting instance files /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35_del
Apr 11 15:25:01 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Deletion of /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35_del complete
Apr 11 15:25:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Acquiring lock "e4555892-7abb-4a3c-a4ae-a27ad4902708" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:25:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "e4555892-7abb-4a3c-a4ae-a27ad4902708" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:25:01 user nova-compute[71229]: DEBUG nova.compute.manager [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Starting instance... {{(pid=71229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 15:25:01 user nova-compute[71229]: INFO nova.virt.block_device [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Booting with volume cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 at /dev/vdb
Apr 11 15:25:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:25:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:25:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 15:25:01 user nova-compute[71229]: INFO nova.compute.claims [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Claim successful on node user
Apr 11 15:25:01 user nova-compute[71229]: DEBUG os_brick.utils [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:25:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:25:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:25:01 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf40af0e-b327-4362-b945-f6a0fa1c4627]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d55e24a97c90\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:25:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:25:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:25:01 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[da787c7b-cb9d-4f2c-80ca-7c114b446efe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:25:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:25:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:25:01 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f0de14-9046-4e7a-b1a5-0f10b893ed4c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:25:01 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[55fc714f-be78-490a-b5f2-3e416d4d25fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:25:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Running cmd (subprocess): nvme version {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:25:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 'nvme version' failed. Not Retrying. {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:25:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] nvme not present on system {{(pid=71229) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 15:25:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:25:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:25:02 user nova-compute[71229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 15:25:02 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3692b53e-2ba4-4a71-bcdd-cf1b7a7edb6a]: (4, '') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:25:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71229) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 15:25:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 15:25:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] LIGHTOS: no hostnqn found. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 15:25:02 user nova-compute[71229]: DEBUG os_brick.utils [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d55e24a97c90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:25:02 user nova-compute[71229]: DEBUG nova.virt.block_device [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Updating existing volume attachment record: fc9f2e36-3c99-4786-ac24-a646f4e0b091 {{(pid=71229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 15:25:02 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:25:02 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:25:02 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.480s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:25:02 user nova-compute[71229]: DEBUG nova.compute.manager [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Start building networks asynchronously for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 15:25:02 user nova-compute[71229]: DEBUG nova.compute.manager [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Allocating IP information in the background. {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 15:25:02 user nova-compute[71229]: DEBUG nova.network.neutron [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] allocate_for_instance() {{(pid=71229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 15:25:02 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 15:25:02 user nova-compute[71229]: DEBUG nova.compute.manager [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Start building block device mappings for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 15:25:02 user nova-compute[71229]: DEBUG nova.policy [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b2538af5c739404aa433b766976e5b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561130d089c8415297697bcedc93aefc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71229) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 15:25:02 user nova-compute[71229]: DEBUG nova.compute.manager [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Start spawning the instance on the hypervisor. {{(pid=71229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 15:25:02 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Creating instance directory {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 15:25:02 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Creating image(s)
Apr 11 15:25:02 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Acquiring lock "/opt/stack/data/nova/instances/e4555892-7abb-4a3c-a4ae-a27ad4902708/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:25:02 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "/opt/stack/data/nova/instances/e4555892-7abb-4a3c-a4ae-a27ad4902708/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:25:02 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "/opt/stack/data/nova/instances/e4555892-7abb-4a3c-a4ae-a27ad4902708/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:25:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:25:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.154s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:25:02 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Acquiring lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:25:02 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:25:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:25:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.182s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:25:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/e4555892-7abb-4a3c-a4ae-a27ad4902708/disk 1073741824 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:25:03 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/e4555892-7abb-4a3c-a4ae-a27ad4902708/disk 1073741824" returned: 0 in 0.060s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:25:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:25:03 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:25:03 user nova-compute[71229]: DEBUG nova.network.neutron [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Successfully created port: a002e821-ea54-4d5c-b25c-8c517fab4e92 {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 15:25:03 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.164s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:25:03 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e4555892-7abb-4a3c-a4ae-a27ad4902708/disk. size=1073741824 {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 15:25:03 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4555892-7abb-4a3c-a4ae-a27ad4902708/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:25:03 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4555892-7abb-4a3c-a4ae-a27ad4902708/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:25:03 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Cannot resize image /opt/stack/data/nova/instances/e4555892-7abb-4a3c-a4ae-a27ad4902708/disk to a smaller size. {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 15:25:03 user nova-compute[71229]: DEBUG nova.objects.instance [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lazy-loading 'migration_context' on Instance uuid e4555892-7abb-4a3c-a4ae-a27ad4902708 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:25:03 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Created local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 15:25:03 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Ensure instance console log exists: /opt/stack/data/nova/instances/e4555892-7abb-4a3c-a4ae-a27ad4902708/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 15:25:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:25:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:25:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:25:04 user nova-compute[71229]: DEBUG nova.network.neutron [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Successfully updated port: a002e821-ea54-4d5c-b25c-8c517fab4e92 {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:25:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Acquiring lock "refresh_cache-e4555892-7abb-4a3c-a4ae-a27ad4902708" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:25:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Acquired lock "refresh_cache-e4555892-7abb-4a3c-a4ae-a27ad4902708" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:25:04 user nova-compute[71229]: DEBUG nova.network.neutron [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:25:04 user nova-compute[71229]: DEBUG nova.compute.manager [req-0e6d7747-9945-43ba-8082-59101f298d69 req-360caa9a-ad01-46fe-bd1f-9b8641924423 service nova] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Received event network-changed-a002e821-ea54-4d5c-b25c-8c517fab4e92 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:25:04 user nova-compute[71229]: DEBUG nova.compute.manager [req-0e6d7747-9945-43ba-8082-59101f298d69 req-360caa9a-ad01-46fe-bd1f-9b8641924423 service nova] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Refreshing instance network info cache due to event network-changed-a002e821-ea54-4d5c-b25c-8c517fab4e92. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:25:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-0e6d7747-9945-43ba-8082-59101f298d69 req-360caa9a-ad01-46fe-bd1f-9b8641924423 service nova] Acquiring lock "refresh_cache-e4555892-7abb-4a3c-a4ae-a27ad4902708" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:25:04 user nova-compute[71229]: DEBUG nova.network.neutron [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:25:05 user nova-compute[71229]: DEBUG nova.network.neutron [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Updating instance_info_cache with network_info: [{"id": "a002e821-ea54-4d5c-b25c-8c517fab4e92", "address": "fa:16:3e:49:8a:71", "network": {"id": "f9b1d398-27cb-42de-9d95-0e031b1bd6ec", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1833751152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "561130d089c8415297697bcedc93aefc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa002e821-ea", "ovs_interfaceid": "a002e821-ea54-4d5c-b25c-8c517fab4e92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:25:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Releasing lock "refresh_cache-e4555892-7abb-4a3c-a4ae-a27ad4902708" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:25:05 user nova-compute[71229]: DEBUG nova.compute.manager [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Instance network_info: |[{"id": "a002e821-ea54-4d5c-b25c-8c517fab4e92", "address": "fa:16:3e:49:8a:71", "network": {"id": "f9b1d398-27cb-42de-9d95-0e031b1bd6ec", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1833751152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "561130d089c8415297697bcedc93aefc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa002e821-ea", "ovs_interfaceid": "a002e821-ea54-4d5c-b25c-8c517fab4e92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 15:25:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-0e6d7747-9945-43ba-8082-59101f298d69 req-360caa9a-ad01-46fe-bd1f-9b8641924423 service nova] Acquired lock "refresh_cache-e4555892-7abb-4a3c-a4ae-a27ad4902708" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:25:05 user nova-compute[71229]: DEBUG nova.network.neutron [req-0e6d7747-9945-43ba-8082-59101f298d69 req-360caa9a-ad01-46fe-bd1f-9b8641924423 service nova] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Refreshing network info cache for port a002e821-ea54-4d5c-b25c-8c517fab4e92 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:25:05 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Start _get_guest_xml network_info=[{"id": "a002e821-ea54-4d5c-b25c-8c517fab4e92", "address": "fa:16:3e:49:8a:71", "network": {"id": "f9b1d398-27cb-42de-9d95-0e031b1bd6ec", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1833751152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "561130d089c8415297697bcedc93aefc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa002e821-ea", "ovs_interfaceid": "a002e821-ea54-4d5c-b25c-8c517fab4e92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '52fe638c-5ada-47d5-b376-233bfa808a37'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:25:05 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:25:05 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:25:05 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:25:05 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:25:05 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:25:05 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:25:05 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:25:05 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:25:05 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:25:05 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:25:05 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:25:05 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:25:05 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:25:05 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:25:05 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:25:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-704141251',display_name='tempest-ServersNegativeTestJSON-server-704141251',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-704141251',id=15,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='561130d089c8415297697bcedc93aefc',ramdisk_id='',reservation_id='r-rf6vqksg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1004375615',owner_user_name='tempest-ServersNegativeTestJSON-1004375615-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:25:03Z,user_data=None,user_id='b2538af5c739404aa433b766976e5b2d',uuid=e4555892-7abb-4a3c-a4ae-a27ad4902708,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a002e821-ea54-4d5c-b25c-8c517fab4e92", "address": "fa:16:3e:49:8a:71", "network": {"id": "f9b1d398-27cb-42de-9d95-0e031b1bd6ec", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1833751152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "561130d089c8415297697bcedc93aefc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa002e821-ea", "ovs_interfaceid": "a002e821-ea54-4d5c-b25c-8c517fab4e92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:25:05 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Converting VIF {"id": "a002e821-ea54-4d5c-b25c-8c517fab4e92", "address": "fa:16:3e:49:8a:71", "network": {"id": "f9b1d398-27cb-42de-9d95-0e031b1bd6ec", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1833751152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "561130d089c8415297697bcedc93aefc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa002e821-ea", "ovs_interfaceid": "a002e821-ea54-4d5c-b25c-8c517fab4e92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:25:05 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:8a:71,bridge_name='br-int',has_traffic_filtering=True,id=a002e821-ea54-4d5c-b25c-8c517fab4e92,network=Network(f9b1d398-27cb-42de-9d95-0e031b1bd6ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa002e821-ea') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:25:05 user nova-compute[71229]: DEBUG nova.objects.instance [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lazy-loading 'pci_devices' on Instance uuid e4555892-7abb-4a3c-a4ae-a27ad4902708 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:25:05 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:25:05 user nova-compute[71229]:   <uuid>e4555892-7abb-4a3c-a4ae-a27ad4902708</uuid>
Apr 11 15:25:05 user nova-compute[71229]:   <name>instance-0000000f</name>
Apr 11 15:25:05 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:25:05 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:25:05 user nova-compute[71229]:   <metadata>
Apr 11 15:25:05 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:25:05 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:25:05 user nova-compute[71229]:       <nova:name>tempest-ServersNegativeTestJSON-server-704141251</nova:name>
Apr 11 15:25:05 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:25:05</nova:creationTime>
Apr 11 15:25:05 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:25:05 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:25:05 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:25:05 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:25:05 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:25:05 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:25:05 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:25:05 user nova-compute[71229]:       <nova:owner>
Apr 11 15:25:05 user nova-compute[71229]:         <nova:user uuid="b2538af5c739404aa433b766976e5b2d">tempest-ServersNegativeTestJSON-1004375615-project-member</nova:user>
Apr 11 15:25:05 user nova-compute[71229]:         <nova:project uuid="561130d089c8415297697bcedc93aefc">tempest-ServersNegativeTestJSON-1004375615</nova:project>
Apr 11 15:25:05 user nova-compute[71229]:       </nova:owner>
Apr 11 15:25:05 user nova-compute[71229]:       <nova:root type="image" uuid="52fe638c-5ada-47d5-b376-233bfa808a37"/>
Apr 11 15:25:05 user nova-compute[71229]:       <nova:ports>
Apr 11 15:25:05 user nova-compute[71229]:         <nova:port uuid="a002e821-ea54-4d5c-b25c-8c517fab4e92">
Apr 11 15:25:05 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 11 15:25:05 user nova-compute[71229]:         </nova:port>
Apr 11 15:25:05 user nova-compute[71229]:       </nova:ports>
Apr 11 15:25:05 user nova-compute[71229]:     </nova:instance>
Apr 11 15:25:05 user nova-compute[71229]:   </metadata>
Apr 11 15:25:05 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:25:05 user nova-compute[71229]:     <system>
Apr 11 15:25:05 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:25:05 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:25:05 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:25:05 user nova-compute[71229]:       <entry name="serial">e4555892-7abb-4a3c-a4ae-a27ad4902708</entry>
Apr 11 15:25:05 user nova-compute[71229]:       <entry name="uuid">e4555892-7abb-4a3c-a4ae-a27ad4902708</entry>
Apr 11 15:25:05 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:25:05 user nova-compute[71229]:     </system>
Apr 11 15:25:05 user nova-compute[71229]:   </sysinfo>
Apr 11 15:25:05 user nova-compute[71229]:   <os>
Apr 11 15:25:05 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:25:05 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 15:25:05 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:25:05 user nova-compute[71229]:   </os>
Apr 11 15:25:05 user nova-compute[71229]:   <features>
Apr 11 15:25:05 user nova-compute[71229]:     <acpi/>
Apr 11 15:25:05 user nova-compute[71229]:     <apic/>
Apr 11 15:25:05 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:25:05 user nova-compute[71229]:   </features>
Apr 11 15:25:05 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:25:05 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:25:05 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:25:05 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:25:05 user nova-compute[71229]:   </clock>
Apr 11 15:25:05 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:25:05 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:25:05 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:25:05 user nova-compute[71229]:   </cpu>
Apr 11 15:25:05 user nova-compute[71229]:   <devices>
Apr 11 15:25:05 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 15:25:05 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 15:25:05 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/e4555892-7abb-4a3c-a4ae-a27ad4902708/disk"/>
Apr 11 15:25:05 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:25:05 user nova-compute[71229]:     </disk>
Apr 11 15:25:05 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:25:05 user nova-compute[71229]:       <mac address="fa:16:3e:49:8a:71"/>
Apr 11 15:25:05 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:25:05 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:25:05 user nova-compute[71229]:       <target dev="tapa002e821-ea"/>
Apr 11 15:25:05 user nova-compute[71229]:     </interface>
Apr 11 15:25:05 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:25:05 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/e4555892-7abb-4a3c-a4ae-a27ad4902708/console.log" append="off"/>
Apr 11 15:25:05 user nova-compute[71229]:     </serial>
Apr 11 15:25:05 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:25:05 user nova-compute[71229]:     <video>
Apr 11 15:25:05 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:25:05 user nova-compute[71229]:     </video>
Apr 11 15:25:05 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:25:05 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:25:05 user nova-compute[71229]:     </rng>
Apr 11 15:25:05 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:25:05 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:25:05 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:25:05 user nova-compute[71229]:     </memballoon>
Apr 11 15:25:05 user nova-compute[71229]:   </devices>
Apr 11 15:25:05 user nova-compute[71229]: </domain>
Apr 11 15:25:05 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:25:05 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:25:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-704141251',display_name='tempest-ServersNegativeTestJSON-server-704141251',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-704141251',id=15,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='561130d089c8415297697bcedc93aefc',ramdisk_id='',reservation_id='r-rf6vqksg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1004375615',owner_user_name='tempest-ServersNegativeTestJSON-1004375615-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:25:03Z,user_data=None,user_id='b2538af5c739404aa433b766976e5b2d',uuid=e4555892-7abb-4a3c-a4ae-a27ad4902708,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a002e821-ea54-4d5c-b25c-8c517fab4e92", "address": "fa:16:3e:49:8a:71", "network": {"id": "f9b1d398-27cb-42de-9d95-0e031b1bd6ec", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1833751152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "561130d089c8415297697bcedc93aefc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa002e821-ea", "ovs_interfaceid": "a002e821-ea54-4d5c-b25c-8c517fab4e92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:25:05 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Converting VIF {"id": "a002e821-ea54-4d5c-b25c-8c517fab4e92", "address": "fa:16:3e:49:8a:71", "network": {"id": "f9b1d398-27cb-42de-9d95-0e031b1bd6ec", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1833751152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "561130d089c8415297697bcedc93aefc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa002e821-ea", "ovs_interfaceid": "a002e821-ea54-4d5c-b25c-8c517fab4e92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:25:05 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:8a:71,bridge_name='br-int',has_traffic_filtering=True,id=a002e821-ea54-4d5c-b25c-8c517fab4e92,network=Network(f9b1d398-27cb-42de-9d95-0e031b1bd6ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa002e821-ea') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:25:05 user nova-compute[71229]: DEBUG os_vif [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:8a:71,bridge_name='br-int',has_traffic_filtering=True,id=a002e821-ea54-4d5c-b25c-8c517fab4e92,network=Network(f9b1d398-27cb-42de-9d95-0e031b1bd6ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa002e821-ea') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:25:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:25:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:25:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa002e821-ea, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:25:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa002e821-ea, col_values=(('external_ids', {'iface-id': 'a002e821-ea54-4d5c-b25c-8c517fab4e92', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:8a:71', 'vm-uuid': 'e4555892-7abb-4a3c-a4ae-a27ad4902708'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:25:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:25:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:05 user nova-compute[71229]: INFO os_vif [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:8a:71,bridge_name='br-int',has_traffic_filtering=True,id=a002e821-ea54-4d5c-b25c-8c517fab4e92,network=Network(f9b1d398-27cb-42de-9d95-0e031b1bd6ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa002e821-ea')
Apr 11 15:25:05 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:25:05 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] No VIF found with MAC fa:16:3e:49:8a:71, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:25:05 user nova-compute[71229]: DEBUG nova.network.neutron [req-0e6d7747-9945-43ba-8082-59101f298d69 req-360caa9a-ad01-46fe-bd1f-9b8641924423 service nova] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Updated VIF entry in instance network info cache for port a002e821-ea54-4d5c-b25c-8c517fab4e92. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:25:05 user nova-compute[71229]: DEBUG nova.network.neutron [req-0e6d7747-9945-43ba-8082-59101f298d69 req-360caa9a-ad01-46fe-bd1f-9b8641924423 service nova] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Updating instance_info_cache with network_info: [{"id": "a002e821-ea54-4d5c-b25c-8c517fab4e92", "address": "fa:16:3e:49:8a:71", "network": {"id": "f9b1d398-27cb-42de-9d95-0e031b1bd6ec", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1833751152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "561130d089c8415297697bcedc93aefc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa002e821-ea", "ovs_interfaceid": "a002e821-ea54-4d5c-b25c-8c517fab4e92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:25:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-0e6d7747-9945-43ba-8082-59101f298d69 req-360caa9a-ad01-46fe-bd1f-9b8641924423 service nova] Releasing lock "refresh_cache-e4555892-7abb-4a3c-a4ae-a27ad4902708" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:25:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:06 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Creating instance directory {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 15:25:06 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Creating image(s)
Apr 11 15:25:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "/opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:25:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "/opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:25:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "/opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:25:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:25:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.146s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:25:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:25:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:25:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:25:06 user nova-compute[71229]: DEBUG nova.compute.manager [req-42e1a2ff-fb78-415f-bed3-1b4959100f80 req-49377000-ef0f-4d5e-ae0c-622995bc9265 service nova] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Received event network-vif-plugged-a002e821-ea54-4d5c-b25c-8c517fab4e92 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:25:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-42e1a2ff-fb78-415f-bed3-1b4959100f80 req-49377000-ef0f-4d5e-ae0c-622995bc9265 service nova] Acquiring lock "e4555892-7abb-4a3c-a4ae-a27ad4902708-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:25:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-42e1a2ff-fb78-415f-bed3-1b4959100f80 req-49377000-ef0f-4d5e-ae0c-622995bc9265 service nova] Lock "e4555892-7abb-4a3c-a4ae-a27ad4902708-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:25:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-42e1a2ff-fb78-415f-bed3-1b4959100f80 req-49377000-ef0f-4d5e-ae0c-622995bc9265 service nova] Lock "e4555892-7abb-4a3c-a4ae-a27ad4902708-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:25:06 user nova-compute[71229]: DEBUG nova.compute.manager [req-42e1a2ff-fb78-415f-bed3-1b4959100f80 req-49377000-ef0f-4d5e-ae0c-622995bc9265 service nova] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] No waiting events found dispatching network-vif-plugged-a002e821-ea54-4d5c-b25c-8c517fab4e92 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:25:06 user nova-compute[71229]: WARNING nova.compute.manager [req-42e1a2ff-fb78-415f-bed3-1b4959100f80 req-49377000-ef0f-4d5e-ae0c-622995bc9265 service nova] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Received unexpected event network-vif-plugged-a002e821-ea54-4d5c-b25c-8c517fab4e92 for instance with vm_state building and task_state spawning.
Apr 11 15:25:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.154s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:25:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk 1073741824 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:25:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk 1073741824" returned: 0 in 0.052s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:25:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:25:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.131s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk. size=1073741824 {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Cannot resize image /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk to a smaller size. {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Created local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Ensure instance console log exists: /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Start _get_guest_xml network_info=[{"id": "d8c64197-b034-4f38-821d-ba030f1fca6b", "address": "fa:16:3e:0f:f8:cb", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c64197-b0", "ovs_interfaceid": "d8c64197-b034-4f38-821d-ba030f1fca6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '52fe638c-5ada-47d5-b376-233bfa808a37'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'blCPNQzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6a805345-374c-4326-9e8f-39bfc7947a35', 'attached_at': '', 'detached_at': '', 'volume_id': 'cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4', 'serial': 'cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4'}, 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'fc9f2e36-3c99-4786-ac24-a646f4e0b091', 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:25:07 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 11 15:25:07 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 11 15:25:07 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG nova.objects.instance [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6a805345-374c-4326-9e8f-39bfc7947a35 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'blCPNQzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:25:07 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 11 15:25:07 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:25:07 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 11 15:25:07 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:25:07 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 15:25:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e3d6d6-09f3-49d1-a74b-db977cf3f512]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 15:25:07 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 -p 172.16.0.220:3260 --interface default --op new {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4497c732-1dab-49b7-9bf4-f464bac80db4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4] added\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4] added
Apr 11 15:25:07 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfef8ae-4d1b-44c3-b0fa-f4d0400fc65f]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a054fbb2-7436-4df9-9159-4bd82c6b47fa]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v blCPNQzx {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v blCPNQzx" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6952c6-fc82-4abd-91c7-0625524b98ae]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'blCPNQzx'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb6f1f0-0be5-4b9f-8ff2-e7897f177371]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[42904595-090a-4d6e-b3a7-5fe1e7c828c6]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:25:07 user nova-compute[71229]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)
Apr 11 15:25:07 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:25:07 user nova-compute[71229]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)
Apr 11 15:25:07 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 -p 172.16.0.220:3260 --login {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[53056d0e-57a1-40f8-9aed-41523b2bb57f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4, portal: 172.16.0.220,3260]
Apr 11 15:25:07 user nova-compute[71229]: Login to [iface: default, target: iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4, portal: 172.16.0.220,3260] successful.
Apr 11 15:25:07 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[471ceee0-fd7f-4814-830c-362c3b6179a2]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea8ad93-5c2f-4142-8773-2371d0feb7e7]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:25:07 user nova-compute[71229]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)
Apr 11 15:25:07 user nova-compute[71229]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 (non-flash)
Apr 11 15:25:07 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:25:07 user nova-compute[71229]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)
Apr 11 15:25:07 user nova-compute[71229]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 (non-flash)
Apr 11 15:25:07 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] HCTL ('35', '-', '-', 0) found on session 15 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d12fc6-4405-43a7-ac34-5c6c1ee5a8c5]: (4, ('- - 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:25:07 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'blCPNQzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 15:25:08 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681226708.5544262, e4555892-7abb-4a3c-a4ae-a27ad4902708 => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:25:08 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] VM Resumed (Lifecycle Event)
Apr 11 15:25:08 user nova-compute[71229]: DEBUG nova.compute.manager [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 15:25:08 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Guest created on hypervisor {{(pid=71229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 15:25:08 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Instance spawned successfully.
Apr 11 15:25:08 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 15:25:08 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:25:08 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '26234353637313333', 'path': '/dev/sdd'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:25:08 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234353637313333', 'path': '/dev/sdd'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 15:25:08 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:25:08 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:25:08 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Found default for hw_cdrom_bus of ide {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:25:08 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Found default for hw_disk_bus of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:25:08 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Found default for hw_input_bus of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:25:08 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Found default for hw_pointer_model of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:25:08 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Found default for hw_video_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:25:08 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Found default for hw_vif_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:25:08 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T15:21:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1386574519',display_name='tempest-ServerActionsTestJSON-server-252985182',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1386574519',id=3,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfAJGQ+GOa8zW+jlKgD9Kz6/k6iEv9pZIOIjICzcstJ92AAS94+47mc3fRsqyx5FaTMV9P4lTsW4Fy7tKIAtMpRx0Sl7sa6ttQnPbPhlcYqfbdWbTqmmKi6+BuZpqSknA==',key_name='tempest-keypair-1137963694',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:21:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bb7660e8f76b471487136806ee9eec62',ramdisk_id='',reservation_id='r-hmn5p3xn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1659503440',owner_user_name='tempest-ServerActionsTestJSON-1659503440-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:25:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10720df0ac4f4e62a0a5c9883d600add',uuid=6a805345-374c-4326-9e8f-39bfc7947a35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8c64197-b034-4f38-821d-ba030f1fca6b", "address": "fa:16:3e:0f:f8:cb", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c64197-b0", "ovs_interfaceid": "d8c64197-b034-4f38-821d-ba030f1fca6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:25:08 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Converting VIF {"id": "d8c64197-b034-4f38-821d-ba030f1fca6b", "address": "fa:16:3e:0f:f8:cb", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c64197-b0", "ovs_interfaceid": "d8c64197-b034-4f38-821d-ba030f1fca6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:25:08 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:f8:cb,bridge_name='br-int',has_traffic_filtering=True,id=d8c64197-b034-4f38-821d-ba030f1fca6b,network=Network(1bd215e8-0459-4dd2-893b-096b6e31ac08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c64197-b0') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:25:08 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:25:08 user nova-compute[71229]:   <uuid>6a805345-374c-4326-9e8f-39bfc7947a35</uuid>
Apr 11 15:25:08 user nova-compute[71229]:   <name>instance-00000003</name>
Apr 11 15:25:08 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:25:08 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:25:08 user nova-compute[71229]:   <metadata>
Apr 11 15:25:08 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:25:08 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:25:08 user nova-compute[71229]:       <nova:name>tempest-ServerActionsTestJSON-server-252985182</nova:name>
Apr 11 15:25:08 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:25:07</nova:creationTime>
Apr 11 15:25:08 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:25:08 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:25:08 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:25:08 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:25:08 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:25:08 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:25:08 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:25:08 user nova-compute[71229]:       <nova:owner>
Apr 11 15:25:08 user nova-compute[71229]:         <nova:user uuid="10720df0ac4f4e62a0a5c9883d600add">tempest-ServerActionsTestJSON-1659503440-project-member</nova:user>
Apr 11 15:25:08 user nova-compute[71229]:         <nova:project uuid="bb7660e8f76b471487136806ee9eec62">tempest-ServerActionsTestJSON-1659503440</nova:project>
Apr 11 15:25:08 user nova-compute[71229]:       </nova:owner>
Apr 11 15:25:08 user nova-compute[71229]:       <nova:root type="image" uuid="52fe638c-5ada-47d5-b376-233bfa808a37"/>
Apr 11 15:25:08 user nova-compute[71229]:       <nova:ports>
Apr 11 15:25:08 user nova-compute[71229]:         <nova:port uuid="d8c64197-b034-4f38-821d-ba030f1fca6b">
Apr 11 15:25:08 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 11 15:25:08 user nova-compute[71229]:         </nova:port>
Apr 11 15:25:08 user nova-compute[71229]:       </nova:ports>
Apr 11 15:25:08 user nova-compute[71229]:     </nova:instance>
Apr 11 15:25:08 user nova-compute[71229]:   </metadata>
Apr 11 15:25:08 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:25:08 user nova-compute[71229]:     <system>
Apr 11 15:25:08 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:25:08 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:25:08 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:25:08 user nova-compute[71229]:       <entry name="serial">6a805345-374c-4326-9e8f-39bfc7947a35</entry>
Apr 11 15:25:08 user nova-compute[71229]:       <entry name="uuid">6a805345-374c-4326-9e8f-39bfc7947a35</entry>
Apr 11 15:25:08 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:25:08 user nova-compute[71229]:     </system>
Apr 11 15:25:08 user nova-compute[71229]:   </sysinfo>
Apr 11 15:25:08 user nova-compute[71229]:   <os>
Apr 11 15:25:08 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:25:08 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 15:25:08 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:25:08 user nova-compute[71229]:   </os>
Apr 11 15:25:08 user nova-compute[71229]:   <features>
Apr 11 15:25:08 user nova-compute[71229]:     <acpi/>
Apr 11 15:25:08 user nova-compute[71229]:     <apic/>
Apr 11 15:25:08 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:25:08 user nova-compute[71229]:   </features>
Apr 11 15:25:08 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:25:08 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:25:08 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:25:08 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:25:08 user nova-compute[71229]:   </clock>
Apr 11 15:25:08 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:25:08 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:25:08 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:25:08 user nova-compute[71229]:   </cpu>
Apr 11 15:25:08 user nova-compute[71229]:   <devices>
Apr 11 15:25:08 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 15:25:08 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 15:25:08 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk"/>
Apr 11 15:25:08 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:25:08 user nova-compute[71229]:     </disk>
Apr 11 15:25:08 user nova-compute[71229]:     <disk type="block" device="disk">
Apr 11 15:25:08 user nova-compute[71229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:25:08 user nova-compute[71229]:       <source dev="/dev/sdd"/>
Apr 11 15:25:08 user nova-compute[71229]:       <target dev="vdb" bus="virtio"/>
Apr 11 15:25:08 user nova-compute[71229]:       <serial>cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4</serial>
Apr 11 15:25:08 user nova-compute[71229]:     </disk>
Apr 11 15:25:08 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:25:08 user nova-compute[71229]:       <mac address="fa:16:3e:0f:f8:cb"/>
Apr 11 15:25:08 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:25:08 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:25:08 user nova-compute[71229]:       <target dev="tapd8c64197-b0"/>
Apr 11 15:25:08 user nova-compute[71229]:     </interface>
Apr 11 15:25:08 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:25:08 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/console.log" append="off"/>
Apr 11 15:25:08 user nova-compute[71229]:     </serial>
Apr 11 15:25:08 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:25:08 user nova-compute[71229]:     <video>
Apr 11 15:25:08 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:25:08 user nova-compute[71229]:     </video>
Apr 11 15:25:08 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:25:08 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:25:08 user nova-compute[71229]:     </rng>
Apr 11 15:25:08 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:25:08 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:25:08 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:25:08 user nova-compute[71229]:     </memballoon>
Apr 11 15:25:08 user nova-compute[71229]:   </devices>
Apr 11 15:25:08 user nova-compute[71229]: </domain>
Apr 11 15:25:08 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:25:08 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T15:21:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1386574519',display_name='tempest-ServerActionsTestJSON-server-252985182',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1386574519',id=3,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfAJGQ+GOa8zW+jlKgD9Kz6/k6iEv9pZIOIjICzcstJ92AAS94+47mc3fRsqyx5FaTMV9P4lTsW4Fy7tKIAtMpRx0Sl7sa6ttQnPbPhlcYqfbdWbTqmmKi6+BuZpqSknA==',key_name='tempest-keypair-1137963694',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:21:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bb7660e8f76b471487136806ee9eec62',ramdisk_id='',reservation_id='r-hmn5p3xn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1659503440',owner_user_name='tempest-ServerActionsTestJSON-1659503440-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:25:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10720df0ac4f4e62a0a5c9883d600add',uuid=6a805345-374c-4326-9e8f-39bfc7947a35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8c64197-b034-4f38-821d-ba030f1fca6b", "address": "fa:16:3e:0f:f8:cb", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c64197-b0", "ovs_interfaceid": "d8c64197-b034-4f38-821d-ba030f1fca6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:25:08 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Converting VIF {"id": "d8c64197-b034-4f38-821d-ba030f1fca6b", "address": "fa:16:3e:0f:f8:cb", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c64197-b0", "ovs_interfaceid": "d8c64197-b034-4f38-821d-ba030f1fca6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:25:08 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:f8:cb,bridge_name='br-int',has_traffic_filtering=True,id=d8c64197-b034-4f38-821d-ba030f1fca6b,network=Network(1bd215e8-0459-4dd2-893b-096b6e31ac08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c64197-b0') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:25:08 user nova-compute[71229]: DEBUG os_vif [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:f8:cb,bridge_name='br-int',has_traffic_filtering=True,id=d8c64197-b034-4f38-821d-ba030f1fca6b,network=Network(1bd215e8-0459-4dd2-893b-096b6e31ac08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c64197-b0') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:25:08 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:08 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:25:08 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:25:08 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:25:08 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681226708.5655773, e4555892-7abb-4a3c-a4ae-a27ad4902708 => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:25:08 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] VM Started (Lifecycle Event)
Apr 11 15:25:08 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:08 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd8c64197-b0, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:25:08 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd8c64197-b0, col_values=(('external_ids', {'iface-id': 'd8c64197-b034-4f38-821d-ba030f1fca6b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:f8:cb', 'vm-uuid': '6a805345-374c-4326-9e8f-39bfc7947a35'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:25:08 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:25:08 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:08 user nova-compute[71229]: INFO os_vif [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:f8:cb,bridge_name='br-int',has_traffic_filtering=True,id=d8c64197-b034-4f38-821d-ba030f1fca6b,network=Network(1bd215e8-0459-4dd2-893b-096b6e31ac08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c64197-b0')
Apr 11 15:25:08 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:25:08 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:25:08 user nova-compute[71229]: INFO nova.compute.manager [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Took 6.09 seconds to spawn the instance on the hypervisor.
Apr 11 15:25:08 user nova-compute[71229]: DEBUG nova.compute.manager [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:25:08 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:25:08 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:25:08 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:25:08 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] No VIF found with MAC fa:16:3e:0f:f8:cb, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:25:08 user nova-compute[71229]: INFO nova.compute.manager [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Took 6.93 seconds to build instance.
Apr 11 15:25:08 user nova-compute[71229]: DEBUG nova.compute.manager [req-59af60b4-e397-4a06-b9f3-209b1be1ecf2 req-ec1d359b-3845-4abf-98c3-853f7bcc3ed0 service nova] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Received event network-vif-plugged-a002e821-ea54-4d5c-b25c-8c517fab4e92 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:25:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-59af60b4-e397-4a06-b9f3-209b1be1ecf2 req-ec1d359b-3845-4abf-98c3-853f7bcc3ed0 service nova] Acquiring lock "e4555892-7abb-4a3c-a4ae-a27ad4902708-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:25:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-59af60b4-e397-4a06-b9f3-209b1be1ecf2 req-ec1d359b-3845-4abf-98c3-853f7bcc3ed0 service nova] Lock "e4555892-7abb-4a3c-a4ae-a27ad4902708-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:25:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-59af60b4-e397-4a06-b9f3-209b1be1ecf2 req-ec1d359b-3845-4abf-98c3-853f7bcc3ed0 service nova] Lock "e4555892-7abb-4a3c-a4ae-a27ad4902708-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:25:08 user nova-compute[71229]: DEBUG nova.compute.manager [req-59af60b4-e397-4a06-b9f3-209b1be1ecf2 req-ec1d359b-3845-4abf-98c3-853f7bcc3ed0 service nova] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] No waiting events found dispatching network-vif-plugged-a002e821-ea54-4d5c-b25c-8c517fab4e92 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:25:08 user nova-compute[71229]: WARNING nova.compute.manager [req-59af60b4-e397-4a06-b9f3-209b1be1ecf2 req-ec1d359b-3845-4abf-98c3-853f7bcc3ed0 service nova] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Received unexpected event network-vif-plugged-a002e821-ea54-4d5c-b25c-8c517fab4e92 for instance with vm_state active and task_state None.
Apr 11 15:25:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3e482daf-86ce-4c17-add4-dccfb5fe3ed5 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "e4555892-7abb-4a3c-a4ae-a27ad4902708" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.045s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:25:09 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:10 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:10 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:10 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:10 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:10 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:10 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:10 user nova-compute[71229]: DEBUG nova.compute.manager [req-91a52fc6-a8bc-401a-9090-977133b366df req-6c08000f-2271-44ee-a594-4c3ef6943244 service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Received event network-vif-plugged-d8c64197-b034-4f38-821d-ba030f1fca6b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:25:10 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-91a52fc6-a8bc-401a-9090-977133b366df req-6c08000f-2271-44ee-a594-4c3ef6943244 service nova] Acquiring lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:25:10 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-91a52fc6-a8bc-401a-9090-977133b366df req-6c08000f-2271-44ee-a594-4c3ef6943244 service nova] Lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:25:10 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-91a52fc6-a8bc-401a-9090-977133b366df req-6c08000f-2271-44ee-a594-4c3ef6943244 service nova] Lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:25:10 user nova-compute[71229]: DEBUG nova.compute.manager [req-91a52fc6-a8bc-401a-9090-977133b366df req-6c08000f-2271-44ee-a594-4c3ef6943244 service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] No waiting events found dispatching network-vif-plugged-d8c64197-b034-4f38-821d-ba030f1fca6b {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:25:10 user nova-compute[71229]: WARNING nova.compute.manager [req-91a52fc6-a8bc-401a-9090-977133b366df req-6c08000f-2271-44ee-a594-4c3ef6943244 service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Received unexpected event network-vif-plugged-d8c64197-b034-4f38-821d-ba030f1fca6b for instance with vm_state active and task_state rebuild_spawning.
Apr 11 15:25:10 user nova-compute[71229]: DEBUG nova.compute.manager [req-91a52fc6-a8bc-401a-9090-977133b366df req-6c08000f-2271-44ee-a594-4c3ef6943244 service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Received event network-vif-plugged-d8c64197-b034-4f38-821d-ba030f1fca6b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:25:10 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-91a52fc6-a8bc-401a-9090-977133b366df req-6c08000f-2271-44ee-a594-4c3ef6943244 service nova] Acquiring lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:25:10 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-91a52fc6-a8bc-401a-9090-977133b366df req-6c08000f-2271-44ee-a594-4c3ef6943244 service nova] Lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:25:10 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-91a52fc6-a8bc-401a-9090-977133b366df req-6c08000f-2271-44ee-a594-4c3ef6943244 service nova] Lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:25:10 user nova-compute[71229]: DEBUG nova.compute.manager [req-91a52fc6-a8bc-401a-9090-977133b366df req-6c08000f-2271-44ee-a594-4c3ef6943244 service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] No waiting events found dispatching network-vif-plugged-d8c64197-b034-4f38-821d-ba030f1fca6b {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:25:10 user nova-compute[71229]: WARNING nova.compute.manager [req-91a52fc6-a8bc-401a-9090-977133b366df req-6c08000f-2271-44ee-a594-4c3ef6943244 service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Received unexpected event network-vif-plugged-d8c64197-b034-4f38-821d-ba030f1fca6b for instance with vm_state active and task_state rebuild_spawning.
Apr 11 15:25:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:12 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Removed pending event for 6a805345-374c-4326-9e8f-39bfc7947a35 due to event {{(pid=71229) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 15:25:12 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681226712.23303, 6a805345-374c-4326-9e8f-39bfc7947a35 => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:25:12 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] VM Resumed (Lifecycle Event)
Apr 11 15:25:12 user nova-compute[71229]: DEBUG nova.compute.manager [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 15:25:12 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Guest created on hypervisor {{(pid=71229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 15:25:12 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Instance spawned successfully.
Apr 11 15:25:12 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 15:25:12 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:25:12 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:25:12 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Found default for hw_cdrom_bus of ide {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:25:12 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Found default for hw_disk_bus of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:25:12 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Found default for hw_input_bus of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:25:12 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Found default for hw_pointer_model of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:25:12 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Found default for hw_video_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:25:12 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Found default for hw_vif_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:25:12 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 11 15:25:12 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681226712.2467625, 6a805345-374c-4326-9e8f-39bfc7947a35 => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:25:12 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] VM Started (Lifecycle Event)
Apr 11 15:25:12 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:25:12 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:25:12 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 11 15:25:12 user nova-compute[71229]: DEBUG nova.compute.manager [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:25:12 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:25:12 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:25:12 user nova-compute[71229]: DEBUG nova.objects.instance [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71229) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 11 15:25:12 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-0dc853de-b6da-4913-ab8c-fb88a58a7965 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.068s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:25:13 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:21 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:43 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:44 user nova-compute[71229]: INFO nova.compute.manager [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Rescuing
Apr 11 15:25:44 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "refresh_cache-b0d90fd2-6a95-43c4-8756-e82071d99154" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:25:44 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquired lock "refresh_cache-b0d90fd2-6a95-43c4-8756-e82071d99154" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:25:44 user nova-compute[71229]: DEBUG nova.network.neutron [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:25:45 user nova-compute[71229]: DEBUG nova.network.neutron [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Updating instance_info_cache with network_info: [{"id": "4718fa68-0eb9-4592-8c43-981438e3d0b8", "address": "fa:16:3e:e4:28:3b", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4718fa68-0e", "ovs_interfaceid": "4718fa68-0eb9-4592-8c43-981438e3d0b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:25:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Releasing lock "refresh_cache-b0d90fd2-6a95-43c4-8756-e82071d99154" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:25:45 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:45 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:45 user nova-compute[71229]: DEBUG nova.compute.manager [req-09284262-d181-42be-af35-78b725901628 req-b8575077-9697-4bc2-9728-91a0f5f2f187 service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Received event network-vif-unplugged-4718fa68-0eb9-4592-8c43-981438e3d0b8 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:25:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-09284262-d181-42be-af35-78b725901628 req-b8575077-9697-4bc2-9728-91a0f5f2f187 service nova] Acquiring lock "b0d90fd2-6a95-43c4-8756-e82071d99154-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:25:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-09284262-d181-42be-af35-78b725901628 req-b8575077-9697-4bc2-9728-91a0f5f2f187 service nova] Lock "b0d90fd2-6a95-43c4-8756-e82071d99154-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:25:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-09284262-d181-42be-af35-78b725901628 req-b8575077-9697-4bc2-9728-91a0f5f2f187 service nova] Lock "b0d90fd2-6a95-43c4-8756-e82071d99154-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:25:45 user nova-compute[71229]: DEBUG nova.compute.manager [req-09284262-d181-42be-af35-78b725901628 req-b8575077-9697-4bc2-9728-91a0f5f2f187 service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] No waiting events found dispatching network-vif-unplugged-4718fa68-0eb9-4592-8c43-981438e3d0b8 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:25:45 user nova-compute[71229]: WARNING nova.compute.manager [req-09284262-d181-42be-af35-78b725901628 req-b8575077-9697-4bc2-9728-91a0f5f2f187 service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Received unexpected event network-vif-unplugged-4718fa68-0eb9-4592-8c43-981438e3d0b8 for instance with vm_state active and task_state rescuing.
Apr 11 15:25:45 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:45 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:46 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Instance destroyed successfully.
Apr 11 15:25:46 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Attempting a stable device rescue
Apr 11 15:25:46 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71229) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 11 15:25:46 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Instance directory exists: not creating {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 15:25:46 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Creating image(s)
Apr 11 15:25:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "/opt/stack/data/nova/instances/b0d90fd2-6a95-43c4-8756-e82071d99154/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:25:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "/opt/stack/data/nova/instances/b0d90fd2-6a95-43c4-8756-e82071d99154/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:25:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "/opt/stack/data/nova/instances/b0d90fd2-6a95-43c4-8756-e82071d99154/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:25:46 user nova-compute[71229]: DEBUG nova.objects.instance [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lazy-loading 'trusted_certs' on Instance uuid b0d90fd2-6a95-43c4-8756-e82071d99154 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:25:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "0c22094c568ddb27dfdc0a5b565aa24ac8771928" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:25:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "0c22094c568ddb27dfdc0a5b565aa24ac8771928" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:25:46 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0c22094c568ddb27dfdc0a5b565aa24ac8771928.part --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:25:46 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0c22094c568ddb27dfdc0a5b565aa24ac8771928.part --force-share --output=json" returned: 0 in 0.152s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:25:46 user nova-compute[71229]: DEBUG nova.virt.images [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] eded9003-50e7-486b-bac5-dfc18b519c48 was qcow2, converting to raw {{(pid=71229) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 15:25:46 user nova-compute[71229]: DEBUG nova.privsep.utils [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71229) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 15:25:46 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0c22094c568ddb27dfdc0a5b565aa24ac8771928.part /opt/stack/data/nova/instances/_base/0c22094c568ddb27dfdc0a5b565aa24ac8771928.converted {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0c22094c568ddb27dfdc0a5b565aa24ac8771928.part /opt/stack/data/nova/instances/_base/0c22094c568ddb27dfdc0a5b565aa24ac8771928.converted" returned: 0 in 0.162s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0c22094c568ddb27dfdc0a5b565aa24ac8771928.converted --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0c22094c568ddb27dfdc0a5b565aa24ac8771928.converted --force-share --output=json" returned: 0 in 0.166s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "0c22094c568ddb27dfdc0a5b565aa24ac8771928" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.156s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "0c22094c568ddb27dfdc0a5b565aa24ac8771928" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "0c22094c568ddb27dfdc0a5b565aa24ac8771928" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0c22094c568ddb27dfdc0a5b565aa24ac8771928 --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0c22094c568ddb27dfdc0a5b565aa24ac8771928 --force-share --output=json" returned: 0 in 0.148s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0c22094c568ddb27dfdc0a5b565aa24ac8771928,backing_fmt=raw /opt/stack/data/nova/instances/b0d90fd2-6a95-43c4-8756-e82071d99154/disk.rescue {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0c22094c568ddb27dfdc0a5b565aa24ac8771928,backing_fmt=raw /opt/stack/data/nova/instances/b0d90fd2-6a95-43c4-8756-e82071d99154/disk.rescue" returned: 0 in 0.050s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "0c22094c568ddb27dfdc0a5b565aa24ac8771928" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG nova.objects.instance [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lazy-loading 'migration_context' on Instance uuid b0d90fd2-6a95-43c4-8756-e82071d99154 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Created local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Start _get_guest_xml network_info=[{"id": "4718fa68-0eb9-4592-8c43-981438e3d0b8", "address": "fa:16:3e:e4:28:3b", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "vif_mac": "fa:16:3e:e4:28:3b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4718fa68-0e", "ovs_interfaceid": "4718fa68-0eb9-4592-8c43-981438e3d0b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'eded9003-50e7-486b-bac5-dfc18b519c48', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QxVsBWUp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'b0d90fd2-6a95-43c4-8756-e82071d99154', 'attached_at': '', 'detached_at': '', 'volume_id': '65c1d870-4696-4892-9abe-b305824a04eb', 'serial': '65c1d870-4696-4892-9abe-b305824a04eb'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'bf049eeb-6a44-4515-bd14-2291e1eb4280', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG nova.objects.instance [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lazy-loading 'resources' on Instance uuid b0d90fd2-6a95-43c4-8756-e82071d99154 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG nova.objects.instance [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lazy-loading 'numa_topology' on Instance uuid b0d90fd2-6a95-43c4-8756-e82071d99154 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:25:47 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:25:47 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:25:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG nova.objects.instance [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lazy-loading 'vcpu_model' on Instance uuid b0d90fd2-6a95-43c4-8756-e82071d99154 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QxVsBWUp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:25:47 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:25:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:25:47 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:25:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:25:47 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 15:25:47 user nova-compute[71229]: DEBUG nova.compute.manager [req-4b4f0e8d-455a-472e-a369-921585634854 req-7b716320-6449-4360-b5b6-c43f52f9f370 service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Received event network-vif-plugged-4718fa68-0eb9-4592-8c43-981438e3d0b8 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4b4f0e8d-455a-472e-a369-921585634854 req-7b716320-6449-4360-b5b6-c43f52f9f370 service nova] Acquiring lock "b0d90fd2-6a95-43c4-8756-e82071d99154-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4b4f0e8d-455a-472e-a369-921585634854 req-7b716320-6449-4360-b5b6-c43f52f9f370 service nova] Lock "b0d90fd2-6a95-43c4-8756-e82071d99154-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4b4f0e8d-455a-472e-a369-921585634854 req-7b716320-6449-4360-b5b6-c43f52f9f370 service nova] Lock "b0d90fd2-6a95-43c4-8756-e82071d99154-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG nova.compute.manager [req-4b4f0e8d-455a-472e-a369-921585634854 req-7b716320-6449-4360-b5b6-c43f52f9f370 service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] No waiting events found dispatching network-vif-plugged-4718fa68-0eb9-4592-8c43-981438e3d0b8 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:25:47 user nova-compute[71229]: WARNING nova.compute.manager [req-4b4f0e8d-455a-472e-a369-921585634854 req-7b716320-6449-4360-b5b6-c43f52f9f370 service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Received unexpected event network-vif-plugged-4718fa68-0eb9-4592-8c43-981438e3d0b8 for instance with vm_state active and task_state rescuing.
Apr 11 15:25:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b77f653-9b1c-4539-8b04-4dfd92bbdf0c]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = QxVsBWUp\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 11 15:25:47 user nova-compute[71229]: node.name = iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb
Apr 11 15:25:47 user nova-compute[71229]: node.tpgt = -1
Apr 11 15:25:47 user nova-compute[71229]: node.startup = automatic
Apr 11 15:25:47 user nova-compute[71229]: node.leading_login = No
Apr 11 15:25:47 user nova-compute[71229]: iface.iscsi_ifacename = default
Apr 11 15:25:47 user nova-compute[71229]: iface.net_ifacename = <empty>
Apr 11 15:25:47 user nova-compute[71229]: iface.ipaddress = <empty>
Apr 11 15:25:47 user nova-compute[71229]: iface.prefix_len = 0
Apr 11 15:25:47 user nova-compute[71229]: iface.hwaddress = <empty>
Apr 11 15:25:47 user nova-compute[71229]: iface.transport_name = tcp
Apr 11 15:25:47 user nova-compute[71229]: iface.initiatorname = <empty>
Apr 11 15:25:47 user nova-compute[71229]: iface.state = <empty>
Apr 11 15:25:47 user nova-compute[71229]: iface.vlan_id = 0
Apr 11 15:25:47 user nova-compute[71229]: iface.vlan_priority = 0
Apr 11 15:25:47 user nova-compute[71229]: iface.vlan_state = <empty>
Apr 11 15:25:47 user nova-compute[71229]: iface.iface_num = 0
Apr 11 15:25:47 user nova-compute[71229]: iface.mtu = 0
Apr 11 15:25:47 user nova-compute[71229]: iface.port = 0
Apr 11 15:25:47 user nova-compute[71229]: iface.bootproto = <empty>
Apr 11 15:25:47 user nova-compute[71229]: iface.subnet_mask = <empty>
Apr 11 15:25:47 user nova-compute[71229]: iface.gateway = <empty>
Apr 11 15:25:47 user nova-compute[71229]: iface.dhcp_alt_client_id_state = <empty>
Apr 11 15:25:47 user nova-compute[71229]: iface.dhcp_alt_client_id = <empty>
Apr 11 15:25:47 user nova-compute[71229]: iface.dhcp_dns = <empty>
Apr 11 15:25:47 user nova-compute[71229]: iface.dhcp_learn_iqn = <empty>
Apr 11 15:25:47 user nova-compute[71229]: iface.dhcp_req_vendor_id_state = <empty>
Apr 11 15:25:47 user nova-compute[71229]: iface.dhcp_vendor_id_state = <empty>
Apr 11 15:25:47 user nova-compute[71229]: iface.dhcp_vendor_id = <empty>
Apr 11 15:25:47 user nova-compute[71229]: iface.dhcp_slp_da = <empty>
Apr 11 15:25:47 user nova-compute[71229]: iface.fragmentation = <empty>
Apr 11 15:25:47 user nova-compute[71229]: iface.gratuitous_arp = <empty>
Apr 11 15:25:47 user nova-compute[71229]: iface.incoming_forwarding = <empty>
Apr 11 15:25:47 user nova-compute[71229]: iface.tos_state = <empty>
Apr 11 15:25:47 user nova-compute[71229]: iface.tos = 0
Apr 11 15:25:47 user nova-compute[71229]: iface.ttl = 0
Apr 11 15:25:47 user nova-compute[71229]: iface.delayed_ack = <empty>
Apr 11 15:25:47 user nova-compute[71229]: iface.tcp_nagle = <empty>
Apr 11 15:25:47 user nova-compute[71229]: iface.tcp_wsf_state = <empty>
Apr 11 15:25:47 user nova-compute[71229]: iface.tcp_wsf = 0
Apr 11 15:25:47 user nova-compute[71229]: iface.tcp_timer_scale = 0
Apr 11 15:25:47 user nova-compute[71229]: iface.tcp_timestamp = <empty>
Apr 11 15:25:47 user nova-compute[71229]: iface.redirect = <empty>
Apr 11 15:25:47 user nova-compute[71229]: iface.def_task_mgmt_timeout = 0
Apr 11 15:25:47 user nova-compute[71229]: iface.header_digest = <empty>
Apr 11 15:25:47 user nova-compute[71229]: iface.data_digest = <empty>
Apr 11 15:25:47 user nova-compute[71229]: iface.immediate_data = <empty>
Apr 11 15:25:47 user nova-compute[71229]: iface.initial_r2t = <empty>
Apr 11 15:25:47 user nova-compute[71229]: iface.data_seq_inorder = <empty>
Apr 11 15:25:47 user nova-compute[71229]: iface.data_pdu_inorder = <empty>
Apr 11 15:25:47 user nova-compute[71229]: iface.erl = 0
Apr 11 15:25:47 user nova-compute[71229]: iface.max_receive_data_len = 0
Apr 11 15:25:47 user nova-compute[71229]: iface.first_burst_len = 0
Apr 11 15:25:47 user nova-compute[71229]: iface.max_outstanding_r2t = 0
Apr 11 15:25:47 user nova-compute[71229]: iface.max_burst_len = 0
Apr 11 15:25:47 user nova-compute[71229]: iface.chap_auth = <empty>
Apr 11 15:25:47 user nova-compute[71229]: iface.bidi_chap = <empty>
Apr 11 15:25:47 user nova-compute[71229]: iface.strict_login_compliance = <empty>
Apr 11 15:25:47 user nova-compute[71229]: iface.discovery_auth = <empty>
Apr 11 15:25:47 user nova-compute[71229]: iface.discovery_logout = <empty>
Apr 11 15:25:47 user nova-compute[71229]: node.discovery_address = <empty>
Apr 11 15:25:47 user nova-compute[71229]: node.discovery_port = 0
Apr 11 15:25:47 user nova-compute[71229]: node.discovery_type = static
Apr 11 15:25:47 user nova-compute[71229]: node.session.initial_cmdsn = 0
Apr 11 15:25:47 user nova-compute[71229]: node.session.initial_login_retry_max = 8
Apr 11 15:25:47 user nova-compute[71229]: node.session.xmit_thread_priority = -20
Apr 11 15:25:47 user nova-compute[71229]: node.session.cmds_max = 128
Apr 11 15:25:47 user nova-compute[71229]: node.session.queue_depth = 32
Apr 11 15:25:47 user nova-compute[71229]: node.session.nr_sessions = 1
Apr 11 15:25:47 user nova-compute[71229]: node.session.auth.authmethod = CHAP
Apr 11 15:25:47 user nova-compute[71229]: node.session.auth.username = QxVsBWUp
Apr 11 15:25:47 user nova-compute[71229]: node.session.auth.password = ***
Apr 11 15:25:47 user nova-compute[71229]: node.session.auth.username_in = <empty>
Apr 11 15:25:47 user nova-compute[71229]: node.session.auth.password_in = <empty>
Apr 11 15:25:47 user nova-compute[71229]: node.session.auth.chap_algs = MD5
Apr 11 15:25:47 user nova-compute[71229]: node.session.timeo.replacement_timeout = 120
Apr 11 15:25:47 user nova-compute[71229]: node.session.err_timeo.abort_timeout = 15
Apr 11 15:25:47 user nova-compute[71229]: node.session.err_timeo.lu_reset_timeout = 30
Apr 11 15:25:47 user nova-compute[71229]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 11 15:25:47 user nova-compute[71229]: node.session.err_timeo.host_reset_timeout = 60
Apr 11 15:25:47 user nova-compute[71229]: node.session.iscsi.FastAbort = Yes
Apr 11 15:25:47 user nova-compute[71229]: node.session.iscsi.InitialR2T = No
Apr 11 15:25:47 user nova-compute[71229]: node.session.iscsi.ImmediateData = Yes
Apr 11 15:25:47 user nova-compute[71229]: node.session.iscsi.FirstBurstLength = 262144
Apr 11 15:25:47 user nova-compute[71229]: node.session.iscsi.MaxBurstLength = 16776192
Apr 11 15:25:47 user nova-compute[71229]: node.session.iscsi.DefaultTime2Retain = 0
Apr 11 15:25:47 user nova-compute[71229]: node.session.iscsi.DefaultTime2Wait = 2
Apr 11 15:25:47 user nova-compute[71229]: node.session.iscsi.MaxConnections = 1
Apr 11 15:25:47 user nova-compute[71229]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 11 15:25:47 user nova-compute[71229]: node.session.iscsi.ERL = 0
Apr 11 15:25:47 user nova-compute[71229]: node.session.scan = manual
Apr 11 15:25:47 user nova-compute[71229]: node.session.reopen_max = 0
Apr 11 15:25:47 user nova-compute[71229]: node.conn[0].address = 172.16.0.220
Apr 11 15:25:47 user nova-compute[71229]: node.conn[0].port = 3260
Apr 11 15:25:47 user nova-compute[71229]: node.conn[0].startup = manual
Apr 11 15:25:47 user nova-compute[71229]: node.conn[0].tcp.window_size = 524288
Apr 11 15:25:47 user nova-compute[71229]: node.conn[0].tcp.type_of_service = 0
Apr 11 15:25:47 user nova-compute[71229]: node.conn[0].timeo.logout_timeout = 15
Apr 11 15:25:47 user nova-compute[71229]: node.conn[0].timeo.login_timeout = 15
Apr 11 15:25:47 user nova-compute[71229]: node.conn[0].timeo.auth_timeout = 45
Apr 11 15:25:47 user nova-compute[71229]: node.conn[0].timeo.noop_out_interval = 5
Apr 11 15:25:47 user nova-compute[71229]: node.conn[0].timeo.noop_out_timeout = 5
Apr 11 15:25:47 user nova-compute[71229]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 11 15:25:47 user nova-compute[71229]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 11 15:25:47 user nova-compute[71229]: node.conn[0].iscsi.HeaderDigest = None
Apr 11 15:25:47 user nova-compute[71229]: node.conn[0].iscsi.DataDigest = None
Apr 11 15:25:47 user nova-compute[71229]: node.conn[0].iscsi.IFMarker = No
Apr 11 15:25:47 user nova-compute[71229]: node.conn[0].iscsi.OFMarker = No
Apr 11 15:25:47 user nova-compute[71229]: # END RECORD
Apr 11 15:25:47 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae15f6f-5fb1-431d-bcee-902a82794c8a]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e7d22c-b0f5-4740-b69c-f166895240bd]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QxVsBWUp {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QxVsBWUp" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d257ea-91fb-4906-acac-823de0b28bd9]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QxVsBWUp'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d52b6bb-2de0-4790-a82a-be75c1b9239d]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd8d7a2-db5f-4c04-9917-38f05b141f74]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:25:47 user nova-compute[71229]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)
Apr 11 15:25:47 user nova-compute[71229]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 (non-flash)
Apr 11 15:25:47 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:25:47 user nova-compute[71229]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)
Apr 11 15:25:47 user nova-compute[71229]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 (non-flash)
Apr 11 15:25:47 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.149s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] HCTL ('33', '0', '0', 0) found on session 12 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8416d20-ce9d-4fb6-a33e-d59df03aadec]: (4, ('0 0 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Searching for a device in session 12 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QxVsBWUp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.172s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] <== connect_volume: return (173ms) {'type': 'block', 'scsi_wwn': '23035613564313763', 'path': '/dev/sdb'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035613564313763', 'path': '/dev/sdb'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:23:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-785051320',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-785051320',id=10,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:24:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ddc05e9bf5ab426982ccb3092ad596e4',ramdisk_id='',reservation_id='r-cxnpum04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1907753459',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:24:11Z,user_data=None,user_id='1d60ce27bfad4d7c9b976e834df35ad4',uuid=b0d90fd2-6a95-43c4-8756-e82071d99154,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4718fa68-0eb9-4592-8c43-981438e3d0b8", "address": "fa:16:3e:e4:28:3b", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "vif_mac": "fa:16:3e:e4:28:3b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4718fa68-0e", "ovs_interfaceid": "4718fa68-0eb9-4592-8c43-981438e3d0b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Converting VIF {"id": "4718fa68-0eb9-4592-8c43-981438e3d0b8", "address": "fa:16:3e:e4:28:3b", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "vif_mac": "fa:16:3e:e4:28:3b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4718fa68-0e", "ovs_interfaceid": "4718fa68-0eb9-4592-8c43-981438e3d0b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:28:3b,bridge_name='br-int',has_traffic_filtering=True,id=4718fa68-0eb9-4592-8c43-981438e3d0b8,network=Network(1cf4cec3-ff08-4320-89e4-aa7e8cf75eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4718fa68-0e') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG nova.objects.instance [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lazy-loading 'pci_devices' on Instance uuid b0d90fd2-6a95-43c4-8756-e82071d99154 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:25:47 user nova-compute[71229]:   <uuid>b0d90fd2-6a95-43c4-8756-e82071d99154</uuid>
Apr 11 15:25:47 user nova-compute[71229]:   <name>instance-0000000a</name>
Apr 11 15:25:47 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:25:47 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:25:47 user nova-compute[71229]:   <metadata>
Apr 11 15:25:47 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:25:47 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:25:47 user nova-compute[71229]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-785051320</nova:name>
Apr 11 15:25:47 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:25:47</nova:creationTime>
Apr 11 15:25:47 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:25:47 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:25:47 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:25:47 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:25:47 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:25:47 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:25:47 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:25:47 user nova-compute[71229]:       <nova:owner>
Apr 11 15:25:47 user nova-compute[71229]:         <nova:user uuid="1d60ce27bfad4d7c9b976e834df35ad4">tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member</nova:user>
Apr 11 15:25:47 user nova-compute[71229]:         <nova:project uuid="ddc05e9bf5ab426982ccb3092ad596e4">tempest-ServerBootFromVolumeStableRescueTest-1907753459</nova:project>
Apr 11 15:25:47 user nova-compute[71229]:       </nova:owner>
Apr 11 15:25:47 user nova-compute[71229]:       <nova:root type="image" uuid="52fe638c-5ada-47d5-b376-233bfa808a37"/>
Apr 11 15:25:47 user nova-compute[71229]:       <nova:ports>
Apr 11 15:25:47 user nova-compute[71229]:         <nova:port uuid="4718fa68-0eb9-4592-8c43-981438e3d0b8">
Apr 11 15:25:47 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 11 15:25:47 user nova-compute[71229]:         </nova:port>
Apr 11 15:25:47 user nova-compute[71229]:       </nova:ports>
Apr 11 15:25:47 user nova-compute[71229]:     </nova:instance>
Apr 11 15:25:47 user nova-compute[71229]:   </metadata>
Apr 11 15:25:47 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:25:47 user nova-compute[71229]:     <system>
Apr 11 15:25:47 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:25:47 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:25:47 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:25:47 user nova-compute[71229]:       <entry name="serial">b0d90fd2-6a95-43c4-8756-e82071d99154</entry>
Apr 11 15:25:47 user nova-compute[71229]:       <entry name="uuid">b0d90fd2-6a95-43c4-8756-e82071d99154</entry>
Apr 11 15:25:47 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:25:47 user nova-compute[71229]:     </system>
Apr 11 15:25:47 user nova-compute[71229]:   </sysinfo>
Apr 11 15:25:47 user nova-compute[71229]:   <os>
Apr 11 15:25:47 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:25:47 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:25:47 user nova-compute[71229]:   </os>
Apr 11 15:25:47 user nova-compute[71229]:   <features>
Apr 11 15:25:47 user nova-compute[71229]:     <acpi/>
Apr 11 15:25:47 user nova-compute[71229]:     <apic/>
Apr 11 15:25:47 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:25:47 user nova-compute[71229]:   </features>
Apr 11 15:25:47 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:25:47 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:25:47 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:25:47 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:25:47 user nova-compute[71229]:   </clock>
Apr 11 15:25:47 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:25:47 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:25:47 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:25:47 user nova-compute[71229]:   </cpu>
Apr 11 15:25:47 user nova-compute[71229]:   <devices>
Apr 11 15:25:47 user nova-compute[71229]:     <disk type="block" device="disk">
Apr 11 15:25:47 user nova-compute[71229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:25:47 user nova-compute[71229]:       <source dev="/dev/sdb"/>
Apr 11 15:25:47 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:25:47 user nova-compute[71229]:       <serial>65c1d870-4696-4892-9abe-b305824a04eb</serial>
Apr 11 15:25:47 user nova-compute[71229]:     </disk>
Apr 11 15:25:47 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 15:25:47 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 15:25:47 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/b0d90fd2-6a95-43c4-8756-e82071d99154/disk.rescue"/>
Apr 11 15:25:47 user nova-compute[71229]:       <target dev="vdb" bus="virtio"/>
Apr 11 15:25:47 user nova-compute[71229]:       <boot order="1"/>
Apr 11 15:25:47 user nova-compute[71229]:     </disk>
Apr 11 15:25:47 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:25:47 user nova-compute[71229]:       <mac address="fa:16:3e:e4:28:3b"/>
Apr 11 15:25:47 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:25:47 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:25:47 user nova-compute[71229]:       <target dev="tap4718fa68-0e"/>
Apr 11 15:25:47 user nova-compute[71229]:     </interface>
Apr 11 15:25:47 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:25:47 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/b0d90fd2-6a95-43c4-8756-e82071d99154/console.log" append="off"/>
Apr 11 15:25:47 user nova-compute[71229]:     </serial>
Apr 11 15:25:47 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:25:47 user nova-compute[71229]:     <video>
Apr 11 15:25:47 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:25:47 user nova-compute[71229]:     </video>
Apr 11 15:25:47 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:25:47 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:25:47 user nova-compute[71229]:     </rng>
Apr 11 15:25:47 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:25:47 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:25:47 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:25:47 user nova-compute[71229]:     </memballoon>
Apr 11 15:25:47 user nova-compute[71229]:   </devices>
Apr 11 15:25:47 user nova-compute[71229]: </domain>
Apr 11 15:25:47 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:25:47 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Instance destroyed successfully.
Apr 11 15:25:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:25:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] No VIF found with MAC fa:16:3e:e4:28:3b, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:25:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1d4e6079-0d12-40a2-ac86-978395423fcb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Acquiring lock "068f10b4-086e-4af7-a53e-f6ece73d01e4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:25:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1d4e6079-0d12-40a2-ac86-978395423fcb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "068f10b4-086e-4af7-a53e-f6ece73d01e4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:25:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1d4e6079-0d12-40a2-ac86-978395423fcb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Acquiring lock "068f10b4-086e-4af7-a53e-f6ece73d01e4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:25:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1d4e6079-0d12-40a2-ac86-978395423fcb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "068f10b4-086e-4af7-a53e-f6ece73d01e4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:25:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1d4e6079-0d12-40a2-ac86-978395423fcb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "068f10b4-086e-4af7-a53e-f6ece73d01e4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:25:48 user nova-compute[71229]: INFO nova.compute.manager [None req-1d4e6079-0d12-40a2-ac86-978395423fcb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Terminating instance
Apr 11 15:25:48 user nova-compute[71229]: DEBUG nova.compute.manager [None req-1d4e6079-0d12-40a2-ac86-978395423fcb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Start destroying the instance on the hypervisor. {{(pid=71229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 15:25:48 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:48 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:49 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Instance destroyed successfully.
Apr 11 15:25:49 user nova-compute[71229]: DEBUG nova.objects.instance [None req-1d4e6079-0d12-40a2-ac86-978395423fcb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lazy-loading 'resources' on Instance uuid 068f10b4-086e-4af7-a53e-f6ece73d01e4 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:25:49 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-1d4e6079-0d12-40a2-ac86-978395423fcb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:23:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1438339496',display_name='tempest-VolumesActionsTest-instance-1438339496',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1438339496',id=11,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:24:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b4a341ccfc0b4f08bb2e97083143dd40',ramdisk_id='',reservation_id='r-0diowjg5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1278032672',owner_user_name='tempest-VolumesActionsTest-1278032672-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:24:06Z,user_data=None,user_id='acc44d2042554ca0b0bde4b2de5b566a',uuid=068f10b4-086e-4af7-a53e-f6ece73d01e4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7774938e-52d1-4c9a-8bc5-db84a905791b", "address": "fa:16:3e:87:e3:63", "network": {"id": "5b9dc948-4f8b-460a-bc87-04cf194f5c08", "bridge": "br-int", "label": "tempest-VolumesActionsTest-712454576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b4a341ccfc0b4f08bb2e97083143dd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7774938e-52", "ovs_interfaceid": "7774938e-52d1-4c9a-8bc5-db84a905791b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:25:49 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-1d4e6079-0d12-40a2-ac86-978395423fcb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Converting VIF {"id": "7774938e-52d1-4c9a-8bc5-db84a905791b", "address": "fa:16:3e:87:e3:63", "network": {"id": "5b9dc948-4f8b-460a-bc87-04cf194f5c08", "bridge": "br-int", "label": "tempest-VolumesActionsTest-712454576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b4a341ccfc0b4f08bb2e97083143dd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7774938e-52", "ovs_interfaceid": "7774938e-52d1-4c9a-8bc5-db84a905791b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:25:49 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-1d4e6079-0d12-40a2-ac86-978395423fcb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:e3:63,bridge_name='br-int',has_traffic_filtering=True,id=7774938e-52d1-4c9a-8bc5-db84a905791b,network=Network(5b9dc948-4f8b-460a-bc87-04cf194f5c08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7774938e-52') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:25:49 user nova-compute[71229]: DEBUG os_vif [None req-1d4e6079-0d12-40a2-ac86-978395423fcb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:e3:63,bridge_name='br-int',has_traffic_filtering=True,id=7774938e-52d1-4c9a-8bc5-db84a905791b,network=Network(5b9dc948-4f8b-460a-bc87-04cf194f5c08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7774938e-52') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:25:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7774938e-52, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:25:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:25:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:49 user nova-compute[71229]: INFO os_vif [None req-1d4e6079-0d12-40a2-ac86-978395423fcb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:e3:63,bridge_name='br-int',has_traffic_filtering=True,id=7774938e-52d1-4c9a-8bc5-db84a905791b,network=Network(5b9dc948-4f8b-460a-bc87-04cf194f5c08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7774938e-52')
Apr 11 15:25:49 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-1d4e6079-0d12-40a2-ac86-978395423fcb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Deleting instance files /opt/stack/data/nova/instances/068f10b4-086e-4af7-a53e-f6ece73d01e4_del
Apr 11 15:25:49 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-1d4e6079-0d12-40a2-ac86-978395423fcb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Deletion of /opt/stack/data/nova/instances/068f10b4-086e-4af7-a53e-f6ece73d01e4_del complete
Apr 11 15:25:49 user nova-compute[71229]: INFO nova.compute.manager [None req-1d4e6079-0d12-40a2-ac86-978395423fcb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Took 1.19 seconds to destroy the instance on the hypervisor.
Apr 11 15:25:49 user nova-compute[71229]: DEBUG oslo.service.loopingcall [None req-1d4e6079-0d12-40a2-ac86-978395423fcb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71229) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 15:25:49 user nova-compute[71229]: DEBUG nova.compute.manager [-] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Deallocating network for instance {{(pid=71229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 15:25:49 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] deallocate_for_instance() {{(pid=71229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 15:25:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:49 user nova-compute[71229]: DEBUG nova.compute.manager [req-6bd64e69-1f86-498c-93cd-488c1f2d7183 req-8404426b-efa7-4a3f-a89e-e7b3816d775d service nova] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Received event network-vif-unplugged-7774938e-52d1-4c9a-8bc5-db84a905791b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:25:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-6bd64e69-1f86-498c-93cd-488c1f2d7183 req-8404426b-efa7-4a3f-a89e-e7b3816d775d service nova] Acquiring lock "068f10b4-086e-4af7-a53e-f6ece73d01e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:25:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-6bd64e69-1f86-498c-93cd-488c1f2d7183 req-8404426b-efa7-4a3f-a89e-e7b3816d775d service nova] Lock "068f10b4-086e-4af7-a53e-f6ece73d01e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:25:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-6bd64e69-1f86-498c-93cd-488c1f2d7183 req-8404426b-efa7-4a3f-a89e-e7b3816d775d service nova] Lock "068f10b4-086e-4af7-a53e-f6ece73d01e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:25:49 user nova-compute[71229]: DEBUG nova.compute.manager [req-6bd64e69-1f86-498c-93cd-488c1f2d7183 req-8404426b-efa7-4a3f-a89e-e7b3816d775d service nova] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] No waiting events found dispatching network-vif-unplugged-7774938e-52d1-4c9a-8bc5-db84a905791b {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:25:49 user nova-compute[71229]: DEBUG nova.compute.manager [req-6bd64e69-1f86-498c-93cd-488c1f2d7183 req-8404426b-efa7-4a3f-a89e-e7b3816d775d service nova] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Received event network-vif-unplugged-7774938e-52d1-4c9a-8bc5-db84a905791b for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 15:25:49 user nova-compute[71229]: DEBUG nova.compute.manager [req-6bd64e69-1f86-498c-93cd-488c1f2d7183 req-8404426b-efa7-4a3f-a89e-e7b3816d775d service nova] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Received event network-vif-plugged-7774938e-52d1-4c9a-8bc5-db84a905791b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:25:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-6bd64e69-1f86-498c-93cd-488c1f2d7183 req-8404426b-efa7-4a3f-a89e-e7b3816d775d service nova] Acquiring lock "068f10b4-086e-4af7-a53e-f6ece73d01e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:25:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-6bd64e69-1f86-498c-93cd-488c1f2d7183 req-8404426b-efa7-4a3f-a89e-e7b3816d775d service nova] Lock "068f10b4-086e-4af7-a53e-f6ece73d01e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:25:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-6bd64e69-1f86-498c-93cd-488c1f2d7183 req-8404426b-efa7-4a3f-a89e-e7b3816d775d service nova] Lock "068f10b4-086e-4af7-a53e-f6ece73d01e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:25:49 user nova-compute[71229]: DEBUG nova.compute.manager [req-6bd64e69-1f86-498c-93cd-488c1f2d7183 req-8404426b-efa7-4a3f-a89e-e7b3816d775d service nova] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] No waiting events found dispatching network-vif-plugged-7774938e-52d1-4c9a-8bc5-db84a905791b {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:25:49 user nova-compute[71229]: WARNING nova.compute.manager [req-6bd64e69-1f86-498c-93cd-488c1f2d7183 req-8404426b-efa7-4a3f-a89e-e7b3816d775d service nova] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Received unexpected event network-vif-plugged-7774938e-52d1-4c9a-8bc5-db84a905791b for instance with vm_state active and task_state deleting.
Apr 11 15:25:49 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:25:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:49 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Took 0.51 seconds to deallocate network for instance.
Apr 11 15:25:49 user nova-compute[71229]: DEBUG nova.compute.manager [req-b1da445c-3d21-4e7a-9d45-1a960701391c req-9e32c812-c819-4439-8f89-64c75a7b106c service nova] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Received event network-vif-deleted-7774938e-52d1-4c9a-8bc5-db84a905791b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:25:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1d4e6079-0d12-40a2-ac86-978395423fcb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:25:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1d4e6079-0d12-40a2-ac86-978395423fcb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:25:50 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-1d4e6079-0d12-40a2-ac86-978395423fcb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:25:50 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-1d4e6079-0d12-40a2-ac86-978395423fcb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:25:50 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1d4e6079-0d12-40a2-ac86-978395423fcb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.341s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:25:50 user nova-compute[71229]: INFO nova.scheduler.client.report [None req-1d4e6079-0d12-40a2-ac86-978395423fcb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Deleted allocations for instance 068f10b4-086e-4af7-a53e-f6ece73d01e4
Apr 11 15:25:50 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1d4e6079-0d12-40a2-ac86-978395423fcb tempest-VolumesActionsTest-1278032672 tempest-VolumesActionsTest-1278032672-project-member] Lock "068f10b4-086e-4af7-a53e-f6ece73d01e4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.241s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:25:51 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:51 user nova-compute[71229]: DEBUG nova.compute.manager [req-4cfea522-4591-431a-9614-f52ad14f28c8 req-8b5ec14d-bac3-443d-bb6e-08f6ac3c2327 service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Received event network-vif-plugged-4718fa68-0eb9-4592-8c43-981438e3d0b8 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:25:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4cfea522-4591-431a-9614-f52ad14f28c8 req-8b5ec14d-bac3-443d-bb6e-08f6ac3c2327 service nova] Acquiring lock "b0d90fd2-6a95-43c4-8756-e82071d99154-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:25:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4cfea522-4591-431a-9614-f52ad14f28c8 req-8b5ec14d-bac3-443d-bb6e-08f6ac3c2327 service nova] Lock "b0d90fd2-6a95-43c4-8756-e82071d99154-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:25:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4cfea522-4591-431a-9614-f52ad14f28c8 req-8b5ec14d-bac3-443d-bb6e-08f6ac3c2327 service nova] Lock "b0d90fd2-6a95-43c4-8756-e82071d99154-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:25:51 user nova-compute[71229]: DEBUG nova.compute.manager [req-4cfea522-4591-431a-9614-f52ad14f28c8 req-8b5ec14d-bac3-443d-bb6e-08f6ac3c2327 service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] No waiting events found dispatching network-vif-plugged-4718fa68-0eb9-4592-8c43-981438e3d0b8 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:25:51 user nova-compute[71229]: WARNING nova.compute.manager [req-4cfea522-4591-431a-9614-f52ad14f28c8 req-8b5ec14d-bac3-443d-bb6e-08f6ac3c2327 service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Received unexpected event network-vif-plugged-4718fa68-0eb9-4592-8c43-981438e3d0b8 for instance with vm_state active and task_state rescuing.
Apr 11 15:25:51 user nova-compute[71229]: DEBUG nova.compute.manager [req-4cfea522-4591-431a-9614-f52ad14f28c8 req-8b5ec14d-bac3-443d-bb6e-08f6ac3c2327 service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Received event network-vif-plugged-4718fa68-0eb9-4592-8c43-981438e3d0b8 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:25:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4cfea522-4591-431a-9614-f52ad14f28c8 req-8b5ec14d-bac3-443d-bb6e-08f6ac3c2327 service nova] Acquiring lock "b0d90fd2-6a95-43c4-8756-e82071d99154-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:25:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4cfea522-4591-431a-9614-f52ad14f28c8 req-8b5ec14d-bac3-443d-bb6e-08f6ac3c2327 service nova] Lock "b0d90fd2-6a95-43c4-8756-e82071d99154-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:25:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4cfea522-4591-431a-9614-f52ad14f28c8 req-8b5ec14d-bac3-443d-bb6e-08f6ac3c2327 service nova] Lock "b0d90fd2-6a95-43c4-8756-e82071d99154-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:25:51 user nova-compute[71229]: DEBUG nova.compute.manager [req-4cfea522-4591-431a-9614-f52ad14f28c8 req-8b5ec14d-bac3-443d-bb6e-08f6ac3c2327 service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] No waiting events found dispatching network-vif-plugged-4718fa68-0eb9-4592-8c43-981438e3d0b8 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:25:51 user nova-compute[71229]: WARNING nova.compute.manager [req-4cfea522-4591-431a-9614-f52ad14f28c8 req-8b5ec14d-bac3-443d-bb6e-08f6ac3c2327 service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Received unexpected event network-vif-plugged-4718fa68-0eb9-4592-8c43-981438e3d0b8 for instance with vm_state active and task_state rescuing.
Apr 11 15:25:51 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Removed pending event for b0d90fd2-6a95-43c4-8756-e82071d99154 due to event {{(pid=71229) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 15:25:51 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681226751.8586175, b0d90fd2-6a95-43c4-8756-e82071d99154 => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:25:51 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] VM Resumed (Lifecycle Event)
Apr 11 15:25:51 user nova-compute[71229]: DEBUG nova.compute.manager [None req-8fe8c152-57b8-46fc-ae43-a42260370c04 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:25:51 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:25:51 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:25:51 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 11 15:25:51 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681226751.8601766, b0d90fd2-6a95-43c4-8756-e82071d99154 => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:25:51 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] VM Started (Lifecycle Event)
Apr 11 15:25:51 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:25:51 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:25:54 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:55 user nova-compute[71229]: DEBUG nova.compute.manager [req-0230fec5-3699-4071-843b-0d3e1976692b req-e6198e94-06b3-422e-a3c7-ace77e1b745a service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Received event network-changed-1ad8234a-3f96-43a0-9dea-862e6efcda73 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:25:55 user nova-compute[71229]: DEBUG nova.compute.manager [req-0230fec5-3699-4071-843b-0d3e1976692b req-e6198e94-06b3-422e-a3c7-ace77e1b745a service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Refreshing instance network info cache due to event network-changed-1ad8234a-3f96-43a0-9dea-862e6efcda73. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:25:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-0230fec5-3699-4071-843b-0d3e1976692b req-e6198e94-06b3-422e-a3c7-ace77e1b745a service nova] Acquiring lock "refresh_cache-1e01618b-2aa4-4b56-b1a2-0d6e25e3075d" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:25:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-0230fec5-3699-4071-843b-0d3e1976692b req-e6198e94-06b3-422e-a3c7-ace77e1b745a service nova] Acquired lock "refresh_cache-1e01618b-2aa4-4b56-b1a2-0d6e25e3075d" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:25:55 user nova-compute[71229]: DEBUG nova.network.neutron [req-0230fec5-3699-4071-843b-0d3e1976692b req-e6198e94-06b3-422e-a3c7-ace77e1b745a service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Refreshing network info cache for port 1ad8234a-3f96-43a0-9dea-862e6efcda73 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:25:55 user nova-compute[71229]: DEBUG nova.network.neutron [req-0230fec5-3699-4071-843b-0d3e1976692b req-e6198e94-06b3-422e-a3c7-ace77e1b745a service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Updated VIF entry in instance network info cache for port 1ad8234a-3f96-43a0-9dea-862e6efcda73. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:25:55 user nova-compute[71229]: DEBUG nova.network.neutron [req-0230fec5-3699-4071-843b-0d3e1976692b req-e6198e94-06b3-422e-a3c7-ace77e1b745a service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Updating instance_info_cache with network_info: [{"id": "1ad8234a-3f96-43a0-9dea-862e6efcda73", "address": "fa:16:3e:54:20:be", "network": {"id": "15a1a586-0100-4057-8501-5c5a282d4063", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834988552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b9b79fb98441fd9f1b5df54471f0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad8234a-3f", "ovs_interfaceid": "1ad8234a-3f96-43a0-9dea-862e6efcda73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:25:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-0230fec5-3699-4071-843b-0d3e1976692b req-e6198e94-06b3-422e-a3c7-ace77e1b745a service nova] Releasing lock "refresh_cache-1e01618b-2aa4-4b56-b1a2-0d6e25e3075d" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:25:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:57 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-07143472-050b-48ad-94bb-2b58c2f148f2 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:25:57 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-07143472-050b-48ad-94bb-2b58c2f148f2 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:25:57 user nova-compute[71229]: INFO nova.compute.manager [None req-07143472-050b-48ad-94bb-2b58c2f148f2 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Shelving
Apr 11 15:25:57 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:57 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:57 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:57 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:57 user nova-compute[71229]: DEBUG nova.compute.manager [req-b414bbd3-eed5-49d6-8939-613c33cd771c req-0483b9ef-6210-44d6-8512-29bda1a08ec8 service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Received event network-vif-unplugged-1ad8234a-3f96-43a0-9dea-862e6efcda73 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:25:57 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-b414bbd3-eed5-49d6-8939-613c33cd771c req-0483b9ef-6210-44d6-8512-29bda1a08ec8 service nova] Acquiring lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:25:57 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-b414bbd3-eed5-49d6-8939-613c33cd771c req-0483b9ef-6210-44d6-8512-29bda1a08ec8 service nova] Lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:25:57 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-b414bbd3-eed5-49d6-8939-613c33cd771c req-0483b9ef-6210-44d6-8512-29bda1a08ec8 service nova] Lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:25:57 user nova-compute[71229]: DEBUG nova.compute.manager [req-b414bbd3-eed5-49d6-8939-613c33cd771c req-0483b9ef-6210-44d6-8512-29bda1a08ec8 service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] No waiting events found dispatching network-vif-unplugged-1ad8234a-3f96-43a0-9dea-862e6efcda73 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:25:57 user nova-compute[71229]: WARNING nova.compute.manager [req-b414bbd3-eed5-49d6-8939-613c33cd771c req-0483b9ef-6210-44d6-8512-29bda1a08ec8 service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Received unexpected event network-vif-unplugged-1ad8234a-3f96-43a0-9dea-862e6efcda73 for instance with vm_state active and task_state shelving.
Apr 11 15:25:58 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Instance destroyed successfully.
Apr 11 15:25:58 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-07143472-050b-48ad-94bb-2b58c2f148f2 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Beginning cold snapshot process
Apr 11 15:25:58 user nova-compute[71229]: DEBUG nova.privsep.utils [None req-07143472-050b-48ad-94bb-2b58c2f148f2 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71229) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 15:25:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-07143472-050b-48ad-94bb-2b58c2f148f2 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/disk /opt/stack/data/nova/instances/snapshots/tmpk4gkelll/aadfed3b57c14f208214b3082e640e52 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:25:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-07143472-050b-48ad-94bb-2b58c2f148f2 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/disk /opt/stack/data/nova/instances/snapshots/tmpk4gkelll/aadfed3b57c14f208214b3082e640e52" returned: 0 in 0.458s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:25:58 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-07143472-050b-48ad-94bb-2b58c2f148f2 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Snapshot extracted, beginning image upload
Apr 11 15:25:59 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:25:59 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:25:59 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:25:59 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 15:25:59 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Didn't find any instances for network info cache update. {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 15:25:59 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:25:59 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:25:59 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:25:59 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:25:59 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:25:59 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:25:59 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 15:25:59 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:25:59 user nova-compute[71229]: DEBUG nova.compute.manager [req-d034167d-5271-4c04-a1b3-4db68faba1d0 req-5bf304dd-f7d4-47ce-9762-e9aac3ae539d service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Received event network-vif-plugged-1ad8234a-3f96-43a0-9dea-862e6efcda73 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:25:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-d034167d-5271-4c04-a1b3-4db68faba1d0 req-5bf304dd-f7d4-47ce-9762-e9aac3ae539d service nova] Acquiring lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:25:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-d034167d-5271-4c04-a1b3-4db68faba1d0 req-5bf304dd-f7d4-47ce-9762-e9aac3ae539d service nova] Lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:25:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-d034167d-5271-4c04-a1b3-4db68faba1d0 req-5bf304dd-f7d4-47ce-9762-e9aac3ae539d service nova] Lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:25:59 user nova-compute[71229]: DEBUG nova.compute.manager [req-d034167d-5271-4c04-a1b3-4db68faba1d0 req-5bf304dd-f7d4-47ce-9762-e9aac3ae539d service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] No waiting events found dispatching network-vif-plugged-1ad8234a-3f96-43a0-9dea-862e6efcda73 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:25:59 user nova-compute[71229]: WARNING nova.compute.manager [req-d034167d-5271-4c04-a1b3-4db68faba1d0 req-5bf304dd-f7d4-47ce-9762-e9aac3ae539d service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Received unexpected event network-vif-plugged-1ad8234a-3f96-43a0-9dea-862e6efcda73 for instance with vm_state active and task_state shelving_image_uploading.
Apr 11 15:25:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:25:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:25:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:25:59 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 15:26:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:26:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:26:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:26:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:26:00 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:26:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0d90fd2-6a95-43c4-8756-e82071d99154/disk.rescue --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:26:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0d90fd2-6a95-43c4-8756-e82071d99154/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:26:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0d90fd2-6a95-43c4-8756-e82071d99154/disk.rescue --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:26:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0d90fd2-6a95-43c4-8756-e82071d99154/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:26:00 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:26:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b59399aa-f550-41c7-9818-6cb1f271fb52/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:26:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b59399aa-f550-41c7-9818-6cb1f271fb52/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:26:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b59399aa-f550-41c7-9818-6cb1f271fb52/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:26:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b59399aa-f550-41c7-9818-6cb1f271fb52/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:26:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4555892-7abb-4a3c-a4ae-a27ad4902708/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:26:01 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-07143472-050b-48ad-94bb-2b58c2f148f2 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Snapshot image upload complete
Apr 11 15:26:01 user nova-compute[71229]: DEBUG nova.compute.manager [None req-07143472-050b-48ad-94bb-2b58c2f148f2 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:26:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4555892-7abb-4a3c-a4ae-a27ad4902708/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:26:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4555892-7abb-4a3c-a4ae-a27ad4902708/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:26:01 user nova-compute[71229]: INFO nova.compute.manager [None req-07143472-050b-48ad-94bb-2b58c2f148f2 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Shelve offloading
Apr 11 15:26:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4555892-7abb-4a3c-a4ae-a27ad4902708/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:26:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a06747-0f43-4731-87e6-40629c382a6b/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:26:01 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Instance destroyed successfully.
Apr 11 15:26:01 user nova-compute[71229]: DEBUG nova.compute.manager [None req-07143472-050b-48ad-94bb-2b58c2f148f2 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:26:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-07143472-050b-48ad-94bb-2b58c2f148f2 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "refresh_cache-1e01618b-2aa4-4b56-b1a2-0d6e25e3075d" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:26:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-07143472-050b-48ad-94bb-2b58c2f148f2 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquired lock "refresh_cache-1e01618b-2aa4-4b56-b1a2-0d6e25e3075d" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:26:01 user nova-compute[71229]: DEBUG nova.network.neutron [None req-07143472-050b-48ad-94bb-2b58c2f148f2 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:26:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a06747-0f43-4731-87e6-40629c382a6b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:26:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a06747-0f43-4731-87e6-40629c382a6b/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:26:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:26:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a06747-0f43-4731-87e6-40629c382a6b/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:26:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:26:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:26:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:26:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:26:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:26:02 user nova-compute[71229]: DEBUG nova.network.neutron [None req-07143472-050b-48ad-94bb-2b58c2f148f2 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Updating instance_info_cache with network_info: [{"id": "1ad8234a-3f96-43a0-9dea-862e6efcda73", "address": "fa:16:3e:54:20:be", "network": {"id": "15a1a586-0100-4057-8501-5c5a282d4063", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834988552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b9b79fb98441fd9f1b5df54471f0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad8234a-3f", "ovs_interfaceid": "1ad8234a-3f96-43a0-9dea-862e6efcda73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:26:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:26:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:26:02 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-07143472-050b-48ad-94bb-2b58c2f148f2 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Releasing lock "refresh_cache-1e01618b-2aa4-4b56-b1a2-0d6e25e3075d" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:26:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:26:02 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:26:02 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:26:02 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:26:02 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8025MB free_disk=26.243873596191406GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 15:26:02 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:26:02 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:26:02 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance de1a45fd-27be-4438-80a4-2f3a100643c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:26:02 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 6a805345-374c-4326-9e8f-39bfc7947a35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:26:02 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance f3a06747-0f43-4731-87e6-40629c382a6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:26:02 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance b0d90fd2-6a95-43c4-8756-e82071d99154 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:26:02 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:26:02 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance b59399aa-f550-41c7-9818-6cb1f271fb52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:26:02 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 39e3dfb1-bc09-474d-b8cb-f01b11923eae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:26:02 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance e4555892-7abb-4a3c-a4ae-a27ad4902708 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:26:02 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 15:26:02 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 15:26:02 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:26:02 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:26:03 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 15:26:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.383s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:26:03 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Instance destroyed successfully.
Apr 11 15:26:03 user nova-compute[71229]: DEBUG nova.objects.instance [None req-07143472-050b-48ad-94bb-2b58c2f148f2 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lazy-loading 'resources' on Instance uuid 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:26:03 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-07143472-050b-48ad-94bb-2b58c2f148f2 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:24:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1772068587',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1772068587',id=12,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsR3rBvaQjIOxYeSz3NLQVsG9AGAuW2r0O6Mjm+I+MgG/J7ZAhRru4tm3W0cW0RBt+UkxQ8v87/p6J8fnQe0XnKTLliPQO8+NI0fNGxiZv5WBaJ+k0gvozLOf39XTzY+Q==',key_name='tempest-keypair-2006224467',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:24:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='63b9b79fb98441fd9f1b5df54471f0bd',ramdisk_id='',reservation_id='r-vjwljds2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1785499036',owner_user_name='tempest-AttachVolumeShelveTestJSON-1785499036-project-member',shelved_at='2023-04-11T15:26:01.166758',shelved_host='user',shelved_image_id='87863922-2331-4e0b-98c7-19452e916a88'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:25:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88d988d9ce0a41669b7c487ac07b4cfe',uuid=1e01618b-2aa4-4b56-b1a2-0d6e25e3075d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "1ad8234a-3f96-43a0-9dea-862e6efcda73", "address": "fa:16:3e:54:20:be", "network": {"id": "15a1a586-0100-4057-8501-5c5a282d4063", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834988552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b9b79fb98441fd9f1b5df54471f0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad8234a-3f", "ovs_interfaceid": "1ad8234a-3f96-43a0-9dea-862e6efcda73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:26:03 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-07143472-050b-48ad-94bb-2b58c2f148f2 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Converting VIF {"id": "1ad8234a-3f96-43a0-9dea-862e6efcda73", "address": "fa:16:3e:54:20:be", "network": {"id": "15a1a586-0100-4057-8501-5c5a282d4063", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834988552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b9b79fb98441fd9f1b5df54471f0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad8234a-3f", "ovs_interfaceid": "1ad8234a-3f96-43a0-9dea-862e6efcda73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:26:03 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-07143472-050b-48ad-94bb-2b58c2f148f2 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:20:be,bridge_name='br-int',has_traffic_filtering=True,id=1ad8234a-3f96-43a0-9dea-862e6efcda73,network=Network(15a1a586-0100-4057-8501-5c5a282d4063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad8234a-3f') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:26:03 user nova-compute[71229]: DEBUG os_vif [None req-07143472-050b-48ad-94bb-2b58c2f148f2 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:20:be,bridge_name='br-int',has_traffic_filtering=True,id=1ad8234a-3f96-43a0-9dea-862e6efcda73,network=Network(15a1a586-0100-4057-8501-5c5a282d4063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad8234a-3f') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:26:03 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:26:03 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ad8234a-3f, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:26:03 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:26:03 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:26:03 user nova-compute[71229]: INFO os_vif [None req-07143472-050b-48ad-94bb-2b58c2f148f2 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:20:be,bridge_name='br-int',has_traffic_filtering=True,id=1ad8234a-3f96-43a0-9dea-862e6efcda73,network=Network(15a1a586-0100-4057-8501-5c5a282d4063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad8234a-3f')
Apr 11 15:26:03 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-07143472-050b-48ad-94bb-2b58c2f148f2 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Deleting instance files /opt/stack/data/nova/instances/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d_del
Apr 11 15:26:03 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-07143472-050b-48ad-94bb-2b58c2f148f2 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Deletion of /opt/stack/data/nova/instances/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d_del complete
Apr 11 15:26:03 user nova-compute[71229]: DEBUG nova.compute.manager [req-5c4eb084-2b6d-4bf1-b28e-6ed93c02c58c req-23e85820-4f2a-454b-8110-664c7ec7c1eb service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Received event network-changed-1ad8234a-3f96-43a0-9dea-862e6efcda73 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:26:03 user nova-compute[71229]: DEBUG nova.compute.manager [req-5c4eb084-2b6d-4bf1-b28e-6ed93c02c58c req-23e85820-4f2a-454b-8110-664c7ec7c1eb service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Refreshing instance network info cache due to event network-changed-1ad8234a-3f96-43a0-9dea-862e6efcda73. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:26:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-5c4eb084-2b6d-4bf1-b28e-6ed93c02c58c req-23e85820-4f2a-454b-8110-664c7ec7c1eb service nova] Acquiring lock "refresh_cache-1e01618b-2aa4-4b56-b1a2-0d6e25e3075d" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:26:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-5c4eb084-2b6d-4bf1-b28e-6ed93c02c58c req-23e85820-4f2a-454b-8110-664c7ec7c1eb service nova] Acquired lock "refresh_cache-1e01618b-2aa4-4b56-b1a2-0d6e25e3075d" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:26:03 user nova-compute[71229]: DEBUG nova.network.neutron [req-5c4eb084-2b6d-4bf1-b28e-6ed93c02c58c req-23e85820-4f2a-454b-8110-664c7ec7c1eb service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Refreshing network info cache for port 1ad8234a-3f96-43a0-9dea-862e6efcda73 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:26:03 user nova-compute[71229]: INFO nova.scheduler.client.report [None req-07143472-050b-48ad-94bb-2b58c2f148f2 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Deleted allocations for instance 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d
Apr 11 15:26:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-07143472-050b-48ad-94bb-2b58c2f148f2 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:26:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-07143472-050b-48ad-94bb-2b58c2f148f2 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:26:03 user nova-compute[71229]: DEBUG nova.objects.instance [None req-07143472-050b-48ad-94bb-2b58c2f148f2 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lazy-loading 'numa_topology' on Instance uuid 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:26:03 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-07143472-050b-48ad-94bb-2b58c2f148f2 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:26:03 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-07143472-050b-48ad-94bb-2b58c2f148f2 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:26:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-07143472-050b-48ad-94bb-2b58c2f148f2 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.343s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:26:03 user nova-compute[71229]: DEBUG nova.network.neutron [req-5c4eb084-2b6d-4bf1-b28e-6ed93c02c58c req-23e85820-4f2a-454b-8110-664c7ec7c1eb service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Updated VIF entry in instance network info cache for port 1ad8234a-3f96-43a0-9dea-862e6efcda73. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:26:03 user nova-compute[71229]: DEBUG nova.network.neutron [req-5c4eb084-2b6d-4bf1-b28e-6ed93c02c58c req-23e85820-4f2a-454b-8110-664c7ec7c1eb service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Updating instance_info_cache with network_info: [{"id": "1ad8234a-3f96-43a0-9dea-862e6efcda73", "address": "fa:16:3e:54:20:be", "network": {"id": "15a1a586-0100-4057-8501-5c5a282d4063", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-834988552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b9b79fb98441fd9f1b5df54471f0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap1ad8234a-3f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:26:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-07143472-050b-48ad-94bb-2b58c2f148f2 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.254s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:26:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-5c4eb084-2b6d-4bf1-b28e-6ed93c02c58c req-23e85820-4f2a-454b-8110-664c7ec7c1eb service nova] Releasing lock "refresh_cache-1e01618b-2aa4-4b56-b1a2-0d6e25e3075d" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:26:04 user nova-compute[71229]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681226749.175666, 068f10b4-086e-4af7-a53e-f6ece73d01e4 => Stopped> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:26:04 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] VM Stopped (Lifecycle Event)
Apr 11 15:26:04 user nova-compute[71229]: DEBUG nova.compute.manager [None req-986b0a01-d850-48cf-8f5f-88b507706b9e None None] [instance: 068f10b4-086e-4af7-a53e-f6ece73d01e4] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:26:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:26:07 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4b3de646-d6bd-4eab-85f1-a8e982cc6149 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "b59399aa-f550-41c7-9818-6cb1f271fb52" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:26:07 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4b3de646-d6bd-4eab-85f1-a8e982cc6149 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "b59399aa-f550-41c7-9818-6cb1f271fb52" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:26:07 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4b3de646-d6bd-4eab-85f1-a8e982cc6149 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "b59399aa-f550-41c7-9818-6cb1f271fb52-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:26:07 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4b3de646-d6bd-4eab-85f1-a8e982cc6149 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "b59399aa-f550-41c7-9818-6cb1f271fb52-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:26:07 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4b3de646-d6bd-4eab-85f1-a8e982cc6149 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "b59399aa-f550-41c7-9818-6cb1f271fb52-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:26:07 user nova-compute[71229]: INFO nova.compute.manager [None req-4b3de646-d6bd-4eab-85f1-a8e982cc6149 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Terminating instance
Apr 11 15:26:07 user nova-compute[71229]: DEBUG nova.compute.manager [None req-4b3de646-d6bd-4eab-85f1-a8e982cc6149 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Start destroying the instance on the hypervisor. {{(pid=71229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 15:26:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:26:07 user nova-compute[71229]: DEBUG nova.compute.manager [req-35f97a3b-bbf6-419f-af85-3de55f7f8a47 req-a4d15fe5-4210-43b1-961a-a282e26425ac service nova] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Received event network-vif-unplugged-ae63c1ed-23df-4140-979f-1756e27a67e1 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:26:07 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-35f97a3b-bbf6-419f-af85-3de55f7f8a47 req-a4d15fe5-4210-43b1-961a-a282e26425ac service nova] Acquiring lock "b59399aa-f550-41c7-9818-6cb1f271fb52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:26:07 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-35f97a3b-bbf6-419f-af85-3de55f7f8a47 req-a4d15fe5-4210-43b1-961a-a282e26425ac service nova] Lock "b59399aa-f550-41c7-9818-6cb1f271fb52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:26:07 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-35f97a3b-bbf6-419f-af85-3de55f7f8a47 req-a4d15fe5-4210-43b1-961a-a282e26425ac service nova] Lock "b59399aa-f550-41c7-9818-6cb1f271fb52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:26:07 user nova-compute[71229]: DEBUG nova.compute.manager [req-35f97a3b-bbf6-419f-af85-3de55f7f8a47 req-a4d15fe5-4210-43b1-961a-a282e26425ac service nova] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] No waiting events found dispatching network-vif-unplugged-ae63c1ed-23df-4140-979f-1756e27a67e1 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:26:07 user nova-compute[71229]: DEBUG nova.compute.manager [req-35f97a3b-bbf6-419f-af85-3de55f7f8a47 req-a4d15fe5-4210-43b1-961a-a282e26425ac service nova] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Received event network-vif-unplugged-ae63c1ed-23df-4140-979f-1756e27a67e1 for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 15:26:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:26:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:26:08 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:26:08 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Instance destroyed successfully.
Apr 11 15:26:08 user nova-compute[71229]: DEBUG nova.objects.instance [None req-4b3de646-d6bd-4eab-85f1-a8e982cc6149 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lazy-loading 'resources' on Instance uuid b59399aa-f550-41c7-9818-6cb1f271fb52 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:26:08 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-4b3de646-d6bd-4eab-85f1-a8e982cc6149 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:24:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1391795375',display_name='tempest-VolumesAdminNegativeTest-server-1391795375',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1391795375',id=13,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:24:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='da140971126a4d298ff718275e7a22ec',ramdisk_id='',reservation_id='r-xpk9eb1a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-2033224639',owner_user_name='tempest-VolumesAdminNegativeTest-2033224639-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:24:21Z,user_data=None,user_id='2717e456dcc941899c48c3c973083bd4',uuid=b59399aa-f550-41c7-9818-6cb1f271fb52,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae63c1ed-23df-4140-979f-1756e27a67e1", "address": "fa:16:3e:a6:73:db", "network": {"id": "f52bd4a9-1843-408b-85af-c2124ad01be7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-593462205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da140971126a4d298ff718275e7a22ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae63c1ed-23", "ovs_interfaceid": "ae63c1ed-23df-4140-979f-1756e27a67e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:26:08 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-4b3de646-d6bd-4eab-85f1-a8e982cc6149 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Converting VIF {"id": "ae63c1ed-23df-4140-979f-1756e27a67e1", "address": "fa:16:3e:a6:73:db", "network": {"id": "f52bd4a9-1843-408b-85af-c2124ad01be7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-593462205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da140971126a4d298ff718275e7a22ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae63c1ed-23", "ovs_interfaceid": "ae63c1ed-23df-4140-979f-1756e27a67e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:26:08 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-4b3de646-d6bd-4eab-85f1-a8e982cc6149 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:73:db,bridge_name='br-int',has_traffic_filtering=True,id=ae63c1ed-23df-4140-979f-1756e27a67e1,network=Network(f52bd4a9-1843-408b-85af-c2124ad01be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae63c1ed-23') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:26:08 user nova-compute[71229]: DEBUG os_vif [None req-4b3de646-d6bd-4eab-85f1-a8e982cc6149 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:73:db,bridge_name='br-int',has_traffic_filtering=True,id=ae63c1ed-23df-4140-979f-1756e27a67e1,network=Network(f52bd4a9-1843-408b-85af-c2124ad01be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae63c1ed-23') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:26:08 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:26:08 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae63c1ed-23, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:26:08 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:26:08 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:26:08 user nova-compute[71229]: INFO os_vif [None req-4b3de646-d6bd-4eab-85f1-a8e982cc6149 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:73:db,bridge_name='br-int',has_traffic_filtering=True,id=ae63c1ed-23df-4140-979f-1756e27a67e1,network=Network(f52bd4a9-1843-408b-85af-c2124ad01be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae63c1ed-23')
Apr 11 15:26:08 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-4b3de646-d6bd-4eab-85f1-a8e982cc6149 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Deleting instance files /opt/stack/data/nova/instances/b59399aa-f550-41c7-9818-6cb1f271fb52_del
Apr 11 15:26:08 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-4b3de646-d6bd-4eab-85f1-a8e982cc6149 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Deletion of /opt/stack/data/nova/instances/b59399aa-f550-41c7-9818-6cb1f271fb52_del complete
Apr 11 15:26:08 user nova-compute[71229]: INFO nova.compute.manager [None req-4b3de646-d6bd-4eab-85f1-a8e982cc6149 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 11 15:26:08 user nova-compute[71229]: DEBUG oslo.service.loopingcall [None req-4b3de646-d6bd-4eab-85f1-a8e982cc6149 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71229) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 15:26:08 user nova-compute[71229]: DEBUG nova.compute.manager [-] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Deallocating network for instance {{(pid=71229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 15:26:08 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] deallocate_for_instance() {{(pid=71229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 15:26:08 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:26:08 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Took 0.52 seconds to deallocate network for instance.
Apr 11 15:26:08 user nova-compute[71229]: DEBUG nova.compute.manager [req-8699deae-86fd-4f06-ae4d-1d4d44c60bb6 req-98284667-2cc9-4130-b9ea-8d3a292bd69f service nova] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Received event network-vif-deleted-ae63c1ed-23df-4140-979f-1756e27a67e1 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:26:08 user nova-compute[71229]: INFO nova.compute.manager [req-8699deae-86fd-4f06-ae4d-1d4d44c60bb6 req-98284667-2cc9-4130-b9ea-8d3a292bd69f service nova] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Neutron deleted interface ae63c1ed-23df-4140-979f-1756e27a67e1; detaching it from the instance and deleting it from the info cache
Apr 11 15:26:08 user nova-compute[71229]: DEBUG nova.network.neutron [req-8699deae-86fd-4f06-ae4d-1d4d44c60bb6 req-98284667-2cc9-4130-b9ea-8d3a292bd69f service nova] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:26:08 user nova-compute[71229]: DEBUG nova.compute.manager [req-8699deae-86fd-4f06-ae4d-1d4d44c60bb6 req-98284667-2cc9-4130-b9ea-8d3a292bd69f service nova] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Detach interface failed, port_id=ae63c1ed-23df-4140-979f-1756e27a67e1, reason: Instance b59399aa-f550-41c7-9818-6cb1f271fb52 could not be found. {{(pid=71229) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 15:26:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4b3de646-d6bd-4eab-85f1-a8e982cc6149 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:26:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4b3de646-d6bd-4eab-85f1-a8e982cc6149 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:26:09 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-4b3de646-d6bd-4eab-85f1-a8e982cc6149 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:26:09 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-4b3de646-d6bd-4eab-85f1-a8e982cc6149 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:26:09 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4b3de646-d6bd-4eab-85f1-a8e982cc6149 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.230s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:26:09 user nova-compute[71229]: INFO nova.scheduler.client.report [None req-4b3de646-d6bd-4eab-85f1-a8e982cc6149 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Deleted allocations for instance b59399aa-f550-41c7-9818-6cb1f271fb52
Apr 11 15:26:09 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4b3de646-d6bd-4eab-85f1-a8e982cc6149 tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "b59399aa-f550-41c7-9818-6cb1f271fb52" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.800s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:26:09 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:26:09 user nova-compute[71229]: DEBUG nova.compute.manager [req-8071e801-17bb-4089-bfe9-c6b37cac70f7 req-3a102942-a8bd-4c6a-a632-adba1a74d8aa service nova] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Received event network-vif-plugged-ae63c1ed-23df-4140-979f-1756e27a67e1 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:26:09 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-8071e801-17bb-4089-bfe9-c6b37cac70f7 req-3a102942-a8bd-4c6a-a632-adba1a74d8aa service nova] Acquiring lock "b59399aa-f550-41c7-9818-6cb1f271fb52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:26:09 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-8071e801-17bb-4089-bfe9-c6b37cac70f7 req-3a102942-a8bd-4c6a-a632-adba1a74d8aa service nova] Lock "b59399aa-f550-41c7-9818-6cb1f271fb52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:26:09 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-8071e801-17bb-4089-bfe9-c6b37cac70f7 req-3a102942-a8bd-4c6a-a632-adba1a74d8aa service nova] Lock "b59399aa-f550-41c7-9818-6cb1f271fb52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:26:09 user nova-compute[71229]: DEBUG nova.compute.manager [req-8071e801-17bb-4089-bfe9-c6b37cac70f7 req-3a102942-a8bd-4c6a-a632-adba1a74d8aa service nova] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] No waiting events found dispatching network-vif-plugged-ae63c1ed-23df-4140-979f-1756e27a67e1 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:26:09 user nova-compute[71229]: WARNING nova.compute.manager [req-8071e801-17bb-4089-bfe9-c6b37cac70f7 req-3a102942-a8bd-4c6a-a632-adba1a74d8aa service nova] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Received unexpected event network-vif-plugged-ae63c1ed-23df-4140-979f-1756e27a67e1 for instance with vm_state deleted and task_state None.
Apr 11 15:26:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:26:13 user nova-compute[71229]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681226758.0516496, 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d => Stopped> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:26:13 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] VM Stopped (Lifecycle Event)
Apr 11 15:26:13 user nova-compute[71229]: DEBUG nova.compute.manager [None req-11177d31-17e8-48f0-99d6-cd5fd76a0fbd None None] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:26:13 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:26:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:26:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:26:21 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:26:23 user nova-compute[71229]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681226768.282844, b59399aa-f550-41c7-9818-6cb1f271fb52 => Stopped> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:26:23 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] VM Stopped (Lifecycle Event)
Apr 11 15:26:23 user nova-compute[71229]: DEBUG nova.compute.manager [None req-241cdf29-a05b-444c-b24a-0413b477418b None None] [instance: b59399aa-f550-41c7-9818-6cb1f271fb52] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:26:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:26:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:26:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:26:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:26:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:26:34 user nova-compute[71229]: DEBUG nova.compute.manager [req-22f58356-a22e-4580-8058-a75cb81509bf req-c50f7cd7-a5d9-4544-948d-3bf8d8a2b98c service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Received event network-changed-21d628ba-6bae-4d98-94df-bb6fbb4f1c24 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:26:34 user nova-compute[71229]: DEBUG nova.compute.manager [req-22f58356-a22e-4580-8058-a75cb81509bf req-c50f7cd7-a5d9-4544-948d-3bf8d8a2b98c service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Refreshing instance network info cache due to event network-changed-21d628ba-6bae-4d98-94df-bb6fbb4f1c24. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:26:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-22f58356-a22e-4580-8058-a75cb81509bf req-c50f7cd7-a5d9-4544-948d-3bf8d8a2b98c service nova] Acquiring lock "refresh_cache-39e3dfb1-bc09-474d-b8cb-f01b11923eae" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:26:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-22f58356-a22e-4580-8058-a75cb81509bf req-c50f7cd7-a5d9-4544-948d-3bf8d8a2b98c service nova] Acquired lock "refresh_cache-39e3dfb1-bc09-474d-b8cb-f01b11923eae" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:26:34 user nova-compute[71229]: DEBUG nova.network.neutron [req-22f58356-a22e-4580-8058-a75cb81509bf req-c50f7cd7-a5d9-4544-948d-3bf8d8a2b98c service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Refreshing network info cache for port 21d628ba-6bae-4d98-94df-bb6fbb4f1c24 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:26:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Acquiring lock "39e3dfb1-bc09-474d-b8cb-f01b11923eae" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:26:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "39e3dfb1-bc09-474d-b8cb-f01b11923eae" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:26:34 user nova-compute[71229]: INFO nova.compute.manager [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Shelve offloading
Apr 11 15:26:34 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:26:34 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:26:34 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:26:34 user nova-compute[71229]: DEBUG nova.network.neutron [req-22f58356-a22e-4580-8058-a75cb81509bf req-c50f7cd7-a5d9-4544-948d-3bf8d8a2b98c service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Updated VIF entry in instance network info cache for port 21d628ba-6bae-4d98-94df-bb6fbb4f1c24. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:26:34 user nova-compute[71229]: DEBUG nova.network.neutron [req-22f58356-a22e-4580-8058-a75cb81509bf req-c50f7cd7-a5d9-4544-948d-3bf8d8a2b98c service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Updating instance_info_cache with network_info: [{"id": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24", "address": "fa:16:3e:97:55:b0", "network": {"id": "75a41a6a-1c7b-47b0-907e-2015d56f554e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1001895705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ed867a40534b70bf75dc0cc28fdfec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d628ba-6b", "ovs_interfaceid": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:26:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-22f58356-a22e-4580-8058-a75cb81509bf req-c50f7cd7-a5d9-4544-948d-3bf8d8a2b98c service nova] Releasing lock "refresh_cache-39e3dfb1-bc09-474d-b8cb-f01b11923eae" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:26:35 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Instance destroyed successfully.
Apr 11 15:26:35 user nova-compute[71229]: DEBUG nova.compute.manager [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:26:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Acquiring lock "refresh_cache-39e3dfb1-bc09-474d-b8cb-f01b11923eae" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:26:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Acquired lock "refresh_cache-39e3dfb1-bc09-474d-b8cb-f01b11923eae" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:26:35 user nova-compute[71229]: DEBUG nova.network.neutron [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:26:36 user nova-compute[71229]: DEBUG nova.network.neutron [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Updating instance_info_cache with network_info: [{"id": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24", "address": "fa:16:3e:97:55:b0", "network": {"id": "75a41a6a-1c7b-47b0-907e-2015d56f554e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1001895705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ed867a40534b70bf75dc0cc28fdfec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d628ba-6b", "ovs_interfaceid": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:26:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Releasing lock "refresh_cache-39e3dfb1-bc09-474d-b8cb-f01b11923eae" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:26:36 user nova-compute[71229]: DEBUG nova.compute.manager [req-a5d7ee98-82ad-4371-ba36-2cea7e13225c req-2f8a1c04-c72b-4fac-b47b-a5e8d0350301 service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Received event network-vif-unplugged-21d628ba-6bae-4d98-94df-bb6fbb4f1c24 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:26:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a5d7ee98-82ad-4371-ba36-2cea7e13225c req-2f8a1c04-c72b-4fac-b47b-a5e8d0350301 service nova] Acquiring lock "39e3dfb1-bc09-474d-b8cb-f01b11923eae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:26:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a5d7ee98-82ad-4371-ba36-2cea7e13225c req-2f8a1c04-c72b-4fac-b47b-a5e8d0350301 service nova] Lock "39e3dfb1-bc09-474d-b8cb-f01b11923eae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:26:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a5d7ee98-82ad-4371-ba36-2cea7e13225c req-2f8a1c04-c72b-4fac-b47b-a5e8d0350301 service nova] Lock "39e3dfb1-bc09-474d-b8cb-f01b11923eae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:26:36 user nova-compute[71229]: DEBUG nova.compute.manager [req-a5d7ee98-82ad-4371-ba36-2cea7e13225c req-2f8a1c04-c72b-4fac-b47b-a5e8d0350301 service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] No waiting events found dispatching network-vif-unplugged-21d628ba-6bae-4d98-94df-bb6fbb4f1c24 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:26:36 user nova-compute[71229]: WARNING nova.compute.manager [req-a5d7ee98-82ad-4371-ba36-2cea7e13225c req-2f8a1c04-c72b-4fac-b47b-a5e8d0350301 service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Received unexpected event network-vif-unplugged-21d628ba-6bae-4d98-94df-bb6fbb4f1c24 for instance with vm_state active and task_state shelving.
Apr 11 15:26:36 user nova-compute[71229]: DEBUG nova.compute.manager [req-a5d7ee98-82ad-4371-ba36-2cea7e13225c req-2f8a1c04-c72b-4fac-b47b-a5e8d0350301 service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Received event network-vif-plugged-21d628ba-6bae-4d98-94df-bb6fbb4f1c24 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:26:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a5d7ee98-82ad-4371-ba36-2cea7e13225c req-2f8a1c04-c72b-4fac-b47b-a5e8d0350301 service nova] Acquiring lock "39e3dfb1-bc09-474d-b8cb-f01b11923eae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:26:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a5d7ee98-82ad-4371-ba36-2cea7e13225c req-2f8a1c04-c72b-4fac-b47b-a5e8d0350301 service nova] Lock "39e3dfb1-bc09-474d-b8cb-f01b11923eae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:26:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a5d7ee98-82ad-4371-ba36-2cea7e13225c req-2f8a1c04-c72b-4fac-b47b-a5e8d0350301 service nova] Lock "39e3dfb1-bc09-474d-b8cb-f01b11923eae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:26:36 user nova-compute[71229]: DEBUG nova.compute.manager [req-a5d7ee98-82ad-4371-ba36-2cea7e13225c req-2f8a1c04-c72b-4fac-b47b-a5e8d0350301 service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] No waiting events found dispatching network-vif-plugged-21d628ba-6bae-4d98-94df-bb6fbb4f1c24 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:26:36 user nova-compute[71229]: WARNING nova.compute.manager [req-a5d7ee98-82ad-4371-ba36-2cea7e13225c req-2f8a1c04-c72b-4fac-b47b-a5e8d0350301 service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Received unexpected event network-vif-plugged-21d628ba-6bae-4d98-94df-bb6fbb4f1c24 for instance with vm_state active and task_state shelving.
Apr 11 15:26:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:26:36 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Instance destroyed successfully.
Apr 11 15:26:36 user nova-compute[71229]: DEBUG nova.objects.instance [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lazy-loading 'resources' on Instance uuid 39e3dfb1-bc09-474d-b8cb-f01b11923eae {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:26:36 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:24:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2037395852',display_name='tempest-TestShelveInstance-server-2037395852',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2037395852',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4WD1C8T6tkUEgT5nSc1MsqRgkLNzQRS7RjsK+eCmfdmidOraNTmKvDvSPnsYiAjMuo6nku/oKvPzyy026kIaVTiO+J+8OfPbwUqPSj0x0wpOl+Z+4f+Lo5uETYRrAumQ==',key_name='tempest-TestShelveInstance-1630475072',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:24:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63ed867a40534b70bf75dc0cc28fdfec',ramdisk_id='',reservation_id='r-vsdu64f3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-602339736',owner_user_name='tempest-TestShelveInstance-602339736-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:24:53Z,user_data=None,user_id='49e1716b2bb2438b93d46dc8052c788b',uuid=39e3dfb1-bc09-474d-b8cb-f01b11923eae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24", "address": "fa:16:3e:97:55:b0", "network": {"id": "75a41a6a-1c7b-47b0-907e-2015d56f554e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1001895705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ed867a40534b70bf75dc0cc28fdfec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d628ba-6b", "ovs_interfaceid": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:26:36 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Converting VIF {"id": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24", "address": "fa:16:3e:97:55:b0", "network": {"id": "75a41a6a-1c7b-47b0-907e-2015d56f554e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1001895705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ed867a40534b70bf75dc0cc28fdfec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d628ba-6b", "ovs_interfaceid": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:26:36 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:55:b0,bridge_name='br-int',has_traffic_filtering=True,id=21d628ba-6bae-4d98-94df-bb6fbb4f1c24,network=Network(75a41a6a-1c7b-47b0-907e-2015d56f554e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21d628ba-6b') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:26:36 user nova-compute[71229]: DEBUG os_vif [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:55:b0,bridge_name='br-int',has_traffic_filtering=True,id=21d628ba-6bae-4d98-94df-bb6fbb4f1c24,network=Network(75a41a6a-1c7b-47b0-907e-2015d56f554e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21d628ba-6b') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:26:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:26:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21d628ba-6b, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:26:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:26:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:26:36 user nova-compute[71229]: INFO os_vif [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:55:b0,bridge_name='br-int',has_traffic_filtering=True,id=21d628ba-6bae-4d98-94df-bb6fbb4f1c24,network=Network(75a41a6a-1c7b-47b0-907e-2015d56f554e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21d628ba-6b')
Apr 11 15:26:36 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 15:26:36 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rEkFuIDz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:26:36 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:26:36 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:26:36 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:26:36 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:26:36 user nova-compute[71229]: DEBUG nova.compute.manager [req-4be2a3db-380a-4ddb-b14e-7ba17bd19f04 req-d4f8083d-9510-4501-b729-287651f5046e service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Received event network-changed-21d628ba-6bae-4d98-94df-bb6fbb4f1c24 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:26:36 user nova-compute[71229]: DEBUG nova.compute.manager [req-4be2a3db-380a-4ddb-b14e-7ba17bd19f04 req-d4f8083d-9510-4501-b729-287651f5046e service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Refreshing instance network info cache due to event network-changed-21d628ba-6bae-4d98-94df-bb6fbb4f1c24. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:26:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4be2a3db-380a-4ddb-b14e-7ba17bd19f04 req-d4f8083d-9510-4501-b729-287651f5046e service nova] Acquiring lock "refresh_cache-39e3dfb1-bc09-474d-b8cb-f01b11923eae" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:26:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4be2a3db-380a-4ddb-b14e-7ba17bd19f04 req-d4f8083d-9510-4501-b729-287651f5046e service nova] Acquired lock "refresh_cache-39e3dfb1-bc09-474d-b8cb-f01b11923eae" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:26:36 user nova-compute[71229]: DEBUG nova.network.neutron [req-4be2a3db-380a-4ddb-b14e-7ba17bd19f04 req-d4f8083d-9510-4501-b729-287651f5046e service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Refreshing network info cache for port 21d628ba-6bae-4d98-94df-bb6fbb4f1c24 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:26:36 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:26:36 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bd3780-50d6-4ccb-9910-1f6c68c59acf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:26:36 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 15:26:36 user nova-compute[71229]: No targets found.
Apr 11 15:26:36 user nova-compute[71229]: iSNS:
Apr 11 15:26:36 user nova-compute[71229]: No targets found.
Apr 11 15:26:36 user nova-compute[71229]: STATIC:
Apr 11 15:26:36 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb
Apr 11 15:26:36 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:26:36 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:26:36 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4
Apr 11 15:26:36 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:26:36 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:26:36 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7
Apr 11 15:26:36 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:26:36 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:26:36 user nova-compute[71229]: FIRMWARE:
Apr 11 15:26:36 user nova-compute[71229]: No targets found.
Apr 11 15:26:36 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:26:36 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 15:26:36 user nova-compute[71229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 15:26:36 user nova-compute[71229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71229) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 15:26:36 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7', 0)] {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 15:26:36 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:26:36 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:26:36 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4105e5-ee9f-4d28-b8ae-4033b9d0cf7e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:26:36 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:26:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:26:37 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[571d8469-18cc-46d9-afbd-ec29b0e047f1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:26:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:26:37 user nova-compute[71229]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)
Apr 11 15:26:37 user nova-compute[71229]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 (non-flash)
Apr 11 15:26:37 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:26:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:26:37 user nova-compute[71229]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)
Apr 11 15:26:37 user nova-compute[71229]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 (non-flash)
Apr 11 15:26:37 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:26:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb641c9cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7'): ({'sdc'}, set())}) {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 15:26:37 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Removing single pathed devices sdc {{(pid=71229) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 15:26:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:26:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:26:37 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b7be14-b295-4488-9e35-563f33367d7e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:26:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:26:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:26:37 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b7e26d-64af-4381-8e33-871ff97b55e6]: (4, ('ok\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:26:37 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Flushing IO for device /dev/sdc {{(pid=71229) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 15:26:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:26:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:26:37 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e92e76-c8f8-4080-b73e-b7536edf4faf]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:26:37 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71229) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 15:26:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:26:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:26:37 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6375ccb-1638-4d2a-b0b1-e48a48c2bb04]: (4, ('1', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:26:37 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 15:26:37 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] SCSI volumes sdc have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 15:26:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7')] {{(pid=71229) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 15:26:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:26:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:26:37 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f451bf56-e5d9-464d-afe6-7ea439bdff02]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:26:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:26:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 -p 172.16.0.220:3260 --logout {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:26:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:26:37 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8750ac02-aa2f-4814-a264-f7f2a7d63134]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:26:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7, portal: 172.16.0.220,3260]
Apr 11 15:26:37 user nova-compute[71229]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7, portal: 172.16.0.220,3260] successful.
Apr 11 15:26:37 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:26:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 -p 172.16.0.220:3260 --op delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:26:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:26:37 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c963cdb-e541-49d1-85f3-7eb58e05c5bc]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:26:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:26:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:26:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] <== disconnect_volume: return (312ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:26:37 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 15:26:37 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Deleting instance files /opt/stack/data/nova/instances/39e3dfb1-bc09-474d-b8cb-f01b11923eae_del
Apr 11 15:26:37 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Deletion of /opt/stack/data/nova/instances/39e3dfb1-bc09-474d-b8cb-f01b11923eae_del complete
Apr 11 15:26:37 user nova-compute[71229]: DEBUG nova.network.neutron [req-4be2a3db-380a-4ddb-b14e-7ba17bd19f04 req-d4f8083d-9510-4501-b729-287651f5046e service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Updated VIF entry in instance network info cache for port 21d628ba-6bae-4d98-94df-bb6fbb4f1c24. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:26:37 user nova-compute[71229]: DEBUG nova.network.neutron [req-4be2a3db-380a-4ddb-b14e-7ba17bd19f04 req-d4f8083d-9510-4501-b729-287651f5046e service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Updating instance_info_cache with network_info: [{"id": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24", "address": "fa:16:3e:97:55:b0", "network": {"id": "75a41a6a-1c7b-47b0-907e-2015d56f554e", "bridge": null, "label": "tempest-TestShelveInstance-1001895705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ed867a40534b70bf75dc0cc28fdfec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap21d628ba-6b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:26:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4be2a3db-380a-4ddb-b14e-7ba17bd19f04 req-d4f8083d-9510-4501-b729-287651f5046e service nova] Releasing lock "refresh_cache-39e3dfb1-bc09-474d-b8cb-f01b11923eae" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:26:38 user nova-compute[71229]: INFO nova.scheduler.client.report [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Deleted allocations for instance 39e3dfb1-bc09-474d-b8cb-f01b11923eae
Apr 11 15:26:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:26:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:26:38 user nova-compute[71229]: DEBUG nova.objects.instance [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lazy-loading 'numa_topology' on Instance uuid 39e3dfb1-bc09-474d-b8cb-f01b11923eae {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:26:38 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:26:38 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:26:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.221s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:26:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5580baa4-b5ed-43c7-b97f-c0eae8895af8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "39e3dfb1-bc09-474d-b8cb-f01b11923eae" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.400s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:26:39 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Acquiring lock "fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:26:39 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Lock "fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:26:39 user nova-compute[71229]: DEBUG nova.compute.manager [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Starting instance... {{(pid=71229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 15:26:39 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:26:39 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:26:39 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 15:26:39 user nova-compute[71229]: INFO nova.compute.claims [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Claim successful on node user
Apr 11 15:26:40 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:26:40 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:26:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.307s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:26:40 user nova-compute[71229]: DEBUG nova.compute.manager [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Start building networks asynchronously for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 15:26:40 user nova-compute[71229]: DEBUG nova.compute.manager [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Allocating IP information in the background. {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 15:26:40 user nova-compute[71229]: DEBUG nova.network.neutron [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] allocate_for_instance() {{(pid=71229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 15:26:40 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 15:26:40 user nova-compute[71229]: DEBUG nova.compute.manager [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Start building block device mappings for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 15:26:40 user nova-compute[71229]: DEBUG nova.policy [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '90c7f9af6776413c91e2638712a142f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c9c879d28040aba0ebc76bc2a80693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71229) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 15:26:40 user nova-compute[71229]: DEBUG nova.compute.manager [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Start spawning the instance on the hypervisor. {{(pid=71229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 15:26:40 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Creating instance directory {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 15:26:40 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Creating image(s)
Apr 11 15:26:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Acquiring lock "/opt/stack/data/nova/instances/fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:26:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Lock "/opt/stack/data/nova/instances/fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:26:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Lock "/opt/stack/data/nova/instances/fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:26:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:26:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.137s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:26:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Acquiring lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:26:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:26:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:26:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.135s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:26:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5/disk 1073741824 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:26:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5/disk 1073741824" returned: 0 in 0.051s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:26:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:26:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:26:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.142s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:26:40 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5/disk. size=1073741824 {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 15:26:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:26:40 user nova-compute[71229]: DEBUG nova.network.neutron [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Successfully created port: 836289ee-6293-49b3-b0c2-7012ceae0c97 {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 15:26:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:26:41 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Cannot resize image /opt/stack/data/nova/instances/fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5/disk to a smaller size. {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 15:26:41 user nova-compute[71229]: DEBUG nova.objects.instance [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Lazy-loading 'migration_context' on Instance uuid fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:26:41 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Created local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 15:26:41 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Ensure instance console log exists: /opt/stack/data/nova/instances/fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 15:26:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:26:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:26:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:26:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:26:41 user nova-compute[71229]: DEBUG nova.network.neutron [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Successfully updated port: 836289ee-6293-49b3-b0c2-7012ceae0c97 {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:26:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Acquiring lock "refresh_cache-fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:26:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Acquired lock "refresh_cache-fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:26:41 user nova-compute[71229]: DEBUG nova.network.neutron [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:26:41 user nova-compute[71229]: DEBUG nova.compute.manager [req-6652633c-178d-4a1c-8d48-795807cea8bd req-d2c86925-85db-49c4-9782-a969627a9cee service nova] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Received event network-changed-836289ee-6293-49b3-b0c2-7012ceae0c97 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:26:41 user nova-compute[71229]: DEBUG nova.compute.manager [req-6652633c-178d-4a1c-8d48-795807cea8bd req-d2c86925-85db-49c4-9782-a969627a9cee service nova] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Refreshing instance network info cache due to event network-changed-836289ee-6293-49b3-b0c2-7012ceae0c97. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:26:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-6652633c-178d-4a1c-8d48-795807cea8bd req-d2c86925-85db-49c4-9782-a969627a9cee service nova] Acquiring lock "refresh_cache-fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:26:41 user nova-compute[71229]: DEBUG nova.network.neutron [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:26:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:26:42 user nova-compute[71229]: DEBUG nova.network.neutron [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Updating instance_info_cache with network_info: [{"id": "836289ee-6293-49b3-b0c2-7012ceae0c97", "address": "fa:16:3e:20:c1:85", "network": {"id": "80c5b877-1e8a-4e8f-8490-7cb77946f044", "bridge": "br-int", "label": "tempest-VolumesActionsTest-60003582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "14c9c879d28040aba0ebc76bc2a80693", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap836289ee-62", "ovs_interfaceid": "836289ee-6293-49b3-b0c2-7012ceae0c97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:26:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Releasing lock "refresh_cache-fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:26:42 user nova-compute[71229]: DEBUG nova.compute.manager [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Instance network_info: |[{"id": "836289ee-6293-49b3-b0c2-7012ceae0c97", "address": "fa:16:3e:20:c1:85", "network": {"id": "80c5b877-1e8a-4e8f-8490-7cb77946f044", "bridge": "br-int", "label": "tempest-VolumesActionsTest-60003582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "14c9c879d28040aba0ebc76bc2a80693", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap836289ee-62", "ovs_interfaceid": "836289ee-6293-49b3-b0c2-7012ceae0c97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 15:26:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-6652633c-178d-4a1c-8d48-795807cea8bd req-d2c86925-85db-49c4-9782-a969627a9cee service nova] Acquired lock "refresh_cache-fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:26:42 user nova-compute[71229]: DEBUG nova.network.neutron [req-6652633c-178d-4a1c-8d48-795807cea8bd req-d2c86925-85db-49c4-9782-a969627a9cee service nova] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Refreshing network info cache for port 836289ee-6293-49b3-b0c2-7012ceae0c97 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:26:42 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Start _get_guest_xml network_info=[{"id": "836289ee-6293-49b3-b0c2-7012ceae0c97", "address": "fa:16:3e:20:c1:85", "network": {"id": "80c5b877-1e8a-4e8f-8490-7cb77946f044", "bridge": "br-int", "label": "tempest-VolumesActionsTest-60003582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "14c9c879d28040aba0ebc76bc2a80693", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap836289ee-62", "ovs_interfaceid": "836289ee-6293-49b3-b0c2-7012ceae0c97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '52fe638c-5ada-47d5-b376-233bfa808a37'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:26:42 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:26:42 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:26:42 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:26:42 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:26:42 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:26:42 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:26:42 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:26:42 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:26:42 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:26:42 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:26:42 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:26:42 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:26:42 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:26:42 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:26:42 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:26:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1343431818',display_name='tempest-VolumesActionsTest-instance-1343431818',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1343431818',id=16,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14c9c879d28040aba0ebc76bc2a80693',ramdisk_id='',reservation_id='r-mk5dk8r9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-955235995',owner_user_name='tempest-VolumesActionsTest-955235995-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:26:40Z,user_data=None,user_id='90c7f9af6776413c91e2638712a142f7',uuid=fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "836289ee-6293-49b3-b0c2-7012ceae0c97", "address": "fa:16:3e:20:c1:85", "network": {"id": "80c5b877-1e8a-4e8f-8490-7cb77946f044", "bridge": "br-int", "label": "tempest-VolumesActionsTest-60003582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "14c9c879d28040aba0ebc76bc2a80693", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap836289ee-62", "ovs_interfaceid": "836289ee-6293-49b3-b0c2-7012ceae0c97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:26:42 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Converting VIF {"id": "836289ee-6293-49b3-b0c2-7012ceae0c97", "address": "fa:16:3e:20:c1:85", "network": {"id": "80c5b877-1e8a-4e8f-8490-7cb77946f044", "bridge": "br-int", "label": "tempest-VolumesActionsTest-60003582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "14c9c879d28040aba0ebc76bc2a80693", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap836289ee-62", "ovs_interfaceid": "836289ee-6293-49b3-b0c2-7012ceae0c97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:26:42 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:c1:85,bridge_name='br-int',has_traffic_filtering=True,id=836289ee-6293-49b3-b0c2-7012ceae0c97,network=Network(80c5b877-1e8a-4e8f-8490-7cb77946f044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap836289ee-62') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:26:42 user nova-compute[71229]: DEBUG nova.objects.instance [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Lazy-loading 'pci_devices' on Instance uuid fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:26:42 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:26:42 user nova-compute[71229]:   <uuid>fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5</uuid>
Apr 11 15:26:42 user nova-compute[71229]:   <name>instance-00000010</name>
Apr 11 15:26:42 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:26:42 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:26:42 user nova-compute[71229]:   <metadata>
Apr 11 15:26:42 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:26:42 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:26:42 user nova-compute[71229]:       <nova:name>tempest-VolumesActionsTest-instance-1343431818</nova:name>
Apr 11 15:26:42 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:26:42</nova:creationTime>
Apr 11 15:26:42 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:26:42 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:26:42 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:26:42 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:26:42 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:26:42 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:26:42 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:26:42 user nova-compute[71229]:       <nova:owner>
Apr 11 15:26:42 user nova-compute[71229]:         <nova:user uuid="90c7f9af6776413c91e2638712a142f7">tempest-VolumesActionsTest-955235995-project-member</nova:user>
Apr 11 15:26:42 user nova-compute[71229]:         <nova:project uuid="14c9c879d28040aba0ebc76bc2a80693">tempest-VolumesActionsTest-955235995</nova:project>
Apr 11 15:26:42 user nova-compute[71229]:       </nova:owner>
Apr 11 15:26:42 user nova-compute[71229]:       <nova:root type="image" uuid="52fe638c-5ada-47d5-b376-233bfa808a37"/>
Apr 11 15:26:42 user nova-compute[71229]:       <nova:ports>
Apr 11 15:26:42 user nova-compute[71229]:         <nova:port uuid="836289ee-6293-49b3-b0c2-7012ceae0c97">
Apr 11 15:26:42 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 11 15:26:42 user nova-compute[71229]:         </nova:port>
Apr 11 15:26:42 user nova-compute[71229]:       </nova:ports>
Apr 11 15:26:42 user nova-compute[71229]:     </nova:instance>
Apr 11 15:26:42 user nova-compute[71229]:   </metadata>
Apr 11 15:26:42 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:26:42 user nova-compute[71229]:     <system>
Apr 11 15:26:42 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:26:42 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:26:42 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:26:42 user nova-compute[71229]:       <entry name="serial">fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5</entry>
Apr 11 15:26:42 user nova-compute[71229]:       <entry name="uuid">fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5</entry>
Apr 11 15:26:42 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:26:42 user nova-compute[71229]:     </system>
Apr 11 15:26:42 user nova-compute[71229]:   </sysinfo>
Apr 11 15:26:42 user nova-compute[71229]:   <os>
Apr 11 15:26:42 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:26:42 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 15:26:42 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:26:42 user nova-compute[71229]:   </os>
Apr 11 15:26:42 user nova-compute[71229]:   <features>
Apr 11 15:26:42 user nova-compute[71229]:     <acpi/>
Apr 11 15:26:42 user nova-compute[71229]:     <apic/>
Apr 11 15:26:42 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:26:42 user nova-compute[71229]:   </features>
Apr 11 15:26:42 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:26:42 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:26:42 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:26:42 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:26:42 user nova-compute[71229]:   </clock>
Apr 11 15:26:42 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:26:42 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:26:42 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:26:42 user nova-compute[71229]:   </cpu>
Apr 11 15:26:42 user nova-compute[71229]:   <devices>
Apr 11 15:26:42 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 15:26:42 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 15:26:42 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5/disk"/>
Apr 11 15:26:42 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:26:42 user nova-compute[71229]:     </disk>
Apr 11 15:26:42 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:26:42 user nova-compute[71229]:       <mac address="fa:16:3e:20:c1:85"/>
Apr 11 15:26:42 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:26:42 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:26:42 user nova-compute[71229]:       <target dev="tap836289ee-62"/>
Apr 11 15:26:42 user nova-compute[71229]:     </interface>
Apr 11 15:26:42 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:26:42 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5/console.log" append="off"/>
Apr 11 15:26:42 user nova-compute[71229]:     </serial>
Apr 11 15:26:42 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:26:42 user nova-compute[71229]:     <video>
Apr 11 15:26:42 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:26:42 user nova-compute[71229]:     </video>
Apr 11 15:26:42 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:26:42 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:26:42 user nova-compute[71229]:     </rng>
Apr 11 15:26:42 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:26:42 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:26:42 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:26:42 user nova-compute[71229]:     </memballoon>
Apr 11 15:26:42 user nova-compute[71229]:   </devices>
Apr 11 15:26:42 user nova-compute[71229]: </domain>
Apr 11 15:26:42 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:26:42 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:26:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1343431818',display_name='tempest-VolumesActionsTest-instance-1343431818',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1343431818',id=16,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14c9c879d28040aba0ebc76bc2a80693',ramdisk_id='',reservation_id='r-mk5dk8r9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-955235995',owner_user_name='tempest-VolumesActionsTest-955235995-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:26:40Z,user_data=None,user_id='90c7f9af6776413c91e2638712a142f7',uuid=fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "836289ee-6293-49b3-b0c2-7012ceae0c97", "address": "fa:16:3e:20:c1:85", "network": {"id": "80c5b877-1e8a-4e8f-8490-7cb77946f044", "bridge": "br-int", "label": "tempest-VolumesActionsTest-60003582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "14c9c879d28040aba0ebc76bc2a80693", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap836289ee-62", "ovs_interfaceid": "836289ee-6293-49b3-b0c2-7012ceae0c97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:26:42 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Converting VIF {"id": "836289ee-6293-49b3-b0c2-7012ceae0c97", "address": "fa:16:3e:20:c1:85", "network": {"id": "80c5b877-1e8a-4e8f-8490-7cb77946f044", "bridge": "br-int", "label": "tempest-VolumesActionsTest-60003582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "14c9c879d28040aba0ebc76bc2a80693", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap836289ee-62", "ovs_interfaceid": "836289ee-6293-49b3-b0c2-7012ceae0c97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:26:42 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:c1:85,bridge_name='br-int',has_traffic_filtering=True,id=836289ee-6293-49b3-b0c2-7012ceae0c97,network=Network(80c5b877-1e8a-4e8f-8490-7cb77946f044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap836289ee-62') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:26:42 user nova-compute[71229]: DEBUG os_vif [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:c1:85,bridge_name='br-int',has_traffic_filtering=True,id=836289ee-6293-49b3-b0c2-7012ceae0c97,network=Network(80c5b877-1e8a-4e8f-8490-7cb77946f044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap836289ee-62') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:26:42 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:26:42 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:26:42 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:26:42 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:26:42 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap836289ee-62, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:26:42 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap836289ee-62, col_values=(('external_ids', {'iface-id': '836289ee-6293-49b3-b0c2-7012ceae0c97', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:c1:85', 'vm-uuid': 'fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:26:42 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:26:42 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:26:42 user nova-compute[71229]: INFO os_vif [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:c1:85,bridge_name='br-int',has_traffic_filtering=True,id=836289ee-6293-49b3-b0c2-7012ceae0c97,network=Network(80c5b877-1e8a-4e8f-8490-7cb77946f044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap836289ee-62')
Apr 11 15:26:42 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:26:42 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] No VIF found with MAC fa:16:3e:20:c1:85, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:26:42 user nova-compute[71229]: DEBUG nova.network.neutron [req-6652633c-178d-4a1c-8d48-795807cea8bd req-d2c86925-85db-49c4-9782-a969627a9cee service nova] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Updated VIF entry in instance network info cache for port 836289ee-6293-49b3-b0c2-7012ceae0c97. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:26:42 user nova-compute[71229]: DEBUG nova.network.neutron [req-6652633c-178d-4a1c-8d48-795807cea8bd req-d2c86925-85db-49c4-9782-a969627a9cee service nova] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Updating instance_info_cache with network_info: [{"id": "836289ee-6293-49b3-b0c2-7012ceae0c97", "address": "fa:16:3e:20:c1:85", "network": {"id": "80c5b877-1e8a-4e8f-8490-7cb77946f044", "bridge": "br-int", "label": "tempest-VolumesActionsTest-60003582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "14c9c879d28040aba0ebc76bc2a80693", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap836289ee-62", "ovs_interfaceid": "836289ee-6293-49b3-b0c2-7012ceae0c97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:26:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-6652633c-178d-4a1c-8d48-795807cea8bd req-d2c86925-85db-49c4-9782-a969627a9cee service nova] Releasing lock "refresh_cache-fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:26:43 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:26:43 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:26:43 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:26:43 user nova-compute[71229]: DEBUG nova.compute.manager [req-bf3e48c3-7f09-4026-8b01-092027b5c2d0 req-e885c760-31cf-4dfd-8627-9050a81212ac service nova] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Received event network-vif-plugged-836289ee-6293-49b3-b0c2-7012ceae0c97 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:26:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-bf3e48c3-7f09-4026-8b01-092027b5c2d0 req-e885c760-31cf-4dfd-8627-9050a81212ac service nova] Acquiring lock "fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:26:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-bf3e48c3-7f09-4026-8b01-092027b5c2d0 req-e885c760-31cf-4dfd-8627-9050a81212ac service nova] Lock "fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:26:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-bf3e48c3-7f09-4026-8b01-092027b5c2d0 req-e885c760-31cf-4dfd-8627-9050a81212ac service nova] Lock "fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:26:43 user nova-compute[71229]: DEBUG nova.compute.manager [req-bf3e48c3-7f09-4026-8b01-092027b5c2d0 req-e885c760-31cf-4dfd-8627-9050a81212ac service nova] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] No waiting events found dispatching network-vif-plugged-836289ee-6293-49b3-b0c2-7012ceae0c97 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:26:43 user nova-compute[71229]: WARNING nova.compute.manager [req-bf3e48c3-7f09-4026-8b01-092027b5c2d0 req-e885c760-31cf-4dfd-8627-9050a81212ac service nova] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Received unexpected event network-vif-plugged-836289ee-6293-49b3-b0c2-7012ceae0c97 for instance with vm_state building and task_state spawning.
Apr 11 15:26:45 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681226805.692062, fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5 => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:26:45 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] VM Resumed (Lifecycle Event)
Apr 11 15:26:45 user nova-compute[71229]: DEBUG nova.compute.manager [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 15:26:45 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Guest created on hypervisor {{(pid=71229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 15:26:45 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Instance spawned successfully.
Apr 11 15:26:45 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 15:26:45 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:26:45 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:26:45 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Found default for hw_cdrom_bus of ide {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:26:45 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Found default for hw_disk_bus of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:26:45 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Found default for hw_input_bus of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:26:45 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Found default for hw_pointer_model of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:26:45 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Found default for hw_video_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:26:45 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Found default for hw_vif_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:26:45 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:26:45 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681226805.695577, fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5 => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:26:45 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] VM Started (Lifecycle Event)
Apr 11 15:26:45 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:26:45 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:26:45 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:26:45 user nova-compute[71229]: INFO nova.compute.manager [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Took 5.40 seconds to spawn the instance on the hypervisor.
Apr 11 15:26:45 user nova-compute[71229]: DEBUG nova.compute.manager [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:26:45 user nova-compute[71229]: INFO nova.compute.manager [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Took 6.04 seconds to build instance.
Apr 11 15:26:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-466be1a9-7c05-4e27-80eb-1c06162bf86d tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Lock "fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.129s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:26:45 user nova-compute[71229]: DEBUG nova.compute.manager [req-df83a829-0c3b-43bf-8fb3-7720fab82698 req-763df361-e76b-4c05-bfe4-86d38ef7da90 service nova] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Received event network-vif-plugged-836289ee-6293-49b3-b0c2-7012ceae0c97 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:26:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-df83a829-0c3b-43bf-8fb3-7720fab82698 req-763df361-e76b-4c05-bfe4-86d38ef7da90 service nova] Acquiring lock "fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:26:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-df83a829-0c3b-43bf-8fb3-7720fab82698 req-763df361-e76b-4c05-bfe4-86d38ef7da90 service nova] Lock "fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:26:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-df83a829-0c3b-43bf-8fb3-7720fab82698 req-763df361-e76b-4c05-bfe4-86d38ef7da90 service nova] Lock "fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:26:45 user nova-compute[71229]: DEBUG nova.compute.manager [req-df83a829-0c3b-43bf-8fb3-7720fab82698 req-763df361-e76b-4c05-bfe4-86d38ef7da90 service nova] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] No waiting events found dispatching network-vif-plugged-836289ee-6293-49b3-b0c2-7012ceae0c97 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:26:45 user nova-compute[71229]: WARNING nova.compute.manager [req-df83a829-0c3b-43bf-8fb3-7720fab82698 req-763df361-e76b-4c05-bfe4-86d38ef7da90 service nova] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Received unexpected event network-vif-plugged-836289ee-6293-49b3-b0c2-7012ceae0c97 for instance with vm_state active and task_state None.
Apr 11 15:26:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:26:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:26:47 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:26:47 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Cleaning up deleted instances {{(pid=71229) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 15:26:47 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] There are 0 instances to clean {{(pid=71229) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 15:26:50 user nova-compute[71229]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681226795.1170914, 39e3dfb1-bc09-474d-b8cb-f01b11923eae => Stopped> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:26:50 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] VM Stopped (Lifecycle Event)
Apr 11 15:26:50 user nova-compute[71229]: DEBUG nova.compute.manager [None req-b67e674c-1816-43c7-8fbf-3c327425b574 None None] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:26:51 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:26:51 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:26:52 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:26:53 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Acquiring lock "f846ecc9-ecc4-4e8f-aca3-39d83b56f414" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:26:53 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "f846ecc9-ecc4-4e8f-aca3-39d83b56f414" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:26:53 user nova-compute[71229]: DEBUG nova.compute.manager [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Starting instance... {{(pid=71229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 15:26:53 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:26:53 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:26:53 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 15:26:53 user nova-compute[71229]: INFO nova.compute.claims [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Claim successful on node user
Apr 11 15:26:53 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:26:53 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:26:53 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:26:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.360s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:26:54 user nova-compute[71229]: DEBUG nova.compute.manager [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Start building networks asynchronously for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 15:26:54 user nova-compute[71229]: DEBUG nova.compute.manager [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Allocating IP information in the background. {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 15:26:54 user nova-compute[71229]: DEBUG nova.network.neutron [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] allocate_for_instance() {{(pid=71229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 15:26:54 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 15:26:54 user nova-compute[71229]: DEBUG nova.compute.manager [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Start building block device mappings for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 15:26:54 user nova-compute[71229]: DEBUG nova.policy [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b2538af5c739404aa433b766976e5b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '561130d089c8415297697bcedc93aefc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71229) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 15:26:54 user nova-compute[71229]: DEBUG nova.compute.manager [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Start spawning the instance on the hypervisor. {{(pid=71229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 15:26:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Creating instance directory {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 15:26:54 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Creating image(s)
Apr 11 15:26:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Acquiring lock "/opt/stack/data/nova/instances/f846ecc9-ecc4-4e8f-aca3-39d83b56f414/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:26:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "/opt/stack/data/nova/instances/f846ecc9-ecc4-4e8f-aca3-39d83b56f414/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:26:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "/opt/stack/data/nova/instances/f846ecc9-ecc4-4e8f-aca3-39d83b56f414/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:26:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:26:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.242s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:26:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Acquiring lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:26:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:26:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:26:54 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:26:54 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:26:54 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:26:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.154s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:26:54 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:26:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/f846ecc9-ecc4-4e8f-aca3-39d83b56f414/disk 1073741824 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:26:54 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:26:54 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 15:26:54 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:26:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/f846ecc9-ecc4-4e8f-aca3-39d83b56f414/disk 1073741824" returned: 0 in 0.068s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:26:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:26:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:26:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:26:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:26:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:26:54 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 15:26:54 user nova-compute[71229]: DEBUG nova.network.neutron [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Successfully created port: ce99a25f-dfdb-4798-8830-d2f4a66e6cc8 {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 15:26:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.169s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:26:54 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f846ecc9-ecc4-4e8f-aca3-39d83b56f414/disk. size=1073741824 {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 15:26:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f846ecc9-ecc4-4e8f-aca3-39d83b56f414/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:26:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f846ecc9-ecc4-4e8f-aca3-39d83b56f414/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:26:55 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Cannot resize image /opt/stack/data/nova/instances/f846ecc9-ecc4-4e8f-aca3-39d83b56f414/disk to a smaller size. {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 15:26:55 user nova-compute[71229]: DEBUG nova.objects.instance [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lazy-loading 'migration_context' on Instance uuid f846ecc9-ecc4-4e8f-aca3-39d83b56f414 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:26:55 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Created local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 15:26:55 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Ensure instance console log exists: /opt/stack/data/nova/instances/f846ecc9-ecc4-4e8f-aca3-39d83b56f414/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 15:26:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:26:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:26:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:26:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:26:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:26:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:26:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:26:55 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:26:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0d90fd2-6a95-43c4-8756-e82071d99154/disk.rescue --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:26:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0d90fd2-6a95-43c4-8756-e82071d99154/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:26:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0d90fd2-6a95-43c4-8756-e82071d99154/disk.rescue --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:26:55 user nova-compute[71229]: DEBUG nova.network.neutron [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Successfully updated port: ce99a25f-dfdb-4798-8830-d2f4a66e6cc8 {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:26:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Acquiring lock "refresh_cache-f846ecc9-ecc4-4e8f-aca3-39d83b56f414" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:26:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Acquired lock "refresh_cache-f846ecc9-ecc4-4e8f-aca3-39d83b56f414" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:26:55 user nova-compute[71229]: DEBUG nova.network.neutron [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:26:55 user nova-compute[71229]: DEBUG nova.compute.manager [req-bbdcbb1a-b73e-4253-a2bd-301b075ae4c2 req-3c85ad82-67d9-4d1c-b9c2-82434b042852 service nova] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Received event network-changed-ce99a25f-dfdb-4798-8830-d2f4a66e6cc8 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:26:55 user nova-compute[71229]: DEBUG nova.compute.manager [req-bbdcbb1a-b73e-4253-a2bd-301b075ae4c2 req-3c85ad82-67d9-4d1c-b9c2-82434b042852 service nova] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Refreshing instance network info cache due to event network-changed-ce99a25f-dfdb-4798-8830-d2f4a66e6cc8. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:26:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-bbdcbb1a-b73e-4253-a2bd-301b075ae4c2 req-3c85ad82-67d9-4d1c-b9c2-82434b042852 service nova] Acquiring lock "refresh_cache-f846ecc9-ecc4-4e8f-aca3-39d83b56f414" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:26:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0d90fd2-6a95-43c4-8756-e82071d99154/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:26:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4555892-7abb-4a3c-a4ae-a27ad4902708/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:26:55 user nova-compute[71229]: DEBUG nova.network.neutron [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:26:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4555892-7abb-4a3c-a4ae-a27ad4902708/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:26:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4555892-7abb-4a3c-a4ae-a27ad4902708/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:26:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4555892-7abb-4a3c-a4ae-a27ad4902708/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:26:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a06747-0f43-4731-87e6-40629c382a6b/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:26:56 user nova-compute[71229]: DEBUG nova.network.neutron [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Updating instance_info_cache with network_info: [{"id": "ce99a25f-dfdb-4798-8830-d2f4a66e6cc8", "address": "fa:16:3e:33:21:56", "network": {"id": "f9b1d398-27cb-42de-9d95-0e031b1bd6ec", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1833751152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "561130d089c8415297697bcedc93aefc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce99a25f-df", "ovs_interfaceid": "ce99a25f-dfdb-4798-8830-d2f4a66e6cc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:26:56 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Releasing lock "refresh_cache-f846ecc9-ecc4-4e8f-aca3-39d83b56f414" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:26:56 user nova-compute[71229]: DEBUG nova.compute.manager [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Instance network_info: |[{"id": "ce99a25f-dfdb-4798-8830-d2f4a66e6cc8", "address": "fa:16:3e:33:21:56", "network": {"id": "f9b1d398-27cb-42de-9d95-0e031b1bd6ec", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1833751152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "561130d089c8415297697bcedc93aefc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce99a25f-df", "ovs_interfaceid": "ce99a25f-dfdb-4798-8830-d2f4a66e6cc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 15:26:56 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-bbdcbb1a-b73e-4253-a2bd-301b075ae4c2 req-3c85ad82-67d9-4d1c-b9c2-82434b042852 service nova] Acquired lock "refresh_cache-f846ecc9-ecc4-4e8f-aca3-39d83b56f414" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:26:56 user nova-compute[71229]: DEBUG nova.network.neutron [req-bbdcbb1a-b73e-4253-a2bd-301b075ae4c2 req-3c85ad82-67d9-4d1c-b9c2-82434b042852 service nova] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Refreshing network info cache for port ce99a25f-dfdb-4798-8830-d2f4a66e6cc8 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:26:56 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Start _get_guest_xml network_info=[{"id": "ce99a25f-dfdb-4798-8830-d2f4a66e6cc8", "address": "fa:16:3e:33:21:56", "network": {"id": "f9b1d398-27cb-42de-9d95-0e031b1bd6ec", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1833751152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "561130d089c8415297697bcedc93aefc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce99a25f-df", "ovs_interfaceid": "ce99a25f-dfdb-4798-8830-d2f4a66e6cc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '52fe638c-5ada-47d5-b376-233bfa808a37'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:26:56 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:26:56 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:26:56 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:26:56 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:26:56 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:26:56 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:26:56 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:26:56 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:26:56 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:26:56 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:26:56 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:26:56 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:26:56 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:26:56 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:26:56 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:26:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-791973205',display_name='tempest-ServersNegativeTestJSON-server-791973205',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-791973205',id=17,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='561130d089c8415297697bcedc93aefc',ramdisk_id='',reservation_id='r-l971skxg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1004375615',owner_user_name='tempest-ServersNegativeTestJSON-1004375615-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:26:54Z,user_data=None,user_id='b2538af5c739404aa433b766976e5b2d',uuid=f846ecc9-ecc4-4e8f-aca3-39d83b56f414,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce99a25f-dfdb-4798-8830-d2f4a66e6cc8", "address": "fa:16:3e:33:21:56", "network": {"id": "f9b1d398-27cb-42de-9d95-0e031b1bd6ec", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1833751152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "561130d089c8415297697bcedc93aefc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce99a25f-df", "ovs_interfaceid": "ce99a25f-dfdb-4798-8830-d2f4a66e6cc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:26:56 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Converting VIF {"id": "ce99a25f-dfdb-4798-8830-d2f4a66e6cc8", "address": "fa:16:3e:33:21:56", "network": {"id": "f9b1d398-27cb-42de-9d95-0e031b1bd6ec", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1833751152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "561130d089c8415297697bcedc93aefc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce99a25f-df", "ovs_interfaceid": "ce99a25f-dfdb-4798-8830-d2f4a66e6cc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:26:56 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:21:56,bridge_name='br-int',has_traffic_filtering=True,id=ce99a25f-dfdb-4798-8830-d2f4a66e6cc8,network=Network(f9b1d398-27cb-42de-9d95-0e031b1bd6ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce99a25f-df') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:26:56 user nova-compute[71229]: DEBUG nova.objects.instance [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lazy-loading 'pci_devices' on Instance uuid f846ecc9-ecc4-4e8f-aca3-39d83b56f414 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:26:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a06747-0f43-4731-87e6-40629c382a6b/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:26:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a06747-0f43-4731-87e6-40629c382a6b/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:26:56 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:26:56 user nova-compute[71229]:   <uuid>f846ecc9-ecc4-4e8f-aca3-39d83b56f414</uuid>
Apr 11 15:26:56 user nova-compute[71229]:   <name>instance-00000011</name>
Apr 11 15:26:56 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:26:56 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:26:56 user nova-compute[71229]:   <metadata>
Apr 11 15:26:56 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:26:56 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:26:56 user nova-compute[71229]:       <nova:name>tempest-ServersNegativeTestJSON-server-791973205</nova:name>
Apr 11 15:26:56 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:26:56</nova:creationTime>
Apr 11 15:26:56 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:26:56 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:26:56 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:26:56 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:26:56 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:26:56 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:26:56 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:26:56 user nova-compute[71229]:       <nova:owner>
Apr 11 15:26:56 user nova-compute[71229]:         <nova:user uuid="b2538af5c739404aa433b766976e5b2d">tempest-ServersNegativeTestJSON-1004375615-project-member</nova:user>
Apr 11 15:26:56 user nova-compute[71229]:         <nova:project uuid="561130d089c8415297697bcedc93aefc">tempest-ServersNegativeTestJSON-1004375615</nova:project>
Apr 11 15:26:56 user nova-compute[71229]:       </nova:owner>
Apr 11 15:26:56 user nova-compute[71229]:       <nova:root type="image" uuid="52fe638c-5ada-47d5-b376-233bfa808a37"/>
Apr 11 15:26:56 user nova-compute[71229]:       <nova:ports>
Apr 11 15:26:56 user nova-compute[71229]:         <nova:port uuid="ce99a25f-dfdb-4798-8830-d2f4a66e6cc8">
Apr 11 15:26:56 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 11 15:26:56 user nova-compute[71229]:         </nova:port>
Apr 11 15:26:56 user nova-compute[71229]:       </nova:ports>
Apr 11 15:26:56 user nova-compute[71229]:     </nova:instance>
Apr 11 15:26:56 user nova-compute[71229]:   </metadata>
Apr 11 15:26:56 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:26:56 user nova-compute[71229]:     <system>
Apr 11 15:26:56 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:26:56 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:26:56 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:26:56 user nova-compute[71229]:       <entry name="serial">f846ecc9-ecc4-4e8f-aca3-39d83b56f414</entry>
Apr 11 15:26:56 user nova-compute[71229]:       <entry name="uuid">f846ecc9-ecc4-4e8f-aca3-39d83b56f414</entry>
Apr 11 15:26:56 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:26:56 user nova-compute[71229]:     </system>
Apr 11 15:26:56 user nova-compute[71229]:   </sysinfo>
Apr 11 15:26:56 user nova-compute[71229]:   <os>
Apr 11 15:26:56 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:26:56 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 15:26:56 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:26:56 user nova-compute[71229]:   </os>
Apr 11 15:26:56 user nova-compute[71229]:   <features>
Apr 11 15:26:56 user nova-compute[71229]:     <acpi/>
Apr 11 15:26:56 user nova-compute[71229]:     <apic/>
Apr 11 15:26:56 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:26:56 user nova-compute[71229]:   </features>
Apr 11 15:26:56 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:26:56 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:26:56 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:26:56 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:26:56 user nova-compute[71229]:   </clock>
Apr 11 15:26:56 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:26:56 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:26:56 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:26:56 user nova-compute[71229]:   </cpu>
Apr 11 15:26:56 user nova-compute[71229]:   <devices>
Apr 11 15:26:56 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 15:26:56 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 15:26:56 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/f846ecc9-ecc4-4e8f-aca3-39d83b56f414/disk"/>
Apr 11 15:26:56 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:26:56 user nova-compute[71229]:     </disk>
Apr 11 15:26:56 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:26:56 user nova-compute[71229]:       <mac address="fa:16:3e:33:21:56"/>
Apr 11 15:26:56 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:26:56 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:26:56 user nova-compute[71229]:       <target dev="tapce99a25f-df"/>
Apr 11 15:26:56 user nova-compute[71229]:     </interface>
Apr 11 15:26:56 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:26:56 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/f846ecc9-ecc4-4e8f-aca3-39d83b56f414/console.log" append="off"/>
Apr 11 15:26:56 user nova-compute[71229]:     </serial>
Apr 11 15:26:56 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:26:56 user nova-compute[71229]:     <video>
Apr 11 15:26:56 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:26:56 user nova-compute[71229]:     </video>
Apr 11 15:26:56 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:26:56 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:26:56 user nova-compute[71229]:     </rng>
Apr 11 15:26:56 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:26:56 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:26:56 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:26:56 user nova-compute[71229]:     </memballoon>
Apr 11 15:26:56 user nova-compute[71229]:   </devices>
Apr 11 15:26:56 user nova-compute[71229]: </domain>
Apr 11 15:26:56 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:26:56 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:26:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-791973205',display_name='tempest-ServersNegativeTestJSON-server-791973205',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-791973205',id=17,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='561130d089c8415297697bcedc93aefc',ramdisk_id='',reservation_id='r-l971skxg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1004375615',owner_user_name='tempest-ServersNegativeTestJSON-1004375615-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:26:54Z,user_data=None,user_id='b2538af5c739404aa433b766976e5b2d',uuid=f846ecc9-ecc4-4e8f-aca3-39d83b56f414,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce99a25f-dfdb-4798-8830-d2f4a66e6cc8", "address": "fa:16:3e:33:21:56", "network": {"id": "f9b1d398-27cb-42de-9d95-0e031b1bd6ec", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1833751152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "561130d089c8415297697bcedc93aefc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce99a25f-df", "ovs_interfaceid": "ce99a25f-dfdb-4798-8830-d2f4a66e6cc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:26:56 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Converting VIF {"id": "ce99a25f-dfdb-4798-8830-d2f4a66e6cc8", "address": "fa:16:3e:33:21:56", "network": {"id": "f9b1d398-27cb-42de-9d95-0e031b1bd6ec", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1833751152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "561130d089c8415297697bcedc93aefc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce99a25f-df", "ovs_interfaceid": "ce99a25f-dfdb-4798-8830-d2f4a66e6cc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:26:56 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:21:56,bridge_name='br-int',has_traffic_filtering=True,id=ce99a25f-dfdb-4798-8830-d2f4a66e6cc8,network=Network(f9b1d398-27cb-42de-9d95-0e031b1bd6ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce99a25f-df') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:26:56 user nova-compute[71229]: DEBUG os_vif [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:21:56,bridge_name='br-int',has_traffic_filtering=True,id=ce99a25f-dfdb-4798-8830-d2f4a66e6cc8,network=Network(f9b1d398-27cb-42de-9d95-0e031b1bd6ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce99a25f-df') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:26:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:26:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:26:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:26:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:26:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce99a25f-df, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:26:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapce99a25f-df, col_values=(('external_ids', {'iface-id': 'ce99a25f-dfdb-4798-8830-d2f4a66e6cc8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:21:56', 'vm-uuid': 'f846ecc9-ecc4-4e8f-aca3-39d83b56f414'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:26:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:26:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:26:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:26:56 user nova-compute[71229]: INFO os_vif [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:21:56,bridge_name='br-int',has_traffic_filtering=True,id=ce99a25f-dfdb-4798-8830-d2f4a66e6cc8,network=Network(f9b1d398-27cb-42de-9d95-0e031b1bd6ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce99a25f-df')
Apr 11 15:26:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a06747-0f43-4731-87e6-40629c382a6b/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:26:56 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:26:56 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] No VIF found with MAC fa:16:3e:33:21:56, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:26:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:26:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:26:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:26:57 user nova-compute[71229]: DEBUG nova.network.neutron [req-bbdcbb1a-b73e-4253-a2bd-301b075ae4c2 req-3c85ad82-67d9-4d1c-b9c2-82434b042852 service nova] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Updated VIF entry in instance network info cache for port ce99a25f-dfdb-4798-8830-d2f4a66e6cc8. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:26:57 user nova-compute[71229]: DEBUG nova.network.neutron [req-bbdcbb1a-b73e-4253-a2bd-301b075ae4c2 req-3c85ad82-67d9-4d1c-b9c2-82434b042852 service nova] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Updating instance_info_cache with network_info: [{"id": "ce99a25f-dfdb-4798-8830-d2f4a66e6cc8", "address": "fa:16:3e:33:21:56", "network": {"id": "f9b1d398-27cb-42de-9d95-0e031b1bd6ec", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1833751152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "561130d089c8415297697bcedc93aefc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce99a25f-df", "ovs_interfaceid": "ce99a25f-dfdb-4798-8830-d2f4a66e6cc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:26:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:26:57 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-bbdcbb1a-b73e-4253-a2bd-301b075ae4c2 req-3c85ad82-67d9-4d1c-b9c2-82434b042852 service nova] Releasing lock "refresh_cache-f846ecc9-ecc4-4e8f-aca3-39d83b56f414" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:26:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:26:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:26:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:26:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json" returned: 0 in 0.370s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:26:57 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:27:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:02 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681226822.2363207, f846ecc9-ecc4-4e8f-aca3-39d83b56f414 => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:27:02 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] VM Resumed (Lifecycle Event)
Apr 11 15:27:02 user nova-compute[71229]: DEBUG nova.compute.manager [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 15:27:02 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Guest created on hypervisor {{(pid=71229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 15:27:02 user nova-compute[71229]: DEBUG nova.compute.manager [req-d46a35a2-2a47-4ecf-8bb0-2fd401272ffd req-8f21a29b-2808-4c88-85b3-b7bdcfee8154 service nova] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Received event network-vif-plugged-ce99a25f-dfdb-4798-8830-d2f4a66e6cc8 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:27:02 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-d46a35a2-2a47-4ecf-8bb0-2fd401272ffd req-8f21a29b-2808-4c88-85b3-b7bdcfee8154 service nova] Acquiring lock "f846ecc9-ecc4-4e8f-aca3-39d83b56f414-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:27:02 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-d46a35a2-2a47-4ecf-8bb0-2fd401272ffd req-8f21a29b-2808-4c88-85b3-b7bdcfee8154 service nova] Lock "f846ecc9-ecc4-4e8f-aca3-39d83b56f414-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:27:02 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-d46a35a2-2a47-4ecf-8bb0-2fd401272ffd req-8f21a29b-2808-4c88-85b3-b7bdcfee8154 service nova] Lock "f846ecc9-ecc4-4e8f-aca3-39d83b56f414-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:27:02 user nova-compute[71229]: DEBUG nova.compute.manager [req-d46a35a2-2a47-4ecf-8bb0-2fd401272ffd req-8f21a29b-2808-4c88-85b3-b7bdcfee8154 service nova] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] No waiting events found dispatching network-vif-plugged-ce99a25f-dfdb-4798-8830-d2f4a66e6cc8 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:27:02 user nova-compute[71229]: WARNING nova.compute.manager [req-d46a35a2-2a47-4ecf-8bb0-2fd401272ffd req-8f21a29b-2808-4c88-85b3-b7bdcfee8154 service nova] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Received unexpected event network-vif-plugged-ce99a25f-dfdb-4798-8830-d2f4a66e6cc8 for instance with vm_state building and task_state spawning.
Apr 11 15:27:02 user nova-compute[71229]: DEBUG nova.compute.manager [req-9f6a42c6-08a5-45f9-815a-82319c04ea97 req-974fb18d-d93f-4ed6-ac44-a0c4601f2a21 service nova] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Received event network-vif-plugged-ce99a25f-dfdb-4798-8830-d2f4a66e6cc8 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:27:02 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-9f6a42c6-08a5-45f9-815a-82319c04ea97 req-974fb18d-d93f-4ed6-ac44-a0c4601f2a21 service nova] Acquiring lock "f846ecc9-ecc4-4e8f-aca3-39d83b56f414-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:27:02 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-9f6a42c6-08a5-45f9-815a-82319c04ea97 req-974fb18d-d93f-4ed6-ac44-a0c4601f2a21 service nova] Lock "f846ecc9-ecc4-4e8f-aca3-39d83b56f414-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:27:02 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-9f6a42c6-08a5-45f9-815a-82319c04ea97 req-974fb18d-d93f-4ed6-ac44-a0c4601f2a21 service nova] Lock "f846ecc9-ecc4-4e8f-aca3-39d83b56f414-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:27:02 user nova-compute[71229]: DEBUG nova.compute.manager [req-9f6a42c6-08a5-45f9-815a-82319c04ea97 req-974fb18d-d93f-4ed6-ac44-a0c4601f2a21 service nova] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] No waiting events found dispatching network-vif-plugged-ce99a25f-dfdb-4798-8830-d2f4a66e6cc8 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:27:02 user nova-compute[71229]: WARNING nova.compute.manager [req-9f6a42c6-08a5-45f9-815a-82319c04ea97 req-974fb18d-d93f-4ed6-ac44-a0c4601f2a21 service nova] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Received unexpected event network-vif-plugged-ce99a25f-dfdb-4798-8830-d2f4a66e6cc8 for instance with vm_state building and task_state spawning.
Apr 11 15:27:02 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:27:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:27:02 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:27:02 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:27:02 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:27:02 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8215MB free_disk=25.77798843383789GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 15:27:02 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:27:02 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:27:02 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4e5d3fb0-a0b4-4423-9460-f2faac2cbd9e tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "f3a06747-0f43-4731-87e6-40629c382a6b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:27:02 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4e5d3fb0-a0b4-4423-9460-f2faac2cbd9e tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "f3a06747-0f43-4731-87e6-40629c382a6b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:27:02 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4e5d3fb0-a0b4-4423-9460-f2faac2cbd9e tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "f3a06747-0f43-4731-87e6-40629c382a6b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:27:02 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4e5d3fb0-a0b4-4423-9460-f2faac2cbd9e tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "f3a06747-0f43-4731-87e6-40629c382a6b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:27:02 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4e5d3fb0-a0b4-4423-9460-f2faac2cbd9e tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "f3a06747-0f43-4731-87e6-40629c382a6b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:27:02 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Instance spawned successfully.
Apr 11 15:27:02 user nova-compute[71229]: INFO nova.compute.manager [None req-4e5d3fb0-a0b4-4423-9460-f2faac2cbd9e tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Terminating instance
Apr 11 15:27:02 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 15:27:02 user nova-compute[71229]: DEBUG nova.compute.manager [None req-4e5d3fb0-a0b4-4423-9460-f2faac2cbd9e tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Start destroying the instance on the hypervisor. {{(pid=71229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 15:27:02 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:27:02 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681226822.2400339, f846ecc9-ecc4-4e8f-aca3-39d83b56f414 => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:27:02 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] VM Started (Lifecycle Event)
Apr 11 15:27:02 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Found default for hw_cdrom_bus of ide {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:27:02 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Found default for hw_disk_bus of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:27:02 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Found default for hw_input_bus of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:27:02 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Found default for hw_pointer_model of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:27:02 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Found default for hw_video_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:27:02 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Found default for hw_vif_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:27:02 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:27:02 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:27:02 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:27:02 user nova-compute[71229]: INFO nova.compute.manager [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Took 8.47 seconds to spawn the instance on the hypervisor.
Apr 11 15:27:02 user nova-compute[71229]: DEBUG nova.compute.manager [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:27:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:02 user nova-compute[71229]: INFO nova.compute.manager [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Took 9.22 seconds to build instance.
Apr 11 15:27:02 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance de1a45fd-27be-4438-80a4-2f3a100643c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:27:02 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 6a805345-374c-4326-9e8f-39bfc7947a35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:27:02 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance f3a06747-0f43-4731-87e6-40629c382a6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:27:02 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance b0d90fd2-6a95-43c4-8756-e82071d99154 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:27:02 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance e4555892-7abb-4a3c-a4ae-a27ad4902708 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:27:02 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:27:02 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance f846ecc9-ecc4-4e8f-aca3-39d83b56f414 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:27:02 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 15:27:02 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 15:27:02 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c320f2a0-227f-4fd6-8353-f04f1085b291 tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "f846ecc9-ecc4-4e8f-aca3-39d83b56f414" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.342s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:27:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:03 user nova-compute[71229]: DEBUG nova.compute.manager [req-4ef27147-0a57-4044-8446-339f1f1f3337 req-8bcb4781-3a8d-49fb-b628-ebe51ac4f0f8 service nova] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Received event network-vif-unplugged-a7049f98-5ea1-4167-be7f-3206830f17c4 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:27:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4ef27147-0a57-4044-8446-339f1f1f3337 req-8bcb4781-3a8d-49fb-b628-ebe51ac4f0f8 service nova] Acquiring lock "f3a06747-0f43-4731-87e6-40629c382a6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:27:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4ef27147-0a57-4044-8446-339f1f1f3337 req-8bcb4781-3a8d-49fb-b628-ebe51ac4f0f8 service nova] Lock "f3a06747-0f43-4731-87e6-40629c382a6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:27:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4ef27147-0a57-4044-8446-339f1f1f3337 req-8bcb4781-3a8d-49fb-b628-ebe51ac4f0f8 service nova] Lock "f3a06747-0f43-4731-87e6-40629c382a6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:27:03 user nova-compute[71229]: DEBUG nova.compute.manager [req-4ef27147-0a57-4044-8446-339f1f1f3337 req-8bcb4781-3a8d-49fb-b628-ebe51ac4f0f8 service nova] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] No waiting events found dispatching network-vif-unplugged-a7049f98-5ea1-4167-be7f-3206830f17c4 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:27:03 user nova-compute[71229]: DEBUG nova.compute.manager [req-4ef27147-0a57-4044-8446-339f1f1f3337 req-8bcb4781-3a8d-49fb-b628-ebe51ac4f0f8 service nova] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Received event network-vif-unplugged-a7049f98-5ea1-4167-be7f-3206830f17c4 for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 15:27:03 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:27:03 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:27:03 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 15:27:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.698s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:27:03 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:27:03 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71229) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 15:27:03 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Instance destroyed successfully.
Apr 11 15:27:03 user nova-compute[71229]: DEBUG nova.objects.instance [None req-4e5d3fb0-a0b4-4423-9460-f2faac2cbd9e tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lazy-loading 'resources' on Instance uuid f3a06747-0f43-4731-87e6-40629c382a6b {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:27:03 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-4e5d3fb0-a0b4-4423-9460-f2faac2cbd9e tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:21:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-299929658',display_name='tempest-VolumesAdminNegativeTest-server-299929658',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-299929658',id=6,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7+kKApk4z8FCEvSKm9HfkBqfdxWArp+jnXBl4IzRHHwFU8PNMf4o+BnC57wgCpXRd4hoyh/vOZAwA+9ZsLsFmqPY0D3TlKuGhbcr3CvY7kzHuI+987FATt2twOLazm+w==',key_name='tempest-keypair-1249294022',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:21:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='da140971126a4d298ff718275e7a22ec',ramdisk_id='',reservation_id='r-4bm6ve02',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-2033224639',owner_user_name='tempest-VolumesAdminNegativeTest-2033224639-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:21:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2717e456dcc941899c48c3c973083bd4',uuid=f3a06747-0f43-4731-87e6-40629c382a6b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7049f98-5ea1-4167-be7f-3206830f17c4", "address": "fa:16:3e:74:02:c7", "network": {"id": "f52bd4a9-1843-408b-85af-c2124ad01be7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-593462205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da140971126a4d298ff718275e7a22ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7049f98-5e", "ovs_interfaceid": "a7049f98-5ea1-4167-be7f-3206830f17c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:27:03 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-4e5d3fb0-a0b4-4423-9460-f2faac2cbd9e tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Converting VIF {"id": "a7049f98-5ea1-4167-be7f-3206830f17c4", "address": "fa:16:3e:74:02:c7", "network": {"id": "f52bd4a9-1843-408b-85af-c2124ad01be7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-593462205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da140971126a4d298ff718275e7a22ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7049f98-5e", "ovs_interfaceid": "a7049f98-5ea1-4167-be7f-3206830f17c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:27:03 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-4e5d3fb0-a0b4-4423-9460-f2faac2cbd9e tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:02:c7,bridge_name='br-int',has_traffic_filtering=True,id=a7049f98-5ea1-4167-be7f-3206830f17c4,network=Network(f52bd4a9-1843-408b-85af-c2124ad01be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7049f98-5e') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:27:03 user nova-compute[71229]: DEBUG os_vif [None req-4e5d3fb0-a0b4-4423-9460-f2faac2cbd9e tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:02:c7,bridge_name='br-int',has_traffic_filtering=True,id=a7049f98-5ea1-4167-be7f-3206830f17c4,network=Network(f52bd4a9-1843-408b-85af-c2124ad01be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7049f98-5e') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:27:03 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:03 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa7049f98-5e, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:27:03 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:27:03 user nova-compute[71229]: INFO os_vif [None req-4e5d3fb0-a0b4-4423-9460-f2faac2cbd9e tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:02:c7,bridge_name='br-int',has_traffic_filtering=True,id=a7049f98-5ea1-4167-be7f-3206830f17c4,network=Network(f52bd4a9-1843-408b-85af-c2124ad01be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7049f98-5e')
Apr 11 15:27:03 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-4e5d3fb0-a0b4-4423-9460-f2faac2cbd9e tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Deleting instance files /opt/stack/data/nova/instances/f3a06747-0f43-4731-87e6-40629c382a6b_del
Apr 11 15:27:03 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-4e5d3fb0-a0b4-4423-9460-f2faac2cbd9e tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Deletion of /opt/stack/data/nova/instances/f3a06747-0f43-4731-87e6-40629c382a6b_del complete
Apr 11 15:27:03 user nova-compute[71229]: INFO nova.compute.manager [None req-4e5d3fb0-a0b4-4423-9460-f2faac2cbd9e tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Took 1.33 seconds to destroy the instance on the hypervisor.
Apr 11 15:27:03 user nova-compute[71229]: DEBUG oslo.service.loopingcall [None req-4e5d3fb0-a0b4-4423-9460-f2faac2cbd9e tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71229) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 15:27:04 user nova-compute[71229]: DEBUG nova.compute.manager [-] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Deallocating network for instance {{(pid=71229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 15:27:04 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] deallocate_for_instance() {{(pid=71229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 15:27:04 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:27:04 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:27:04 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 15:27:04 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Rebuilding the list of instances to heal {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 15:27:04 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Skipping network cache update for instance because it is being deleted. {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9809}}
Apr 11 15:27:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "refresh_cache-de1a45fd-27be-4438-80a4-2f3a100643c9" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:27:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquired lock "refresh_cache-de1a45fd-27be-4438-80a4-2f3a100643c9" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:27:04 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Forcefully refreshing network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 15:27:04 user nova-compute[71229]: DEBUG nova.objects.instance [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lazy-loading 'info_cache' on Instance uuid de1a45fd-27be-4438-80a4-2f3a100643c9 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:27:05 user nova-compute[71229]: DEBUG nova.compute.manager [req-dcf91874-f222-42a6-a709-4b756bfe60d0 req-dc730c59-81a7-4c8f-9369-76d58f968618 service nova] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Received event network-vif-plugged-a7049f98-5ea1-4167-be7f-3206830f17c4 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:27:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-dcf91874-f222-42a6-a709-4b756bfe60d0 req-dc730c59-81a7-4c8f-9369-76d58f968618 service nova] Acquiring lock "f3a06747-0f43-4731-87e6-40629c382a6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:27:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-dcf91874-f222-42a6-a709-4b756bfe60d0 req-dc730c59-81a7-4c8f-9369-76d58f968618 service nova] Lock "f3a06747-0f43-4731-87e6-40629c382a6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:27:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-dcf91874-f222-42a6-a709-4b756bfe60d0 req-dc730c59-81a7-4c8f-9369-76d58f968618 service nova] Lock "f3a06747-0f43-4731-87e6-40629c382a6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:27:05 user nova-compute[71229]: DEBUG nova.compute.manager [req-dcf91874-f222-42a6-a709-4b756bfe60d0 req-dc730c59-81a7-4c8f-9369-76d58f968618 service nova] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] No waiting events found dispatching network-vif-plugged-a7049f98-5ea1-4167-be7f-3206830f17c4 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:27:05 user nova-compute[71229]: WARNING nova.compute.manager [req-dcf91874-f222-42a6-a709-4b756bfe60d0 req-dc730c59-81a7-4c8f-9369-76d58f968618 service nova] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Received unexpected event network-vif-plugged-a7049f98-5ea1-4167-be7f-3206830f17c4 for instance with vm_state active and task_state deleting.
Apr 11 15:27:05 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:27:05 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Took 1.28 seconds to deallocate network for instance.
Apr 11 15:27:05 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Updating instance_info_cache with network_info: [{"id": "197ae974-459a-49ab-9d70-89bfaa073f50", "address": "fa:16:3e:03:bb:91", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ae974-45", "ovs_interfaceid": "197ae974-459a-49ab-9d70-89bfaa073f50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:27:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4e5d3fb0-a0b4-4423-9460-f2faac2cbd9e tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:27:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4e5d3fb0-a0b4-4423-9460-f2faac2cbd9e tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:27:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Releasing lock "refresh_cache-de1a45fd-27be-4438-80a4-2f3a100643c9" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:27:05 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Updated the network info_cache for instance {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 15:27:05 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:27:05 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-4e5d3fb0-a0b4-4423-9460-f2faac2cbd9e tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:27:05 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-4e5d3fb0-a0b4-4423-9460-f2faac2cbd9e tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:27:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4e5d3fb0-a0b4-4423-9460-f2faac2cbd9e tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.264s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:27:05 user nova-compute[71229]: INFO nova.scheduler.client.report [None req-4e5d3fb0-a0b4-4423-9460-f2faac2cbd9e tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Deleted allocations for instance f3a06747-0f43-4731-87e6-40629c382a6b
Apr 11 15:27:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4e5d3fb0-a0b4-4423-9460-f2faac2cbd9e tempest-VolumesAdminNegativeTest-2033224639 tempest-VolumesAdminNegativeTest-2033224639-project-member] Lock "f3a06747-0f43-4731-87e6-40629c382a6b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.097s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:27:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:07 user nova-compute[71229]: DEBUG nova.compute.manager [req-177dbbdb-227f-419b-ac4f-233706f94d3c req-2c0eb452-3ff3-461e-b415-3bd0cdd5017b service nova] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Received event network-vif-deleted-a7049f98-5ea1-4167-be7f-3206830f17c4 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:27:08 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:10 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:10 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:13 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:18 user nova-compute[71229]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681226823.5273252, f3a06747-0f43-4731-87e6-40629c382a6b => Stopped> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:27:18 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] VM Stopped (Lifecycle Event)
Apr 11 15:27:18 user nova-compute[71229]: DEBUG nova.compute.manager [None req-2c7e942e-3920-48b3-bfef-338e7252e18b None None] [instance: f3a06747-0f43-4731-87e6-40629c382a6b] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:27:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:21 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:31 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:27:31 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Triggering sync for uuid de1a45fd-27be-4438-80a4-2f3a100643c9 {{(pid=71229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 15:27:31 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Triggering sync for uuid 6a805345-374c-4326-9e8f-39bfc7947a35 {{(pid=71229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 15:27:31 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Triggering sync for uuid b0d90fd2-6a95-43c4-8756-e82071d99154 {{(pid=71229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 15:27:31 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Triggering sync for uuid e4555892-7abb-4a3c-a4ae-a27ad4902708 {{(pid=71229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 15:27:31 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Triggering sync for uuid fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5 {{(pid=71229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 15:27:31 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Triggering sync for uuid f846ecc9-ecc4-4e8f-aca3-39d83b56f414 {{(pid=71229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 15:27:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "de1a45fd-27be-4438-80a4-2f3a100643c9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:27:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "de1a45fd-27be-4438-80a4-2f3a100643c9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:27:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "6a805345-374c-4326-9e8f-39bfc7947a35" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:27:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "6a805345-374c-4326-9e8f-39bfc7947a35" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:27:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "b0d90fd2-6a95-43c4-8756-e82071d99154" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:27:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "b0d90fd2-6a95-43c4-8756-e82071d99154" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:27:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "e4555892-7abb-4a3c-a4ae-a27ad4902708" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:27:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "e4555892-7abb-4a3c-a4ae-a27ad4902708" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:27:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:27:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:27:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "f846ecc9-ecc4-4e8f-aca3-39d83b56f414" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:27:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "f846ecc9-ecc4-4e8f-aca3-39d83b56f414" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:27:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "6a805345-374c-4326-9e8f-39bfc7947a35" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:27:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:27:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "b0d90fd2-6a95-43c4-8756-e82071d99154" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.105s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:27:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "de1a45fd-27be-4438-80a4-2f3a100643c9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.126s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:27:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "f846ecc9-ecc4-4e8f-aca3-39d83b56f414" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.121s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:27:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "e4555892-7abb-4a3c-a4ae-a27ad4902708" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.135s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:27:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:36 user nova-compute[71229]: INFO nova.compute.manager [None req-2391bf0a-1152-4fad-a77b-001551cc0948 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Unrescuing
Apr 11 15:27:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-2391bf0a-1152-4fad-a77b-001551cc0948 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "refresh_cache-b0d90fd2-6a95-43c4-8756-e82071d99154" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:27:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-2391bf0a-1152-4fad-a77b-001551cc0948 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquired lock "refresh_cache-b0d90fd2-6a95-43c4-8756-e82071d99154" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:27:36 user nova-compute[71229]: DEBUG nova.network.neutron [None req-2391bf0a-1152-4fad-a77b-001551cc0948 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:27:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:37 user nova-compute[71229]: DEBUG nova.network.neutron [None req-2391bf0a-1152-4fad-a77b-001551cc0948 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Updating instance_info_cache with network_info: [{"id": "4718fa68-0eb9-4592-8c43-981438e3d0b8", "address": "fa:16:3e:e4:28:3b", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4718fa68-0e", "ovs_interfaceid": "4718fa68-0eb9-4592-8c43-981438e3d0b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:27:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-2391bf0a-1152-4fad-a77b-001551cc0948 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Releasing lock "refresh_cache-b0d90fd2-6a95-43c4-8756-e82071d99154" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:27:37 user nova-compute[71229]: DEBUG nova.objects.instance [None req-2391bf0a-1152-4fad-a77b-001551cc0948 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lazy-loading 'flavor' on Instance uuid b0d90fd2-6a95-43c4-8756-e82071d99154 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:27:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:37 user nova-compute[71229]: DEBUG nova.compute.manager [req-f496724a-323a-4dae-b241-0bee4856fc84 req-5a0daadd-8636-4a72-9036-e9ad3aee90ef service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Received event network-vif-unplugged-4718fa68-0eb9-4592-8c43-981438e3d0b8 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:27:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-f496724a-323a-4dae-b241-0bee4856fc84 req-5a0daadd-8636-4a72-9036-e9ad3aee90ef service nova] Acquiring lock "b0d90fd2-6a95-43c4-8756-e82071d99154-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:27:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-f496724a-323a-4dae-b241-0bee4856fc84 req-5a0daadd-8636-4a72-9036-e9ad3aee90ef service nova] Lock "b0d90fd2-6a95-43c4-8756-e82071d99154-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:27:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-f496724a-323a-4dae-b241-0bee4856fc84 req-5a0daadd-8636-4a72-9036-e9ad3aee90ef service nova] Lock "b0d90fd2-6a95-43c4-8756-e82071d99154-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:27:37 user nova-compute[71229]: DEBUG nova.compute.manager [req-f496724a-323a-4dae-b241-0bee4856fc84 req-5a0daadd-8636-4a72-9036-e9ad3aee90ef service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] No waiting events found dispatching network-vif-unplugged-4718fa68-0eb9-4592-8c43-981438e3d0b8 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:27:37 user nova-compute[71229]: WARNING nova.compute.manager [req-f496724a-323a-4dae-b241-0bee4856fc84 req-5a0daadd-8636-4a72-9036-e9ad3aee90ef service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Received unexpected event network-vif-unplugged-4718fa68-0eb9-4592-8c43-981438e3d0b8 for instance with vm_state rescued and task_state unrescuing.
Apr 11 15:27:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:37 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Instance destroyed successfully.
Apr 11 15:27:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:40 user nova-compute[71229]: DEBUG nova.compute.manager [req-33cd6a8e-2647-429b-9aed-cbe7eaf59c8a req-e6c32278-2db8-4fc3-8ee5-09396ec2d2d8 service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Received event network-vif-plugged-4718fa68-0eb9-4592-8c43-981438e3d0b8 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:27:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-33cd6a8e-2647-429b-9aed-cbe7eaf59c8a req-e6c32278-2db8-4fc3-8ee5-09396ec2d2d8 service nova] Acquiring lock "b0d90fd2-6a95-43c4-8756-e82071d99154-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:27:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-33cd6a8e-2647-429b-9aed-cbe7eaf59c8a req-e6c32278-2db8-4fc3-8ee5-09396ec2d2d8 service nova] Lock "b0d90fd2-6a95-43c4-8756-e82071d99154-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:27:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-33cd6a8e-2647-429b-9aed-cbe7eaf59c8a req-e6c32278-2db8-4fc3-8ee5-09396ec2d2d8 service nova] Lock "b0d90fd2-6a95-43c4-8756-e82071d99154-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:27:40 user nova-compute[71229]: DEBUG nova.compute.manager [req-33cd6a8e-2647-429b-9aed-cbe7eaf59c8a req-e6c32278-2db8-4fc3-8ee5-09396ec2d2d8 service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] No waiting events found dispatching network-vif-plugged-4718fa68-0eb9-4592-8c43-981438e3d0b8 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:27:40 user nova-compute[71229]: WARNING nova.compute.manager [req-33cd6a8e-2647-429b-9aed-cbe7eaf59c8a req-e6c32278-2db8-4fc3-8ee5-09396ec2d2d8 service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Received unexpected event network-vif-plugged-4718fa68-0eb9-4592-8c43-981438e3d0b8 for instance with vm_state rescued and task_state unrescuing.
Apr 11 15:27:40 user nova-compute[71229]: DEBUG nova.compute.manager [req-33cd6a8e-2647-429b-9aed-cbe7eaf59c8a req-e6c32278-2db8-4fc3-8ee5-09396ec2d2d8 service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Received event network-vif-plugged-4718fa68-0eb9-4592-8c43-981438e3d0b8 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:27:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-33cd6a8e-2647-429b-9aed-cbe7eaf59c8a req-e6c32278-2db8-4fc3-8ee5-09396ec2d2d8 service nova] Acquiring lock "b0d90fd2-6a95-43c4-8756-e82071d99154-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:27:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-33cd6a8e-2647-429b-9aed-cbe7eaf59c8a req-e6c32278-2db8-4fc3-8ee5-09396ec2d2d8 service nova] Lock "b0d90fd2-6a95-43c4-8756-e82071d99154-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:27:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-33cd6a8e-2647-429b-9aed-cbe7eaf59c8a req-e6c32278-2db8-4fc3-8ee5-09396ec2d2d8 service nova] Lock "b0d90fd2-6a95-43c4-8756-e82071d99154-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:27:40 user nova-compute[71229]: DEBUG nova.compute.manager [req-33cd6a8e-2647-429b-9aed-cbe7eaf59c8a req-e6c32278-2db8-4fc3-8ee5-09396ec2d2d8 service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] No waiting events found dispatching network-vif-plugged-4718fa68-0eb9-4592-8c43-981438e3d0b8 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:27:40 user nova-compute[71229]: WARNING nova.compute.manager [req-33cd6a8e-2647-429b-9aed-cbe7eaf59c8a req-e6c32278-2db8-4fc3-8ee5-09396ec2d2d8 service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Received unexpected event network-vif-plugged-4718fa68-0eb9-4592-8c43-981438e3d0b8 for instance with vm_state rescued and task_state unrescuing.
Apr 11 15:27:40 user nova-compute[71229]: DEBUG nova.compute.manager [req-33cd6a8e-2647-429b-9aed-cbe7eaf59c8a req-e6c32278-2db8-4fc3-8ee5-09396ec2d2d8 service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Received event network-vif-plugged-4718fa68-0eb9-4592-8c43-981438e3d0b8 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:27:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-33cd6a8e-2647-429b-9aed-cbe7eaf59c8a req-e6c32278-2db8-4fc3-8ee5-09396ec2d2d8 service nova] Acquiring lock "b0d90fd2-6a95-43c4-8756-e82071d99154-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:27:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-33cd6a8e-2647-429b-9aed-cbe7eaf59c8a req-e6c32278-2db8-4fc3-8ee5-09396ec2d2d8 service nova] Lock "b0d90fd2-6a95-43c4-8756-e82071d99154-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:27:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-33cd6a8e-2647-429b-9aed-cbe7eaf59c8a req-e6c32278-2db8-4fc3-8ee5-09396ec2d2d8 service nova] Lock "b0d90fd2-6a95-43c4-8756-e82071d99154-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:27:40 user nova-compute[71229]: DEBUG nova.compute.manager [req-33cd6a8e-2647-429b-9aed-cbe7eaf59c8a req-e6c32278-2db8-4fc3-8ee5-09396ec2d2d8 service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] No waiting events found dispatching network-vif-plugged-4718fa68-0eb9-4592-8c43-981438e3d0b8 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:27:40 user nova-compute[71229]: WARNING nova.compute.manager [req-33cd6a8e-2647-429b-9aed-cbe7eaf59c8a req-e6c32278-2db8-4fc3-8ee5-09396ec2d2d8 service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Received unexpected event network-vif-plugged-4718fa68-0eb9-4592-8c43-981438e3d0b8 for instance with vm_state rescued and task_state unrescuing.
Apr 11 15:27:40 user nova-compute[71229]: DEBUG nova.compute.manager [req-33cd6a8e-2647-429b-9aed-cbe7eaf59c8a req-e6c32278-2db8-4fc3-8ee5-09396ec2d2d8 service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Received event network-vif-unplugged-4718fa68-0eb9-4592-8c43-981438e3d0b8 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:27:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-33cd6a8e-2647-429b-9aed-cbe7eaf59c8a req-e6c32278-2db8-4fc3-8ee5-09396ec2d2d8 service nova] Acquiring lock "b0d90fd2-6a95-43c4-8756-e82071d99154-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:27:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-33cd6a8e-2647-429b-9aed-cbe7eaf59c8a req-e6c32278-2db8-4fc3-8ee5-09396ec2d2d8 service nova] Lock "b0d90fd2-6a95-43c4-8756-e82071d99154-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:27:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-33cd6a8e-2647-429b-9aed-cbe7eaf59c8a req-e6c32278-2db8-4fc3-8ee5-09396ec2d2d8 service nova] Lock "b0d90fd2-6a95-43c4-8756-e82071d99154-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:27:40 user nova-compute[71229]: DEBUG nova.compute.manager [req-33cd6a8e-2647-429b-9aed-cbe7eaf59c8a req-e6c32278-2db8-4fc3-8ee5-09396ec2d2d8 service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] No waiting events found dispatching network-vif-unplugged-4718fa68-0eb9-4592-8c43-981438e3d0b8 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:27:40 user nova-compute[71229]: WARNING nova.compute.manager [req-33cd6a8e-2647-429b-9aed-cbe7eaf59c8a req-e6c32278-2db8-4fc3-8ee5-09396ec2d2d8 service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Received unexpected event network-vif-unplugged-4718fa68-0eb9-4592-8c43-981438e3d0b8 for instance with vm_state rescued and task_state unrescuing.
Apr 11 15:27:40 user nova-compute[71229]: DEBUG nova.compute.manager [req-33cd6a8e-2647-429b-9aed-cbe7eaf59c8a req-e6c32278-2db8-4fc3-8ee5-09396ec2d2d8 service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Received event network-vif-plugged-4718fa68-0eb9-4592-8c43-981438e3d0b8 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:27:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-33cd6a8e-2647-429b-9aed-cbe7eaf59c8a req-e6c32278-2db8-4fc3-8ee5-09396ec2d2d8 service nova] Acquiring lock "b0d90fd2-6a95-43c4-8756-e82071d99154-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:27:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-33cd6a8e-2647-429b-9aed-cbe7eaf59c8a req-e6c32278-2db8-4fc3-8ee5-09396ec2d2d8 service nova] Lock "b0d90fd2-6a95-43c4-8756-e82071d99154-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:27:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-33cd6a8e-2647-429b-9aed-cbe7eaf59c8a req-e6c32278-2db8-4fc3-8ee5-09396ec2d2d8 service nova] Lock "b0d90fd2-6a95-43c4-8756-e82071d99154-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:27:40 user nova-compute[71229]: DEBUG nova.compute.manager [req-33cd6a8e-2647-429b-9aed-cbe7eaf59c8a req-e6c32278-2db8-4fc3-8ee5-09396ec2d2d8 service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] No waiting events found dispatching network-vif-plugged-4718fa68-0eb9-4592-8c43-981438e3d0b8 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:27:40 user nova-compute[71229]: WARNING nova.compute.manager [req-33cd6a8e-2647-429b-9aed-cbe7eaf59c8a req-e6c32278-2db8-4fc3-8ee5-09396ec2d2d8 service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Received unexpected event network-vif-plugged-4718fa68-0eb9-4592-8c43-981438e3d0b8 for instance with vm_state rescued and task_state unrescuing.
Apr 11 15:27:40 user nova-compute[71229]: DEBUG nova.compute.manager [req-33cd6a8e-2647-429b-9aed-cbe7eaf59c8a req-e6c32278-2db8-4fc3-8ee5-09396ec2d2d8 service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Received event network-vif-plugged-4718fa68-0eb9-4592-8c43-981438e3d0b8 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:27:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-33cd6a8e-2647-429b-9aed-cbe7eaf59c8a req-e6c32278-2db8-4fc3-8ee5-09396ec2d2d8 service nova] Acquiring lock "b0d90fd2-6a95-43c4-8756-e82071d99154-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:27:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-33cd6a8e-2647-429b-9aed-cbe7eaf59c8a req-e6c32278-2db8-4fc3-8ee5-09396ec2d2d8 service nova] Lock "b0d90fd2-6a95-43c4-8756-e82071d99154-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:27:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-33cd6a8e-2647-429b-9aed-cbe7eaf59c8a req-e6c32278-2db8-4fc3-8ee5-09396ec2d2d8 service nova] Lock "b0d90fd2-6a95-43c4-8756-e82071d99154-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:27:40 user nova-compute[71229]: DEBUG nova.compute.manager [req-33cd6a8e-2647-429b-9aed-cbe7eaf59c8a req-e6c32278-2db8-4fc3-8ee5-09396ec2d2d8 service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] No waiting events found dispatching network-vif-plugged-4718fa68-0eb9-4592-8c43-981438e3d0b8 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:27:40 user nova-compute[71229]: WARNING nova.compute.manager [req-33cd6a8e-2647-429b-9aed-cbe7eaf59c8a req-e6c32278-2db8-4fc3-8ee5-09396ec2d2d8 service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Received unexpected event network-vif-plugged-4718fa68-0eb9-4592-8c43-981438e3d0b8 for instance with vm_state rescued and task_state unrescuing.
Apr 11 15:27:40 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:41 user nova-compute[71229]: DEBUG nova.compute.manager [req-b2fa0f80-9425-4b2d-b43f-91b0d422c075 req-159dc598-a0da-487c-87fd-9c36d1781a8c service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Received event network-vif-plugged-4718fa68-0eb9-4592-8c43-981438e3d0b8 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:27:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-b2fa0f80-9425-4b2d-b43f-91b0d422c075 req-159dc598-a0da-487c-87fd-9c36d1781a8c service nova] Acquiring lock "b0d90fd2-6a95-43c4-8756-e82071d99154-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:27:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-b2fa0f80-9425-4b2d-b43f-91b0d422c075 req-159dc598-a0da-487c-87fd-9c36d1781a8c service nova] Lock "b0d90fd2-6a95-43c4-8756-e82071d99154-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:27:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-b2fa0f80-9425-4b2d-b43f-91b0d422c075 req-159dc598-a0da-487c-87fd-9c36d1781a8c service nova] Lock "b0d90fd2-6a95-43c4-8756-e82071d99154-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:27:41 user nova-compute[71229]: DEBUG nova.compute.manager [req-b2fa0f80-9425-4b2d-b43f-91b0d422c075 req-159dc598-a0da-487c-87fd-9c36d1781a8c service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] No waiting events found dispatching network-vif-plugged-4718fa68-0eb9-4592-8c43-981438e3d0b8 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:27:41 user nova-compute[71229]: WARNING nova.compute.manager [req-b2fa0f80-9425-4b2d-b43f-91b0d422c075 req-159dc598-a0da-487c-87fd-9c36d1781a8c service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Received unexpected event network-vif-plugged-4718fa68-0eb9-4592-8c43-981438e3d0b8 for instance with vm_state rescued and task_state unrescuing.
Apr 11 15:27:41 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Removed pending event for b0d90fd2-6a95-43c4-8756-e82071d99154 due to event {{(pid=71229) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 15:27:41 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681226861.8171375, b0d90fd2-6a95-43c4-8756-e82071d99154 => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:27:41 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] VM Resumed (Lifecycle Event)
Apr 11 15:27:41 user nova-compute[71229]: DEBUG nova.compute.manager [None req-2391bf0a-1152-4fad-a77b-001551cc0948 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:27:41 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:27:41 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:27:41 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 11 15:27:41 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681226861.8185003, b0d90fd2-6a95-43c4-8756-e82071d99154 => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:27:41 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] VM Started (Lifecycle Event)
Apr 11 15:27:41 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:27:41 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:27:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "d534d17d-ba77-4447-8a63-7d6021ad7896" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:27:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "d534d17d-ba77-4447-8a63-7d6021ad7896" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:27:42 user nova-compute[71229]: DEBUG nova.compute.manager [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Starting instance... {{(pid=71229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 15:27:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:27:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:27:43 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 15:27:43 user nova-compute[71229]: INFO nova.compute.claims [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Claim successful on node user
Apr 11 15:27:43 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:27:43 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:27:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.297s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:27:43 user nova-compute[71229]: DEBUG nova.compute.manager [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Start building networks asynchronously for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 15:27:43 user nova-compute[71229]: DEBUG nova.compute.manager [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Allocating IP information in the background. {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 15:27:43 user nova-compute[71229]: DEBUG nova.network.neutron [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] allocate_for_instance() {{(pid=71229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 15:27:43 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 15:27:43 user nova-compute[71229]: DEBUG nova.compute.manager [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Start building block device mappings for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 15:27:43 user nova-compute[71229]: DEBUG nova.policy [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '091ece3baa634583a7cc3000c78f2c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90bfd48094c54cd5b13dabf27ebdd5dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71229) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 15:27:43 user nova-compute[71229]: DEBUG nova.compute.manager [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Start spawning the instance on the hypervisor. {{(pid=71229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 15:27:43 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Creating instance directory {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 15:27:43 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Creating image(s)
Apr 11 15:27:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "/opt/stack/data/nova/instances/d534d17d-ba77-4447-8a63-7d6021ad7896/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:27:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "/opt/stack/data/nova/instances/d534d17d-ba77-4447-8a63-7d6021ad7896/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:27:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "/opt/stack/data/nova/instances/d534d17d-ba77-4447-8a63-7d6021ad7896/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:27:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:27:43 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.139s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:27:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:27:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:27:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:27:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.136s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:27:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/d534d17d-ba77-4447-8a63-7d6021ad7896/disk 1073741824 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:27:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/d534d17d-ba77-4447-8a63-7d6021ad7896/disk 1073741824" returned: 0 in 0.051s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:27:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:27:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:27:44 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.136s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:27:44 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d534d17d-ba77-4447-8a63-7d6021ad7896/disk. size=1073741824 {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 15:27:44 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d534d17d-ba77-4447-8a63-7d6021ad7896/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:27:44 user nova-compute[71229]: DEBUG nova.network.neutron [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Successfully created port: 05f23fee-4450-48d6-8b2f-6c1fcf308da6 {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 15:27:44 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d534d17d-ba77-4447-8a63-7d6021ad7896/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:27:44 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Cannot resize image /opt/stack/data/nova/instances/d534d17d-ba77-4447-8a63-7d6021ad7896/disk to a smaller size. {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 15:27:44 user nova-compute[71229]: DEBUG nova.objects.instance [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lazy-loading 'migration_context' on Instance uuid d534d17d-ba77-4447-8a63-7d6021ad7896 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:27:44 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Created local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 15:27:44 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Ensure instance console log exists: /opt/stack/data/nova/instances/d534d17d-ba77-4447-8a63-7d6021ad7896/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 15:27:44 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:27:44 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:27:44 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:27:44 user nova-compute[71229]: DEBUG nova.network.neutron [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Successfully updated port: 05f23fee-4450-48d6-8b2f-6c1fcf308da6 {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:27:44 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "refresh_cache-d534d17d-ba77-4447-8a63-7d6021ad7896" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:27:44 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquired lock "refresh_cache-d534d17d-ba77-4447-8a63-7d6021ad7896" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:27:44 user nova-compute[71229]: DEBUG nova.network.neutron [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:27:44 user nova-compute[71229]: DEBUG nova.compute.manager [req-447d0aa0-c076-4440-9361-91dc2558df64 req-9c8094f8-095c-47b2-9aad-7b2f5a07b756 service nova] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Received event network-changed-05f23fee-4450-48d6-8b2f-6c1fcf308da6 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:27:44 user nova-compute[71229]: DEBUG nova.compute.manager [req-447d0aa0-c076-4440-9361-91dc2558df64 req-9c8094f8-095c-47b2-9aad-7b2f5a07b756 service nova] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Refreshing instance network info cache due to event network-changed-05f23fee-4450-48d6-8b2f-6c1fcf308da6. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:27:44 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-447d0aa0-c076-4440-9361-91dc2558df64 req-9c8094f8-095c-47b2-9aad-7b2f5a07b756 service nova] Acquiring lock "refresh_cache-d534d17d-ba77-4447-8a63-7d6021ad7896" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:27:44 user nova-compute[71229]: DEBUG nova.network.neutron [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:27:45 user nova-compute[71229]: DEBUG nova.network.neutron [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Updating instance_info_cache with network_info: [{"id": "05f23fee-4450-48d6-8b2f-6c1fcf308da6", "address": "fa:16:3e:61:6a:d2", "network": {"id": "fc99abc0-f7ce-488e-b3d5-926973bb5e6b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2010457639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90bfd48094c54cd5b13dabf27ebdd5dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05f23fee-44", "ovs_interfaceid": "05f23fee-4450-48d6-8b2f-6c1fcf308da6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:27:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Releasing lock "refresh_cache-d534d17d-ba77-4447-8a63-7d6021ad7896" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:27:45 user nova-compute[71229]: DEBUG nova.compute.manager [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Instance network_info: |[{"id": "05f23fee-4450-48d6-8b2f-6c1fcf308da6", "address": "fa:16:3e:61:6a:d2", "network": {"id": "fc99abc0-f7ce-488e-b3d5-926973bb5e6b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2010457639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90bfd48094c54cd5b13dabf27ebdd5dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05f23fee-44", "ovs_interfaceid": "05f23fee-4450-48d6-8b2f-6c1fcf308da6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 15:27:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-447d0aa0-c076-4440-9361-91dc2558df64 req-9c8094f8-095c-47b2-9aad-7b2f5a07b756 service nova] Acquired lock "refresh_cache-d534d17d-ba77-4447-8a63-7d6021ad7896" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:27:45 user nova-compute[71229]: DEBUG nova.network.neutron [req-447d0aa0-c076-4440-9361-91dc2558df64 req-9c8094f8-095c-47b2-9aad-7b2f5a07b756 service nova] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Refreshing network info cache for port 05f23fee-4450-48d6-8b2f-6c1fcf308da6 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:27:45 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Start _get_guest_xml network_info=[{"id": "05f23fee-4450-48d6-8b2f-6c1fcf308da6", "address": "fa:16:3e:61:6a:d2", "network": {"id": "fc99abc0-f7ce-488e-b3d5-926973bb5e6b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2010457639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90bfd48094c54cd5b13dabf27ebdd5dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05f23fee-44", "ovs_interfaceid": "05f23fee-4450-48d6-8b2f-6c1fcf308da6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '52fe638c-5ada-47d5-b376-233bfa808a37'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:27:45 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:27:45 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:27:45 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:27:45 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:27:45 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:27:45 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:27:45 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:27:45 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:27:45 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:27:45 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:27:45 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:27:45 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:27:45 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:27:45 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:27:45 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:27:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1036280409',display_name='tempest-SnapshotDataIntegrityTests-server-1036280409',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1036280409',id=18,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEsY8FMpTDo2iDL8D2048rjTj/VI+ylGYuKoz69HdKNUW8YbpOt3axid+tNJOYBWww9OiD0Ac5LQl/2OtP+ihiza/khI/3Fa6GADgrvtJLGlEyRQIArtEl+HOseWnLoJKA==',key_name='tempest-SnapshotDataIntegrityTests-465777949',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='90bfd48094c54cd5b13dabf27ebdd5dd',ramdisk_id='',reservation_id='r-go1a1mo9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1684503145',owner_user_name='tempest-SnapshotDataIntegrityTests-1684503145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:27:43Z,user_data=None,user_id='091ece3baa634583a7cc3000c78f2c26',uuid=d534d17d-ba77-4447-8a63-7d6021ad7896,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05f23fee-4450-48d6-8b2f-6c1fcf308da6", "address": "fa:16:3e:61:6a:d2", "network": {"id": "fc99abc0-f7ce-488e-b3d5-926973bb5e6b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2010457639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90bfd48094c54cd5b13dabf27ebdd5dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05f23fee-44", "ovs_interfaceid": "05f23fee-4450-48d6-8b2f-6c1fcf308da6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:27:45 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Converting VIF {"id": "05f23fee-4450-48d6-8b2f-6c1fcf308da6", "address": "fa:16:3e:61:6a:d2", "network": {"id": "fc99abc0-f7ce-488e-b3d5-926973bb5e6b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2010457639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90bfd48094c54cd5b13dabf27ebdd5dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05f23fee-44", "ovs_interfaceid": "05f23fee-4450-48d6-8b2f-6c1fcf308da6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:27:45 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:6a:d2,bridge_name='br-int',has_traffic_filtering=True,id=05f23fee-4450-48d6-8b2f-6c1fcf308da6,network=Network(fc99abc0-f7ce-488e-b3d5-926973bb5e6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05f23fee-44') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:27:45 user nova-compute[71229]: DEBUG nova.objects.instance [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lazy-loading 'pci_devices' on Instance uuid d534d17d-ba77-4447-8a63-7d6021ad7896 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:27:45 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:27:45 user nova-compute[71229]:   <uuid>d534d17d-ba77-4447-8a63-7d6021ad7896</uuid>
Apr 11 15:27:45 user nova-compute[71229]:   <name>instance-00000012</name>
Apr 11 15:27:45 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:27:45 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:27:45 user nova-compute[71229]:   <metadata>
Apr 11 15:27:45 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:27:45 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:27:45 user nova-compute[71229]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1036280409</nova:name>
Apr 11 15:27:45 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:27:45</nova:creationTime>
Apr 11 15:27:45 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:27:45 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:27:45 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:27:45 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:27:45 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:27:45 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:27:45 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:27:45 user nova-compute[71229]:       <nova:owner>
Apr 11 15:27:45 user nova-compute[71229]:         <nova:user uuid="091ece3baa634583a7cc3000c78f2c26">tempest-SnapshotDataIntegrityTests-1684503145-project-member</nova:user>
Apr 11 15:27:45 user nova-compute[71229]:         <nova:project uuid="90bfd48094c54cd5b13dabf27ebdd5dd">tempest-SnapshotDataIntegrityTests-1684503145</nova:project>
Apr 11 15:27:45 user nova-compute[71229]:       </nova:owner>
Apr 11 15:27:45 user nova-compute[71229]:       <nova:root type="image" uuid="52fe638c-5ada-47d5-b376-233bfa808a37"/>
Apr 11 15:27:45 user nova-compute[71229]:       <nova:ports>
Apr 11 15:27:45 user nova-compute[71229]:         <nova:port uuid="05f23fee-4450-48d6-8b2f-6c1fcf308da6">
Apr 11 15:27:45 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 11 15:27:45 user nova-compute[71229]:         </nova:port>
Apr 11 15:27:45 user nova-compute[71229]:       </nova:ports>
Apr 11 15:27:45 user nova-compute[71229]:     </nova:instance>
Apr 11 15:27:45 user nova-compute[71229]:   </metadata>
Apr 11 15:27:45 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:27:45 user nova-compute[71229]:     <system>
Apr 11 15:27:45 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:27:45 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:27:45 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:27:45 user nova-compute[71229]:       <entry name="serial">d534d17d-ba77-4447-8a63-7d6021ad7896</entry>
Apr 11 15:27:45 user nova-compute[71229]:       <entry name="uuid">d534d17d-ba77-4447-8a63-7d6021ad7896</entry>
Apr 11 15:27:45 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:27:45 user nova-compute[71229]:     </system>
Apr 11 15:27:45 user nova-compute[71229]:   </sysinfo>
Apr 11 15:27:45 user nova-compute[71229]:   <os>
Apr 11 15:27:45 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:27:45 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 15:27:45 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:27:45 user nova-compute[71229]:   </os>
Apr 11 15:27:45 user nova-compute[71229]:   <features>
Apr 11 15:27:45 user nova-compute[71229]:     <acpi/>
Apr 11 15:27:45 user nova-compute[71229]:     <apic/>
Apr 11 15:27:45 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:27:45 user nova-compute[71229]:   </features>
Apr 11 15:27:45 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:27:45 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:27:45 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:27:45 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:27:45 user nova-compute[71229]:   </clock>
Apr 11 15:27:45 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:27:45 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:27:45 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:27:45 user nova-compute[71229]:   </cpu>
Apr 11 15:27:45 user nova-compute[71229]:   <devices>
Apr 11 15:27:45 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 15:27:45 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 15:27:45 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/d534d17d-ba77-4447-8a63-7d6021ad7896/disk"/>
Apr 11 15:27:45 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:27:45 user nova-compute[71229]:     </disk>
Apr 11 15:27:45 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:27:45 user nova-compute[71229]:       <mac address="fa:16:3e:61:6a:d2"/>
Apr 11 15:27:45 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:27:45 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:27:45 user nova-compute[71229]:       <target dev="tap05f23fee-44"/>
Apr 11 15:27:45 user nova-compute[71229]:     </interface>
Apr 11 15:27:45 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:27:45 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/d534d17d-ba77-4447-8a63-7d6021ad7896/console.log" append="off"/>
Apr 11 15:27:45 user nova-compute[71229]:     </serial>
Apr 11 15:27:45 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:27:45 user nova-compute[71229]:     <video>
Apr 11 15:27:45 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:27:45 user nova-compute[71229]:     </video>
Apr 11 15:27:45 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:27:45 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:27:45 user nova-compute[71229]:     </rng>
Apr 11 15:27:45 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:27:45 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:27:45 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:27:45 user nova-compute[71229]:     </memballoon>
Apr 11 15:27:45 user nova-compute[71229]:   </devices>
Apr 11 15:27:45 user nova-compute[71229]: </domain>
Apr 11 15:27:45 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:27:45 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:27:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1036280409',display_name='tempest-SnapshotDataIntegrityTests-server-1036280409',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1036280409',id=18,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEsY8FMpTDo2iDL8D2048rjTj/VI+ylGYuKoz69HdKNUW8YbpOt3axid+tNJOYBWww9OiD0Ac5LQl/2OtP+ihiza/khI/3Fa6GADgrvtJLGlEyRQIArtEl+HOseWnLoJKA==',key_name='tempest-SnapshotDataIntegrityTests-465777949',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='90bfd48094c54cd5b13dabf27ebdd5dd',ramdisk_id='',reservation_id='r-go1a1mo9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1684503145',owner_user_name='tempest-SnapshotDataIntegrityTests-1684503145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:27:43Z,user_data=None,user_id='091ece3baa634583a7cc3000c78f2c26',uuid=d534d17d-ba77-4447-8a63-7d6021ad7896,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05f23fee-4450-48d6-8b2f-6c1fcf308da6", "address": "fa:16:3e:61:6a:d2", "network": {"id": "fc99abc0-f7ce-488e-b3d5-926973bb5e6b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2010457639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90bfd48094c54cd5b13dabf27ebdd5dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05f23fee-44", "ovs_interfaceid": "05f23fee-4450-48d6-8b2f-6c1fcf308da6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:27:45 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Converting VIF {"id": "05f23fee-4450-48d6-8b2f-6c1fcf308da6", "address": "fa:16:3e:61:6a:d2", "network": {"id": "fc99abc0-f7ce-488e-b3d5-926973bb5e6b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2010457639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90bfd48094c54cd5b13dabf27ebdd5dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05f23fee-44", "ovs_interfaceid": "05f23fee-4450-48d6-8b2f-6c1fcf308da6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:27:45 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:6a:d2,bridge_name='br-int',has_traffic_filtering=True,id=05f23fee-4450-48d6-8b2f-6c1fcf308da6,network=Network(fc99abc0-f7ce-488e-b3d5-926973bb5e6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05f23fee-44') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:27:45 user nova-compute[71229]: DEBUG os_vif [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:6a:d2,bridge_name='br-int',has_traffic_filtering=True,id=05f23fee-4450-48d6-8b2f-6c1fcf308da6,network=Network(fc99abc0-f7ce-488e-b3d5-926973bb5e6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05f23fee-44') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:27:45 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:45 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:27:45 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:27:45 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:45 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap05f23fee-44, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:27:45 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap05f23fee-44, col_values=(('external_ids', {'iface-id': '05f23fee-4450-48d6-8b2f-6c1fcf308da6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:6a:d2', 'vm-uuid': 'd534d17d-ba77-4447-8a63-7d6021ad7896'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:27:45 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:45 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:27:45 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:45 user nova-compute[71229]: INFO os_vif [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:6a:d2,bridge_name='br-int',has_traffic_filtering=True,id=05f23fee-4450-48d6-8b2f-6c1fcf308da6,network=Network(fc99abc0-f7ce-488e-b3d5-926973bb5e6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05f23fee-44')
Apr 11 15:27:45 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:27:45 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] No VIF found with MAC fa:16:3e:61:6a:d2, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:27:45 user nova-compute[71229]: DEBUG nova.network.neutron [req-447d0aa0-c076-4440-9361-91dc2558df64 req-9c8094f8-095c-47b2-9aad-7b2f5a07b756 service nova] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Updated VIF entry in instance network info cache for port 05f23fee-4450-48d6-8b2f-6c1fcf308da6. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:27:45 user nova-compute[71229]: DEBUG nova.network.neutron [req-447d0aa0-c076-4440-9361-91dc2558df64 req-9c8094f8-095c-47b2-9aad-7b2f5a07b756 service nova] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Updating instance_info_cache with network_info: [{"id": "05f23fee-4450-48d6-8b2f-6c1fcf308da6", "address": "fa:16:3e:61:6a:d2", "network": {"id": "fc99abc0-f7ce-488e-b3d5-926973bb5e6b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2010457639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90bfd48094c54cd5b13dabf27ebdd5dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05f23fee-44", "ovs_interfaceid": "05f23fee-4450-48d6-8b2f-6c1fcf308da6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:27:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-447d0aa0-c076-4440-9361-91dc2558df64 req-9c8094f8-095c-47b2-9aad-7b2f5a07b756 service nova] Releasing lock "refresh_cache-d534d17d-ba77-4447-8a63-7d6021ad7896" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:27:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:46 user nova-compute[71229]: DEBUG nova.compute.manager [req-b134487a-78b4-42d9-b920-1c19ed602ce7 req-ceab7a0a-b2d1-403b-839f-e28485c0eb11 service nova] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Received event network-vif-plugged-05f23fee-4450-48d6-8b2f-6c1fcf308da6 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:27:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-b134487a-78b4-42d9-b920-1c19ed602ce7 req-ceab7a0a-b2d1-403b-839f-e28485c0eb11 service nova] Acquiring lock "d534d17d-ba77-4447-8a63-7d6021ad7896-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:27:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-b134487a-78b4-42d9-b920-1c19ed602ce7 req-ceab7a0a-b2d1-403b-839f-e28485c0eb11 service nova] Lock "d534d17d-ba77-4447-8a63-7d6021ad7896-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:27:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-b134487a-78b4-42d9-b920-1c19ed602ce7 req-ceab7a0a-b2d1-403b-839f-e28485c0eb11 service nova] Lock "d534d17d-ba77-4447-8a63-7d6021ad7896-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:27:46 user nova-compute[71229]: DEBUG nova.compute.manager [req-b134487a-78b4-42d9-b920-1c19ed602ce7 req-ceab7a0a-b2d1-403b-839f-e28485c0eb11 service nova] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] No waiting events found dispatching network-vif-plugged-05f23fee-4450-48d6-8b2f-6c1fcf308da6 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:27:46 user nova-compute[71229]: WARNING nova.compute.manager [req-b134487a-78b4-42d9-b920-1c19ed602ce7 req-ceab7a0a-b2d1-403b-839f-e28485c0eb11 service nova] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Received unexpected event network-vif-plugged-05f23fee-4450-48d6-8b2f-6c1fcf308da6 for instance with vm_state building and task_state spawning.
Apr 11 15:27:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:48 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681226868.7013721, d534d17d-ba77-4447-8a63-7d6021ad7896 => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:27:48 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] VM Resumed (Lifecycle Event)
Apr 11 15:27:48 user nova-compute[71229]: DEBUG nova.compute.manager [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 15:27:48 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Guest created on hypervisor {{(pid=71229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 15:27:48 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Instance spawned successfully.
Apr 11 15:27:48 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 15:27:48 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:27:48 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:27:48 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Found default for hw_cdrom_bus of ide {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:27:48 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Found default for hw_disk_bus of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:27:48 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Found default for hw_input_bus of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:27:48 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Found default for hw_pointer_model of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:27:48 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Found default for hw_video_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:27:48 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Found default for hw_vif_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:27:48 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:27:48 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681226868.7054896, d534d17d-ba77-4447-8a63-7d6021ad7896 => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:27:48 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] VM Started (Lifecycle Event)
Apr 11 15:27:48 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:27:48 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:27:48 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:27:48 user nova-compute[71229]: INFO nova.compute.manager [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Took 5.30 seconds to spawn the instance on the hypervisor.
Apr 11 15:27:48 user nova-compute[71229]: DEBUG nova.compute.manager [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:27:48 user nova-compute[71229]: DEBUG nova.compute.manager [req-ed69dc9e-56db-42b4-8610-2ad42e38c045 req-861de9bb-740c-4333-90a3-73b2329b2051 service nova] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Received event network-vif-plugged-05f23fee-4450-48d6-8b2f-6c1fcf308da6 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:27:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-ed69dc9e-56db-42b4-8610-2ad42e38c045 req-861de9bb-740c-4333-90a3-73b2329b2051 service nova] Acquiring lock "d534d17d-ba77-4447-8a63-7d6021ad7896-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:27:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-ed69dc9e-56db-42b4-8610-2ad42e38c045 req-861de9bb-740c-4333-90a3-73b2329b2051 service nova] Lock "d534d17d-ba77-4447-8a63-7d6021ad7896-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:27:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-ed69dc9e-56db-42b4-8610-2ad42e38c045 req-861de9bb-740c-4333-90a3-73b2329b2051 service nova] Lock "d534d17d-ba77-4447-8a63-7d6021ad7896-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:27:48 user nova-compute[71229]: DEBUG nova.compute.manager [req-ed69dc9e-56db-42b4-8610-2ad42e38c045 req-861de9bb-740c-4333-90a3-73b2329b2051 service nova] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] No waiting events found dispatching network-vif-plugged-05f23fee-4450-48d6-8b2f-6c1fcf308da6 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:27:48 user nova-compute[71229]: WARNING nova.compute.manager [req-ed69dc9e-56db-42b4-8610-2ad42e38c045 req-861de9bb-740c-4333-90a3-73b2329b2051 service nova] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Received unexpected event network-vif-plugged-05f23fee-4450-48d6-8b2f-6c1fcf308da6 for instance with vm_state building and task_state spawning.
Apr 11 15:27:48 user nova-compute[71229]: INFO nova.compute.manager [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Took 5.89 seconds to build instance.
Apr 11 15:27:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5b234499-79fe-405f-980d-821a16138451 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "d534d17d-ba77-4447-8a63-7d6021ad7896" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.976s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:27:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:27:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:27:49 user nova-compute[71229]: INFO nova.compute.manager [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Unshelving
Apr 11 15:27:49 user nova-compute[71229]: INFO nova.virt.block_device [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Booting with volume 092c1963-af41-4f6f-9205-8970fc6e3122 at /dev/vdc
Apr 11 15:27:49 user nova-compute[71229]: DEBUG os_brick.utils [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:27:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:27:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:27:49 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[df565205-b9ee-4ea5-8905-1e9ccd27706e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d55e24a97c90\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:27:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:27:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:27:49 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7185250f-5bb0-4377-842b-96f1bbb651cd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:27:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:27:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:27:49 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[44bb3623-700e-4e4f-af71-8fb6b8d4d7ff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:27:49 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9faec06-39d5-483c-9a3e-b06860f84094]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:27:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Running cmd (subprocess): nvme version {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:27:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] 'nvme version' failed. Not Retrying. {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:27:49 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] nvme not present on system {{(pid=71229) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 15:27:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:27:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:27:49 user nova-compute[71229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 15:27:49 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6eafb07-2181-40ae-a9bd-697ce3a99290]: (4, '') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:27:49 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71229) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 15:27:49 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 15:27:49 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] LIGHTOS: no hostnqn found. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 15:27:49 user nova-compute[71229]: DEBUG os_brick.utils [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d55e24a97c90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:27:49 user nova-compute[71229]: DEBUG nova.virt.block_device [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Updating existing volume attachment record: 764b1c84-f8dc-49a2-b9ad-8e169ac6b768 {{(pid=71229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 15:27:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b572e4e7-8035-4a3c-aa18-fe86e878894b tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "6a805345-374c-4326-9e8f-39bfc7947a35" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:27:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b572e4e7-8035-4a3c-aa18-fe86e878894b tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "6a805345-374c-4326-9e8f-39bfc7947a35" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:27:49 user nova-compute[71229]: INFO nova.compute.manager [None req-b572e4e7-8035-4a3c-aa18-fe86e878894b tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Detaching volume cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4
Apr 11 15:27:49 user nova-compute[71229]: INFO nova.virt.block_device [None req-b572e4e7-8035-4a3c-aa18-fe86e878894b tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Attempting to driver detach volume cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 from mountpoint /dev/vdb
Apr 11 15:27:49 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b572e4e7-8035-4a3c-aa18-fe86e878894b tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Attempting to detach device vdb from instance 6a805345-374c-4326-9e8f-39bfc7947a35 from the persistent domain config. {{(pid=71229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 15:27:49 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-b572e4e7-8035-4a3c-aa18-fe86e878894b tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 15:27:49 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:27:49 user nova-compute[71229]:   <source dev="/dev/sdd"/>
Apr 11 15:27:49 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 15:27:49 user nova-compute[71229]:   <serial>cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4</serial>
Apr 11 15:27:49 user nova-compute[71229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 15:27:49 user nova-compute[71229]: </disk>
Apr 11 15:27:49 user nova-compute[71229]:  {{(pid=71229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 15:27:49 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-b572e4e7-8035-4a3c-aa18-fe86e878894b tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Successfully detached device vdb from instance 6a805345-374c-4326-9e8f-39bfc7947a35 from the persistent domain config.
Apr 11 15:27:49 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b572e4e7-8035-4a3c-aa18-fe86e878894b tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6a805345-374c-4326-9e8f-39bfc7947a35 from the live domain config. {{(pid=71229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 15:27:49 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-b572e4e7-8035-4a3c-aa18-fe86e878894b tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 15:27:49 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:27:49 user nova-compute[71229]:   <source dev="/dev/sdd"/>
Apr 11 15:27:49 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 15:27:49 user nova-compute[71229]:   <serial>cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4</serial>
Apr 11 15:27:49 user nova-compute[71229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 15:27:49 user nova-compute[71229]: </disk>
Apr 11 15:27:49 user nova-compute[71229]:  {{(pid=71229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Received event <DeviceRemovedEvent: 1681226870.3693311, 6a805345-374c-4326-9e8f-39bfc7947a35 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71229) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b572e4e7-8035-4a3c-aa18-fe86e878894b tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6a805345-374c-4326-9e8f-39bfc7947a35 {{(pid=71229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 15:27:50 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-b572e4e7-8035-4a3c-aa18-fe86e878894b tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Successfully detached device vdb from instance 6a805345-374c-4326-9e8f-39bfc7947a35 from the live domain config.
Apr 11 15:27:50 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b572e4e7-8035-4a3c-aa18-fe86e878894b tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b572e4e7-8035-4a3c-aa18-fe86e878894b tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'blCPNQzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:27:50 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-b572e4e7-8035-4a3c-aa18-fe86e878894b tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:27:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-b572e4e7-8035-4a3c-aa18-fe86e878894b tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-b572e4e7-8035-4a3c-aa18-fe86e878894b tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[697a404d-8d6c-4186-819c-20e799065b3b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b572e4e7-8035-4a3c-aa18-fe86e878894b tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 15:27:50 user nova-compute[71229]: No targets found.
Apr 11 15:27:50 user nova-compute[71229]: iSNS:
Apr 11 15:27:50 user nova-compute[71229]: No targets found.
Apr 11 15:27:50 user nova-compute[71229]: STATIC:
Apr 11 15:27:50 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb
Apr 11 15:27:50 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:27:50 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:27:50 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4
Apr 11 15:27:50 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:27:50 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:27:50 user nova-compute[71229]: FIRMWARE:
Apr 11 15:27:50 user nova-compute[71229]: No targets found.
Apr 11 15:27:50 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b572e4e7-8035-4a3c-aa18-fe86e878894b tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 15:27:50 user nova-compute[71229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 15:27:50 user nova-compute[71229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71229) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b572e4e7-8035-4a3c-aa18-fe86e878894b tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4', 0)] {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[98db0c69-530a-42cf-b436-511ad560ee9b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fa41ff-280d-4e54-bab3-4dea5521f4bf]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b572e4e7-8035-4a3c-aa18-fe86e878894b tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:27:50 user nova-compute[71229]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 (non-flash)
Apr 11 15:27:50 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b572e4e7-8035-4a3c-aa18-fe86e878894b tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:27:50 user nova-compute[71229]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 (non-flash)
Apr 11 15:27:50 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b572e4e7-8035-4a3c-aa18-fe86e878894b tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb5c147b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4'): ({'sdd'}, set())}) {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-b572e4e7-8035-4a3c-aa18-fe86e878894b tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Removing single pathed devices sdd {{(pid=71229) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc953435-e253-4789-85e3-31a99f32490c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3009fcc9-75eb-4441-ac4c-23cea2bc3a89]: (4, ('ok\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-b572e4e7-8035-4a3c-aa18-fe86e878894b tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Flushing IO for device /dev/sdd {{(pid=71229) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[45bf5f14-ca9d-4f04-b66f-7b769846fc07]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-b572e4e7-8035-4a3c-aa18-fe86e878894b tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71229) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8cd11a-9734-48b8-abc9-3ebb83bef050]: (4, ('1', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-b572e4e7-8035-4a3c-aa18-fe86e878894b tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-b572e4e7-8035-4a3c-aa18-fe86e878894b tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] SCSI volumes sdd have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b572e4e7-8035-4a3c-aa18-fe86e878894b tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4')] {{(pid=71229) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff9beb5-d265-4710-b9fb-8b3216dcca5c]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b572e4e7-8035-4a3c-aa18-fe86e878894b tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 -p 172.16.0.220:3260 --logout {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d530426-7682-40fa-b946-884967c90bef]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b572e4e7-8035-4a3c-aa18-fe86e878894b tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4, portal: 172.16.0.220,3260]
Apr 11 15:27:50 user nova-compute[71229]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4, portal: 172.16.0.220,3260] successful.
Apr 11 15:27:50 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 -p 172.16.0.220:3260 --op delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc3b13b8-bac5-4cb2-a1f0-1d66f3d2cae4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bcad14-07a7-4de4-9da5-42d8d7309a3e]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b572e4e7-8035-4a3c-aa18-fe86e878894b tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-b572e4e7-8035-4a3c-aa18-fe86e878894b tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b572e4e7-8035-4a3c-aa18-fe86e878894b tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] <== disconnect_volume: return (294ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:27:50 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b572e4e7-8035-4a3c-aa18-fe86e878894b tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 15:27:51 user nova-compute[71229]: DEBUG nova.objects.instance [None req-b572e4e7-8035-4a3c-aa18-fe86e878894b tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lazy-loading 'flavor' on Instance uuid 6a805345-374c-4326-9e8f-39bfc7947a35 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:27:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b572e4e7-8035-4a3c-aa18-fe86e878894b tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "6a805345-374c-4326-9e8f-39bfc7947a35" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.671s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:27:51 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:53 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:27:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:27:54 user nova-compute[71229]: DEBUG nova.objects.instance [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lazy-loading 'pci_requests' on Instance uuid 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:27:54 user nova-compute[71229]: DEBUG nova.objects.instance [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lazy-loading 'numa_topology' on Instance uuid 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:27:54 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 15:27:54 user nova-compute[71229]: INFO nova.compute.claims [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Claim successful on node user
Apr 11 15:27:54 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:27:54 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:27:54 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:27:54 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 15:27:54 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:27:54 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:27:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:27:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.424s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:27:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.019s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:27:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:27:54 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 15:27:54 user nova-compute[71229]: INFO nova.network.neutron [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Updating port 1ad8234a-3f96-43a0-9dea-862e6efcda73 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 11 15:27:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:27:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:27:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:27:55 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:27:55 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:27:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f846ecc9-ecc4-4e8f-aca3-39d83b56f414/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:27:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f846ecc9-ecc4-4e8f-aca3-39d83b56f414/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:27:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f846ecc9-ecc4-4e8f-aca3-39d83b56f414/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:27:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "refresh_cache-1e01618b-2aa4-4b56-b1a2-0d6e25e3075d" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:27:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquired lock "refresh_cache-1e01618b-2aa4-4b56-b1a2-0d6e25e3075d" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:27:55 user nova-compute[71229]: DEBUG nova.network.neutron [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:27:55 user nova-compute[71229]: DEBUG nova.compute.manager [req-e7e56143-e7d1-4cd6-ad28-6da7d8ff208e req-f129fd9e-3eb3-4977-8547-0cbc0a848dd8 service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Received event network-changed-1ad8234a-3f96-43a0-9dea-862e6efcda73 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:27:55 user nova-compute[71229]: DEBUG nova.compute.manager [req-e7e56143-e7d1-4cd6-ad28-6da7d8ff208e req-f129fd9e-3eb3-4977-8547-0cbc0a848dd8 service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Refreshing instance network info cache due to event network-changed-1ad8234a-3f96-43a0-9dea-862e6efcda73. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:27:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e7e56143-e7d1-4cd6-ad28-6da7d8ff208e req-f129fd9e-3eb3-4977-8547-0cbc0a848dd8 service nova] Acquiring lock "refresh_cache-1e01618b-2aa4-4b56-b1a2-0d6e25e3075d" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:27:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f846ecc9-ecc4-4e8f-aca3-39d83b56f414/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:27:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d534d17d-ba77-4447-8a63-7d6021ad7896/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:27:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d534d17d-ba77-4447-8a63-7d6021ad7896/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:27:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d534d17d-ba77-4447-8a63-7d6021ad7896/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:27:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d534d17d-ba77-4447-8a63-7d6021ad7896/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:27:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4555892-7abb-4a3c-a4ae-a27ad4902708/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:27:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4555892-7abb-4a3c-a4ae-a27ad4902708/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:27:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4555892-7abb-4a3c-a4ae-a27ad4902708/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:27:56 user nova-compute[71229]: DEBUG nova.network.neutron [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Updating instance_info_cache with network_info: [{"id": "1ad8234a-3f96-43a0-9dea-862e6efcda73", "address": "fa:16:3e:54:20:be", "network": {"id": "15a1a586-0100-4057-8501-5c5a282d4063", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834988552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b9b79fb98441fd9f1b5df54471f0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad8234a-3f", "ovs_interfaceid": "1ad8234a-3f96-43a0-9dea-862e6efcda73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:27:56 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Releasing lock "refresh_cache-1e01618b-2aa4-4b56-b1a2-0d6e25e3075d" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:27:56 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Creating instance directory {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 15:27:56 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Creating image(s)
Apr 11 15:27:56 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "/opt/stack/data/nova/instances/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:27:56 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "/opt/stack/data/nova/instances/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:27:56 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "/opt/stack/data/nova/instances/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:27:56 user nova-compute[71229]: DEBUG nova.objects.instance [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:27:56 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e7e56143-e7d1-4cd6-ad28-6da7d8ff208e req-f129fd9e-3eb3-4977-8547-0cbc0a848dd8 service nova] Acquired lock "refresh_cache-1e01618b-2aa4-4b56-b1a2-0d6e25e3075d" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:27:56 user nova-compute[71229]: DEBUG nova.network.neutron [req-e7e56143-e7d1-4cd6-ad28-6da7d8ff208e req-f129fd9e-3eb3-4977-8547-0cbc0a848dd8 service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Refreshing network info cache for port 1ad8234a-3f96-43a0-9dea-862e6efcda73 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:27:56 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "f5b3dfefdf8867a11ef3d904c3bec91eb9e5c5bd" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:27:56 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "f5b3dfefdf8867a11ef3d904c3bec91eb9e5c5bd" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:27:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4555892-7abb-4a3c-a4ae-a27ad4902708/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:27:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:27:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5b3dfefdf8867a11ef3d904c3bec91eb9e5c5bd.part --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:27:57 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:27:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5/disk --force-share --output=json" returned: 0 in 0.866s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:27:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:27:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5b3dfefdf8867a11ef3d904c3bec91eb9e5c5bd.part --force-share --output=json" returned: 0 in 0.164s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:27:57 user nova-compute[71229]: DEBUG nova.virt.images [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] 87863922-2331-4e0b-98c7-19452e916a88 was qcow2, converting to raw {{(pid=71229) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 15:27:57 user nova-compute[71229]: DEBUG nova.privsep.utils [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71229) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 15:27:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f5b3dfefdf8867a11ef3d904c3bec91eb9e5c5bd.part /opt/stack/data/nova/instances/_base/f5b3dfefdf8867a11ef3d904c3bec91eb9e5c5bd.converted {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:27:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:27:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:27:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:27:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:27:57 user nova-compute[71229]: DEBUG nova.network.neutron [req-e7e56143-e7d1-4cd6-ad28-6da7d8ff208e req-f129fd9e-3eb3-4977-8547-0cbc0a848dd8 service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Updated VIF entry in instance network info cache for port 1ad8234a-3f96-43a0-9dea-862e6efcda73. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:27:57 user nova-compute[71229]: DEBUG nova.network.neutron [req-e7e56143-e7d1-4cd6-ad28-6da7d8ff208e req-f129fd9e-3eb3-4977-8547-0cbc0a848dd8 service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Updating instance_info_cache with network_info: [{"id": "1ad8234a-3f96-43a0-9dea-862e6efcda73", "address": "fa:16:3e:54:20:be", "network": {"id": "15a1a586-0100-4057-8501-5c5a282d4063", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834988552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b9b79fb98441fd9f1b5df54471f0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad8234a-3f", "ovs_interfaceid": "1ad8234a-3f96-43a0-9dea-862e6efcda73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:27:57 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e7e56143-e7d1-4cd6-ad28-6da7d8ff208e req-f129fd9e-3eb3-4977-8547-0cbc0a848dd8 service nova] Releasing lock "refresh_cache-1e01618b-2aa4-4b56-b1a2-0d6e25e3075d" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:27:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:27:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f5b3dfefdf8867a11ef3d904c3bec91eb9e5c5bd.part /opt/stack/data/nova/instances/_base/f5b3dfefdf8867a11ef3d904c3bec91eb9e5c5bd.converted" returned: 0 in 0.853s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:27:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5b3dfefdf8867a11ef3d904c3bec91eb9e5c5bd.converted --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:27:58 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:27:58 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:27:58 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8146MB free_disk=26.229724884033203GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 15:27:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:27:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:27:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5b3dfefdf8867a11ef3d904c3bec91eb9e5c5bd.converted --force-share --output=json" returned: 0 in 0.154s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:27:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "f5b3dfefdf8867a11ef3d904c3bec91eb9e5c5bd" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.066s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:27:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5b3dfefdf8867a11ef3d904c3bec91eb9e5c5bd --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:27:58 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance de1a45fd-27be-4438-80a4-2f3a100643c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:27:58 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 6a805345-374c-4326-9e8f-39bfc7947a35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:27:58 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance b0d90fd2-6a95-43c4-8756-e82071d99154 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:27:58 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance e4555892-7abb-4a3c-a4ae-a27ad4902708 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:27:58 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:27:58 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance f846ecc9-ecc4-4e8f-aca3-39d83b56f414 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:27:58 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance d534d17d-ba77-4447-8a63-7d6021ad7896 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:27:58 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1705}}
Apr 11 15:27:58 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 15:27:58 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 15:27:58 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Refreshing inventories for resource provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 15:27:58 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Updating ProviderTree inventory for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 15:27:58 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Updating inventory in ProviderTree for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 15:27:58 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Refreshing aggregate associations for resource provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de, aggregates: None {{(pid=71229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 15:27:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5b3dfefdf8867a11ef3d904c3bec91eb9e5c5bd --force-share --output=json" returned: 0 in 0.177s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:27:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "f5b3dfefdf8867a11ef3d904c3bec91eb9e5c5bd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:27:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "f5b3dfefdf8867a11ef3d904c3bec91eb9e5c5bd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:27:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5b3dfefdf8867a11ef3d904c3bec91eb9e5c5bd --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:27:58 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Refreshing trait associations for resource provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de, traits: COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=71229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 15:27:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5b3dfefdf8867a11ef3d904c3bec91eb9e5c5bd --force-share --output=json" returned: 0 in 0.143s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:27:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f5b3dfefdf8867a11ef3d904c3bec91eb9e5c5bd,backing_fmt=raw /opt/stack/data/nova/instances/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/disk 1073741824 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:27:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f5b3dfefdf8867a11ef3d904c3bec91eb9e5c5bd,backing_fmt=raw /opt/stack/data/nova/instances/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/disk 1073741824" returned: 0 in 0.090s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:27:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "f5b3dfefdf8867a11ef3d904c3bec91eb9e5c5bd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:27:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5b3dfefdf8867a11ef3d904c3bec91eb9e5c5bd --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:27:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5b3dfefdf8867a11ef3d904c3bec91eb9e5c5bd --force-share --output=json" returned: 0 in 0.142s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:27:58 user nova-compute[71229]: DEBUG nova.objects.instance [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lazy-loading 'migration_context' on Instance uuid 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:27:58 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Rebasing disk image.
Apr 11 15:27:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:27:58 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:27:58 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:27:58 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 15:27:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.791s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:27:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.133s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:27:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a -F raw /opt/stack/data/nova/instances/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/disk {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:27:59 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:27:59 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:27:59 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 15:27:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "refresh_cache-6a805345-374c-4326-9e8f-39bfc7947a35" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:27:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquired lock "refresh_cache-6a805345-374c-4326-9e8f-39bfc7947a35" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:27:59 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Forcefully refreshing network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 15:28:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:00 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Updating instance_info_cache with network_info: [{"id": "d8c64197-b034-4f38-821d-ba030f1fca6b", "address": "fa:16:3e:0f:f8:cb", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c64197-b0", "ovs_interfaceid": "d8c64197-b034-4f38-821d-ba030f1fca6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:28:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Releasing lock "refresh_cache-6a805345-374c-4326-9e8f-39bfc7947a35" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:28:00 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Updated the network info_cache for instance {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 15:28:00 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:28:00 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:28:00 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:28:00 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a -F raw /opt/stack/data/nova/instances/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/disk" returned: 0 in 2.133s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Created local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Ensure instance console log exists: /opt/stack/data/nova/instances/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Start _get_guest_xml network_info=[{"id": "1ad8234a-3f96-43a0-9dea-862e6efcda73", "address": "fa:16:3e:54:20:be", "network": {"id": "15a1a586-0100-4057-8501-5c5a282d4063", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834988552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b9b79fb98441fd9f1b5df54471f0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad8234a-3f", "ovs_interfaceid": "1ad8234a-3f96-43a0-9dea-862e6efcda73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='e16712f07794d24e2473561e6dee1ced',container_format='bare',created_at=2023-04-11T15:25:57Z,direct_url=<?>,disk_format='qcow2',id=87863922-2331-4e0b-98c7-19452e916a88,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1772068587-shelved',owner='63b9b79fb98441fd9f1b5df54471f0bd',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-11T15:26:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '52fe638c-5ada-47d5-b376-233bfa808a37'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vXtplGab', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '1e01618b-2aa4-4b56-b1a2-0d6e25e3075d', 'attached_at': '', 'detached_at': '', 'volume_id': '092c1963-af41-4f6f-9205-8970fc6e3122', 'serial': '092c1963-af41-4f6f-9205-8970fc6e3122'}, 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '764b1c84-f8dc-49a2-b9ad-8e169ac6b768', 'guest_format': None, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:28:01 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:28:01 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:28:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='e16712f07794d24e2473561e6dee1ced',container_format='bare',created_at=2023-04-11T15:25:57Z,direct_url=<?>,disk_format='qcow2',id=87863922-2331-4e0b-98c7-19452e916a88,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1772068587-shelved',owner='63b9b79fb98441fd9f1b5df54471f0bd',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-11T15:26:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG nova.objects.instance [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vXtplGab', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:28:01 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:28:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:28:01 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:28:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:28:01 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 15:28:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122 -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9f54f3-4aa4-4e7e-ad55-d78dbe73009c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 15:28:01 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122 -p 172.16.0.220:3260 --interface default --op new {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d85bb5-dbae-48ed-bf78-526ad6d9ae00]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122] added\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122] added
Apr 11 15:28:01 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1f143e-201e-457e-8cc9-6d1675445f92]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c3d091-6c4c-47b4-b0b6-430c1d24e9bd]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vXtplGab {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vXtplGab" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2881ca3c-c95a-460f-a400-9208b52fa9f8]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vXtplGab'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3d7880-c33c-48ad-813a-4c479217a1e1]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b31e0c-ed72-48b4-b0c3-7e37476c2cbd]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:28:01 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:28:01 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122 -p 172.16.0.220:3260 --login {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122 -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4969890f-685d-4f18-b2be-e89dbc670500]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122, portal: 172.16.0.220,3260]
Apr 11 15:28:01 user nova-compute[71229]: Login to [iface: default, target: iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122, portal: 172.16.0.220,3260] successful.
Apr 11 15:28:01 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b433754-0052-44c3-9cb9-fc5e5e221ada]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf21281-4452-4e0e-89fd-07f2b11cbf14]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:28:01 user nova-compute[71229]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122 (non-flash)
Apr 11 15:28:01 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:28:01 user nova-compute[71229]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122 (non-flash)
Apr 11 15:28:01 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de8b14c-04a2-4322-a9ea-67c3b40b6980]: (4, ('- - 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: None {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:28:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:02 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:28:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vXtplGab', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 15:28:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:28:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23937366338653935', 'path': '/dev/sdc'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:28:02 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937366338653935', 'path': '/dev/sdc'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 15:28:02 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T15:24:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1772068587',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1772068587',id=12,image_ref='87863922-2331-4e0b-98c7-19452e916a88',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-2006224467',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:24:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='63b9b79fb98441fd9f1b5df54471f0bd',ramdisk_id='',reservation_id='r-vjwljds2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1785499036',owner_user_name='tempest-AttachVolumeShelveTestJSON-1785499036-project-member',shelved_at='2023-04-11T15:26:01.166758',shelved_host='user',shelved_image_id='87863922-2331-4e0b-98c7-19452e916a88'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:27:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88d988d9ce0a41669b7c487ac07b4cfe',uuid=1e01618b-2aa4-4b56-b1a2-0d6e25e3075d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1ad8234a-3f96-43a0-9dea-862e6efcda73", "address": "fa:16:3e:54:20:be", "network": {"id": "15a1a586-0100-4057-8501-5c5a282d4063", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834988552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b9b79fb98441fd9f1b5df54471f0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad8234a-3f", "ovs_interfaceid": "1ad8234a-3f96-43a0-9dea-862e6efcda73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:28:02 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Converting VIF {"id": "1ad8234a-3f96-43a0-9dea-862e6efcda73", "address": "fa:16:3e:54:20:be", "network": {"id": "15a1a586-0100-4057-8501-5c5a282d4063", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834988552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b9b79fb98441fd9f1b5df54471f0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad8234a-3f", "ovs_interfaceid": "1ad8234a-3f96-43a0-9dea-862e6efcda73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:28:02 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:20:be,bridge_name='br-int',has_traffic_filtering=True,id=1ad8234a-3f96-43a0-9dea-862e6efcda73,network=Network(15a1a586-0100-4057-8501-5c5a282d4063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad8234a-3f') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:28:02 user nova-compute[71229]: DEBUG nova.objects.instance [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:28:02 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:28:02 user nova-compute[71229]:   <uuid>1e01618b-2aa4-4b56-b1a2-0d6e25e3075d</uuid>
Apr 11 15:28:02 user nova-compute[71229]:   <name>instance-0000000c</name>
Apr 11 15:28:02 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:28:02 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:28:02 user nova-compute[71229]:   <metadata>
Apr 11 15:28:02 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:28:02 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:28:02 user nova-compute[71229]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1772068587</nova:name>
Apr 11 15:28:02 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:28:01</nova:creationTime>
Apr 11 15:28:02 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:28:02 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:28:02 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:28:02 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:28:02 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:28:02 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:28:02 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:28:02 user nova-compute[71229]:       <nova:owner>
Apr 11 15:28:02 user nova-compute[71229]:         <nova:user uuid="88d988d9ce0a41669b7c487ac07b4cfe">tempest-AttachVolumeShelveTestJSON-1785499036-project-member</nova:user>
Apr 11 15:28:02 user nova-compute[71229]:         <nova:project uuid="63b9b79fb98441fd9f1b5df54471f0bd">tempest-AttachVolumeShelveTestJSON-1785499036</nova:project>
Apr 11 15:28:02 user nova-compute[71229]:       </nova:owner>
Apr 11 15:28:02 user nova-compute[71229]:       <nova:root type="image" uuid="87863922-2331-4e0b-98c7-19452e916a88"/>
Apr 11 15:28:02 user nova-compute[71229]:       <nova:ports>
Apr 11 15:28:02 user nova-compute[71229]:         <nova:port uuid="1ad8234a-3f96-43a0-9dea-862e6efcda73">
Apr 11 15:28:02 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 11 15:28:02 user nova-compute[71229]:         </nova:port>
Apr 11 15:28:02 user nova-compute[71229]:       </nova:ports>
Apr 11 15:28:02 user nova-compute[71229]:     </nova:instance>
Apr 11 15:28:02 user nova-compute[71229]:   </metadata>
Apr 11 15:28:02 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:28:02 user nova-compute[71229]:     <system>
Apr 11 15:28:02 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:28:02 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:28:02 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:28:02 user nova-compute[71229]:       <entry name="serial">1e01618b-2aa4-4b56-b1a2-0d6e25e3075d</entry>
Apr 11 15:28:02 user nova-compute[71229]:       <entry name="uuid">1e01618b-2aa4-4b56-b1a2-0d6e25e3075d</entry>
Apr 11 15:28:02 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:28:02 user nova-compute[71229]:     </system>
Apr 11 15:28:02 user nova-compute[71229]:   </sysinfo>
Apr 11 15:28:02 user nova-compute[71229]:   <os>
Apr 11 15:28:02 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:28:02 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 15:28:02 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:28:02 user nova-compute[71229]:   </os>
Apr 11 15:28:02 user nova-compute[71229]:   <features>
Apr 11 15:28:02 user nova-compute[71229]:     <acpi/>
Apr 11 15:28:02 user nova-compute[71229]:     <apic/>
Apr 11 15:28:02 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:28:02 user nova-compute[71229]:   </features>
Apr 11 15:28:02 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:28:02 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:28:02 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:28:02 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:28:02 user nova-compute[71229]:   </clock>
Apr 11 15:28:02 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:28:02 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:28:02 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:28:02 user nova-compute[71229]:   </cpu>
Apr 11 15:28:02 user nova-compute[71229]:   <devices>
Apr 11 15:28:02 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 15:28:02 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 15:28:02 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/disk"/>
Apr 11 15:28:02 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:28:02 user nova-compute[71229]:     </disk>
Apr 11 15:28:02 user nova-compute[71229]:     <disk type="block" device="disk">
Apr 11 15:28:02 user nova-compute[71229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:28:02 user nova-compute[71229]:       <source dev="/dev/sdc"/>
Apr 11 15:28:02 user nova-compute[71229]:       <target dev="vdc" bus="virtio"/>
Apr 11 15:28:02 user nova-compute[71229]:       <serial>092c1963-af41-4f6f-9205-8970fc6e3122</serial>
Apr 11 15:28:02 user nova-compute[71229]:     </disk>
Apr 11 15:28:02 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:28:02 user nova-compute[71229]:       <mac address="fa:16:3e:54:20:be"/>
Apr 11 15:28:02 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:28:02 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:28:02 user nova-compute[71229]:       <target dev="tap1ad8234a-3f"/>
Apr 11 15:28:02 user nova-compute[71229]:     </interface>
Apr 11 15:28:02 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:28:02 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/console.log" append="off"/>
Apr 11 15:28:02 user nova-compute[71229]:     </serial>
Apr 11 15:28:02 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:28:02 user nova-compute[71229]:     <video>
Apr 11 15:28:02 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:28:02 user nova-compute[71229]:     </video>
Apr 11 15:28:02 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:28:02 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:28:02 user nova-compute[71229]:     </rng>
Apr 11 15:28:02 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:28:02 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:28:02 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:28:02 user nova-compute[71229]:     </memballoon>
Apr 11 15:28:02 user nova-compute[71229]:   </devices>
Apr 11 15:28:02 user nova-compute[71229]: </domain>
Apr 11 15:28:02 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:28:02 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T15:24:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1772068587',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1772068587',id=12,image_ref='87863922-2331-4e0b-98c7-19452e916a88',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-2006224467',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:24:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='63b9b79fb98441fd9f1b5df54471f0bd',ramdisk_id='',reservation_id='r-vjwljds2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1785499036',owner_user_name='tempest-AttachVolumeShelveTestJSON-1785499036-project-member',shelved_at='2023-04-11T15:26:01.166758',shelved_host='user',shelved_image_id='87863922-2331-4e0b-98c7-19452e916a88'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:27:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88d988d9ce0a41669b7c487ac07b4cfe',uuid=1e01618b-2aa4-4b56-b1a2-0d6e25e3075d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1ad8234a-3f96-43a0-9dea-862e6efcda73", "address": "fa:16:3e:54:20:be", "network": {"id": "15a1a586-0100-4057-8501-5c5a282d4063", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834988552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b9b79fb98441fd9f1b5df54471f0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad8234a-3f", "ovs_interfaceid": "1ad8234a-3f96-43a0-9dea-862e6efcda73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:28:02 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Converting VIF {"id": "1ad8234a-3f96-43a0-9dea-862e6efcda73", "address": "fa:16:3e:54:20:be", "network": {"id": "15a1a586-0100-4057-8501-5c5a282d4063", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834988552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b9b79fb98441fd9f1b5df54471f0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad8234a-3f", "ovs_interfaceid": "1ad8234a-3f96-43a0-9dea-862e6efcda73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:28:02 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:20:be,bridge_name='br-int',has_traffic_filtering=True,id=1ad8234a-3f96-43a0-9dea-862e6efcda73,network=Network(15a1a586-0100-4057-8501-5c5a282d4063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad8234a-3f') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:28:02 user nova-compute[71229]: DEBUG os_vif [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:20:be,bridge_name='br-int',has_traffic_filtering=True,id=1ad8234a-3f96-43a0-9dea-862e6efcda73,network=Network(15a1a586-0100-4057-8501-5c5a282d4063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad8234a-3f') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:28:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:28:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:28:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ad8234a-3f, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:28:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1ad8234a-3f, col_values=(('external_ids', {'iface-id': '1ad8234a-3f96-43a0-9dea-862e6efcda73', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:20:be', 'vm-uuid': '1e01618b-2aa4-4b56-b1a2-0d6e25e3075d'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:28:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:28:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:02 user nova-compute[71229]: INFO os_vif [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:20:be,bridge_name='br-int',has_traffic_filtering=True,id=1ad8234a-3f96-43a0-9dea-862e6efcda73,network=Network(15a1a586-0100-4057-8501-5c5a282d4063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad8234a-3f')
Apr 11 15:28:02 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:28:02 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:28:02 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] No VIF found with MAC fa:16:3e:54:20:be, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:28:03 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:03 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:03 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:03 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:04 user nova-compute[71229]: DEBUG nova.compute.manager [req-c143660d-00ce-42a8-915b-a3138ba5b3d7 req-fca08ed2-3751-4087-8a3e-28a0e62facbe service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Received event network-vif-plugged-1ad8234a-3f96-43a0-9dea-862e6efcda73 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:28:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c143660d-00ce-42a8-915b-a3138ba5b3d7 req-fca08ed2-3751-4087-8a3e-28a0e62facbe service nova] Acquiring lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:28:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c143660d-00ce-42a8-915b-a3138ba5b3d7 req-fca08ed2-3751-4087-8a3e-28a0e62facbe service nova] Lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:28:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c143660d-00ce-42a8-915b-a3138ba5b3d7 req-fca08ed2-3751-4087-8a3e-28a0e62facbe service nova] Lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:28:04 user nova-compute[71229]: DEBUG nova.compute.manager [req-c143660d-00ce-42a8-915b-a3138ba5b3d7 req-fca08ed2-3751-4087-8a3e-28a0e62facbe service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] No waiting events found dispatching network-vif-plugged-1ad8234a-3f96-43a0-9dea-862e6efcda73 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:28:04 user nova-compute[71229]: WARNING nova.compute.manager [req-c143660d-00ce-42a8-915b-a3138ba5b3d7 req-fca08ed2-3751-4087-8a3e-28a0e62facbe service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Received unexpected event network-vif-plugged-1ad8234a-3f96-43a0-9dea-862e6efcda73 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 11 15:28:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:06 user nova-compute[71229]: DEBUG nova.compute.manager [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 15:28:06 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Guest created on hypervisor {{(pid=71229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 15:28:06 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681226886.0949488, 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:28:06 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] VM Resumed (Lifecycle Event)
Apr 11 15:28:06 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Instance spawned successfully.
Apr 11 15:28:06 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:28:06 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:28:06 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:28:06 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681226886.095596, 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:28:06 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] VM Started (Lifecycle Event)
Apr 11 15:28:06 user nova-compute[71229]: DEBUG nova.compute.manager [req-cdf37cb8-e3be-4c2b-b08f-25e6a3beb03f req-cc84ace5-837d-482c-8066-7916fd7cffbf service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Received event network-vif-plugged-1ad8234a-3f96-43a0-9dea-862e6efcda73 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:28:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-cdf37cb8-e3be-4c2b-b08f-25e6a3beb03f req-cc84ace5-837d-482c-8066-7916fd7cffbf service nova] Acquiring lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:28:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-cdf37cb8-e3be-4c2b-b08f-25e6a3beb03f req-cc84ace5-837d-482c-8066-7916fd7cffbf service nova] Lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:28:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-cdf37cb8-e3be-4c2b-b08f-25e6a3beb03f req-cc84ace5-837d-482c-8066-7916fd7cffbf service nova] Lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:28:06 user nova-compute[71229]: DEBUG nova.compute.manager [req-cdf37cb8-e3be-4c2b-b08f-25e6a3beb03f req-cc84ace5-837d-482c-8066-7916fd7cffbf service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] No waiting events found dispatching network-vif-plugged-1ad8234a-3f96-43a0-9dea-862e6efcda73 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:28:06 user nova-compute[71229]: WARNING nova.compute.manager [req-cdf37cb8-e3be-4c2b-b08f-25e6a3beb03f req-cc84ace5-837d-482c-8066-7916fd7cffbf service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Received unexpected event network-vif-plugged-1ad8234a-3f96-43a0-9dea-862e6efcda73 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 11 15:28:06 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:28:06 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:28:06 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:28:06 user nova-compute[71229]: DEBUG nova.compute.manager [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:28:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-395bc32f-2140-4939-af51-660885437421 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 17.042s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:28:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:10 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:12 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:12 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:13 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Acquiring lock "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:28:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:28:18 user nova-compute[71229]: DEBUG nova.compute.manager [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Starting instance... {{(pid=71229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 15:28:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:28:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:28:18 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 15:28:18 user nova-compute[71229]: INFO nova.compute.claims [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Claim successful on node user
Apr 11 15:28:18 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:28:18 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:28:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.483s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:28:18 user nova-compute[71229]: DEBUG nova.compute.manager [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Start building networks asynchronously for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 15:28:18 user nova-compute[71229]: DEBUG nova.compute.manager [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Allocating IP information in the background. {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 15:28:18 user nova-compute[71229]: DEBUG nova.network.neutron [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] allocate_for_instance() {{(pid=71229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 15:28:18 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 15:28:18 user nova-compute[71229]: DEBUG nova.compute.manager [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Start building block device mappings for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 15:28:19 user nova-compute[71229]: DEBUG nova.policy [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f32986358bcc4148ad3f361e3944ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82dec4b679f24d1e85b1105b4849cddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71229) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 15:28:19 user nova-compute[71229]: DEBUG nova.compute.manager [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Start spawning the instance on the hypervisor. {{(pid=71229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 15:28:19 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Creating instance directory {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 15:28:19 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Creating image(s)
Apr 11 15:28:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Acquiring lock "/opt/stack/data/nova/instances/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:28:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "/opt/stack/data/nova/instances/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:28:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "/opt/stack/data/nova/instances/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:28:19 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:28:19 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.160s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:28:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Acquiring lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:28:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:28:19 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:28:19 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.141s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:28:19 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/disk 1073741824 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:28:19 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/disk 1073741824" returned: 0 in 0.048s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:28:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:28:19 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:28:19 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.141s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:28:19 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/disk. size=1073741824 {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 15:28:19 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:28:19 user nova-compute[71229]: DEBUG nova.network.neutron [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Successfully created port: 40f1797d-278c-4676-8413-3b0c0f113dd9 {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 15:28:19 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:28:19 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Cannot resize image /opt/stack/data/nova/instances/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/disk to a smaller size. {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 15:28:19 user nova-compute[71229]: DEBUG nova.objects.instance [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lazy-loading 'migration_context' on Instance uuid 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:28:19 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Created local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 15:28:19 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Ensure instance console log exists: /opt/stack/data/nova/instances/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 15:28:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:28:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:28:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:28:20 user nova-compute[71229]: DEBUG nova.network.neutron [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Successfully updated port: 40f1797d-278c-4676-8413-3b0c0f113dd9 {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:28:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Acquiring lock "refresh_cache-1424f1ff-6c0f-4f9a-bddc-6c448a768a7a" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:28:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Acquired lock "refresh_cache-1424f1ff-6c0f-4f9a-bddc-6c448a768a7a" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:28:20 user nova-compute[71229]: DEBUG nova.network.neutron [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:28:20 user nova-compute[71229]: DEBUG nova.compute.manager [req-30e954a2-cf48-4d32-b8bb-d4a075a36953 req-ebbf71a0-6ee2-43c1-aa0f-6631fdb1cc1b service nova] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Received event network-changed-40f1797d-278c-4676-8413-3b0c0f113dd9 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:28:20 user nova-compute[71229]: DEBUG nova.compute.manager [req-30e954a2-cf48-4d32-b8bb-d4a075a36953 req-ebbf71a0-6ee2-43c1-aa0f-6631fdb1cc1b service nova] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Refreshing instance network info cache due to event network-changed-40f1797d-278c-4676-8413-3b0c0f113dd9. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:28:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-30e954a2-cf48-4d32-b8bb-d4a075a36953 req-ebbf71a0-6ee2-43c1-aa0f-6631fdb1cc1b service nova] Acquiring lock "refresh_cache-1424f1ff-6c0f-4f9a-bddc-6c448a768a7a" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:28:20 user nova-compute[71229]: DEBUG nova.network.neutron [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:28:20 user nova-compute[71229]: DEBUG nova.network.neutron [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Updating instance_info_cache with network_info: [{"id": "40f1797d-278c-4676-8413-3b0c0f113dd9", "address": "fa:16:3e:05:3e:4e", "network": {"id": "921b7e62-65aa-426c-9286-8b31b88588a8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1464327252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82dec4b679f24d1e85b1105b4849cddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40f1797d-27", "ovs_interfaceid": "40f1797d-278c-4676-8413-3b0c0f113dd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:28:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Releasing lock "refresh_cache-1424f1ff-6c0f-4f9a-bddc-6c448a768a7a" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:28:20 user nova-compute[71229]: DEBUG nova.compute.manager [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Instance network_info: |[{"id": "40f1797d-278c-4676-8413-3b0c0f113dd9", "address": "fa:16:3e:05:3e:4e", "network": {"id": "921b7e62-65aa-426c-9286-8b31b88588a8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1464327252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82dec4b679f24d1e85b1105b4849cddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40f1797d-27", "ovs_interfaceid": "40f1797d-278c-4676-8413-3b0c0f113dd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 15:28:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-30e954a2-cf48-4d32-b8bb-d4a075a36953 req-ebbf71a0-6ee2-43c1-aa0f-6631fdb1cc1b service nova] Acquired lock "refresh_cache-1424f1ff-6c0f-4f9a-bddc-6c448a768a7a" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:28:20 user nova-compute[71229]: DEBUG nova.network.neutron [req-30e954a2-cf48-4d32-b8bb-d4a075a36953 req-ebbf71a0-6ee2-43c1-aa0f-6631fdb1cc1b service nova] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Refreshing network info cache for port 40f1797d-278c-4676-8413-3b0c0f113dd9 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:28:20 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Start _get_guest_xml network_info=[{"id": "40f1797d-278c-4676-8413-3b0c0f113dd9", "address": "fa:16:3e:05:3e:4e", "network": {"id": "921b7e62-65aa-426c-9286-8b31b88588a8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1464327252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82dec4b679f24d1e85b1105b4849cddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40f1797d-27", "ovs_interfaceid": "40f1797d-278c-4676-8413-3b0c0f113dd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '52fe638c-5ada-47d5-b376-233bfa808a37'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:28:20 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:28:20 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:28:20 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:28:20 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:28:20 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:28:20 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:28:20 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:28:20 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:28:20 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:28:20 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:28:20 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:28:20 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:28:20 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:28:20 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:28:20 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T15:28:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-982441201',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-982441201',id=19,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQhnP1Gx1ErLuuEevJpV94XRpvcJAoAfxD6RZqXP7Kvn0H8XePF/x7sWzG5H5vtetd0gs+rS/bMxjK4Qz9b0uYhYgbQvD0DmjSlBMXC1CeKAiMrjjZNT7Keb43XJ65W+w==',key_name='tempest-keypair-1011126544',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82dec4b679f24d1e85b1105b4849cddd',ramdisk_id='',reservation_id='r-izovbhtx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-727930312',owner_user_name='tempest-TaggedAttachmentsTest-727930312-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:28:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f32986358bcc4148ad3f361e3944ed81',uuid=1424f1ff-6c0f-4f9a-bddc-6c448a768a7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40f1797d-278c-4676-8413-3b0c0f113dd9", "address": "fa:16:3e:05:3e:4e", "network": {"id": "921b7e62-65aa-426c-9286-8b31b88588a8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1464327252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82dec4b679f24d1e85b1105b4849cddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40f1797d-27", "ovs_interfaceid": "40f1797d-278c-4676-8413-3b0c0f113dd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:28:20 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Converting VIF {"id": "40f1797d-278c-4676-8413-3b0c0f113dd9", "address": "fa:16:3e:05:3e:4e", "network": {"id": "921b7e62-65aa-426c-9286-8b31b88588a8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1464327252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82dec4b679f24d1e85b1105b4849cddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40f1797d-27", "ovs_interfaceid": "40f1797d-278c-4676-8413-3b0c0f113dd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:28:20 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:3e:4e,bridge_name='br-int',has_traffic_filtering=True,id=40f1797d-278c-4676-8413-3b0c0f113dd9,network=Network(921b7e62-65aa-426c-9286-8b31b88588a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40f1797d-27') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:28:20 user nova-compute[71229]: DEBUG nova.objects.instance [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lazy-loading 'pci_devices' on Instance uuid 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:28:20 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:28:20 user nova-compute[71229]:   <uuid>1424f1ff-6c0f-4f9a-bddc-6c448a768a7a</uuid>
Apr 11 15:28:20 user nova-compute[71229]:   <name>instance-00000013</name>
Apr 11 15:28:20 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:28:20 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:28:20 user nova-compute[71229]:   <metadata>
Apr 11 15:28:20 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:28:20 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:28:20 user nova-compute[71229]:       <nova:name>tempest-device-tagging-server-982441201</nova:name>
Apr 11 15:28:20 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:28:20</nova:creationTime>
Apr 11 15:28:20 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:28:20 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:28:20 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:28:20 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:28:20 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:28:20 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:28:20 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:28:20 user nova-compute[71229]:       <nova:owner>
Apr 11 15:28:20 user nova-compute[71229]:         <nova:user uuid="f32986358bcc4148ad3f361e3944ed81">tempest-TaggedAttachmentsTest-727930312-project-member</nova:user>
Apr 11 15:28:20 user nova-compute[71229]:         <nova:project uuid="82dec4b679f24d1e85b1105b4849cddd">tempest-TaggedAttachmentsTest-727930312</nova:project>
Apr 11 15:28:20 user nova-compute[71229]:       </nova:owner>
Apr 11 15:28:20 user nova-compute[71229]:       <nova:root type="image" uuid="52fe638c-5ada-47d5-b376-233bfa808a37"/>
Apr 11 15:28:20 user nova-compute[71229]:       <nova:ports>
Apr 11 15:28:20 user nova-compute[71229]:         <nova:port uuid="40f1797d-278c-4676-8413-3b0c0f113dd9">
Apr 11 15:28:20 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 11 15:28:20 user nova-compute[71229]:         </nova:port>
Apr 11 15:28:20 user nova-compute[71229]:       </nova:ports>
Apr 11 15:28:20 user nova-compute[71229]:     </nova:instance>
Apr 11 15:28:20 user nova-compute[71229]:   </metadata>
Apr 11 15:28:20 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:28:20 user nova-compute[71229]:     <system>
Apr 11 15:28:20 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:28:20 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:28:20 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:28:20 user nova-compute[71229]:       <entry name="serial">1424f1ff-6c0f-4f9a-bddc-6c448a768a7a</entry>
Apr 11 15:28:20 user nova-compute[71229]:       <entry name="uuid">1424f1ff-6c0f-4f9a-bddc-6c448a768a7a</entry>
Apr 11 15:28:20 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:28:20 user nova-compute[71229]:     </system>
Apr 11 15:28:20 user nova-compute[71229]:   </sysinfo>
Apr 11 15:28:20 user nova-compute[71229]:   <os>
Apr 11 15:28:20 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:28:20 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 15:28:20 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:28:20 user nova-compute[71229]:   </os>
Apr 11 15:28:20 user nova-compute[71229]:   <features>
Apr 11 15:28:20 user nova-compute[71229]:     <acpi/>
Apr 11 15:28:20 user nova-compute[71229]:     <apic/>
Apr 11 15:28:20 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:28:20 user nova-compute[71229]:   </features>
Apr 11 15:28:20 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:28:20 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:28:20 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:28:20 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:28:20 user nova-compute[71229]:   </clock>
Apr 11 15:28:20 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:28:20 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:28:20 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:28:20 user nova-compute[71229]:   </cpu>
Apr 11 15:28:20 user nova-compute[71229]:   <devices>
Apr 11 15:28:20 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 15:28:20 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 15:28:20 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/disk"/>
Apr 11 15:28:20 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:28:20 user nova-compute[71229]:     </disk>
Apr 11 15:28:20 user nova-compute[71229]:     <disk type="file" device="cdrom">
Apr 11 15:28:20 user nova-compute[71229]:       <driver name="qemu" type="raw" cache="none"/>
Apr 11 15:28:20 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/disk.config"/>
Apr 11 15:28:20 user nova-compute[71229]:       <target dev="hda" bus="ide"/>
Apr 11 15:28:20 user nova-compute[71229]:     </disk>
Apr 11 15:28:20 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:28:20 user nova-compute[71229]:       <mac address="fa:16:3e:05:3e:4e"/>
Apr 11 15:28:20 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:28:20 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:28:20 user nova-compute[71229]:       <target dev="tap40f1797d-27"/>
Apr 11 15:28:20 user nova-compute[71229]:     </interface>
Apr 11 15:28:20 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:28:20 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/console.log" append="off"/>
Apr 11 15:28:20 user nova-compute[71229]:     </serial>
Apr 11 15:28:20 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:28:20 user nova-compute[71229]:     <video>
Apr 11 15:28:20 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:28:20 user nova-compute[71229]:     </video>
Apr 11 15:28:20 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:28:20 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:28:20 user nova-compute[71229]:     </rng>
Apr 11 15:28:20 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:28:20 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:28:20 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:28:20 user nova-compute[71229]:     </memballoon>
Apr 11 15:28:20 user nova-compute[71229]:   </devices>
Apr 11 15:28:20 user nova-compute[71229]: </domain>
Apr 11 15:28:20 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:28:20 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T15:28:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-982441201',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-982441201',id=19,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQhnP1Gx1ErLuuEevJpV94XRpvcJAoAfxD6RZqXP7Kvn0H8XePF/x7sWzG5H5vtetd0gs+rS/bMxjK4Qz9b0uYhYgbQvD0DmjSlBMXC1CeKAiMrjjZNT7Keb43XJ65W+w==',key_name='tempest-keypair-1011126544',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82dec4b679f24d1e85b1105b4849cddd',ramdisk_id='',reservation_id='r-izovbhtx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-727930312',owner_user_name='tempest-TaggedAttachmentsTest-727930312-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:28:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f32986358bcc4148ad3f361e3944ed81',uuid=1424f1ff-6c0f-4f9a-bddc-6c448a768a7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40f1797d-278c-4676-8413-3b0c0f113dd9", "address": "fa:16:3e:05:3e:4e", "network": {"id": "921b7e62-65aa-426c-9286-8b31b88588a8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1464327252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82dec4b679f24d1e85b1105b4849cddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40f1797d-27", "ovs_interfaceid": "40f1797d-278c-4676-8413-3b0c0f113dd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:28:20 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Converting VIF {"id": "40f1797d-278c-4676-8413-3b0c0f113dd9", "address": "fa:16:3e:05:3e:4e", "network": {"id": "921b7e62-65aa-426c-9286-8b31b88588a8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1464327252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82dec4b679f24d1e85b1105b4849cddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40f1797d-27", "ovs_interfaceid": "40f1797d-278c-4676-8413-3b0c0f113dd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:28:20 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:3e:4e,bridge_name='br-int',has_traffic_filtering=True,id=40f1797d-278c-4676-8413-3b0c0f113dd9,network=Network(921b7e62-65aa-426c-9286-8b31b88588a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40f1797d-27') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:28:20 user nova-compute[71229]: DEBUG os_vif [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:3e:4e,bridge_name='br-int',has_traffic_filtering=True,id=40f1797d-278c-4676-8413-3b0c0f113dd9,network=Network(921b7e62-65aa-426c-9286-8b31b88588a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40f1797d-27') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:28:20 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:20 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:28:20 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:28:20 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:20 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap40f1797d-27, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:28:20 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap40f1797d-27, col_values=(('external_ids', {'iface-id': '40f1797d-278c-4676-8413-3b0c0f113dd9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:3e:4e', 'vm-uuid': '1424f1ff-6c0f-4f9a-bddc-6c448a768a7a'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:28:20 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:20 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:28:20 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:20 user nova-compute[71229]: INFO os_vif [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:3e:4e,bridge_name='br-int',has_traffic_filtering=True,id=40f1797d-278c-4676-8413-3b0c0f113dd9,network=Network(921b7e62-65aa-426c-9286-8b31b88588a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40f1797d-27')
Apr 11 15:28:20 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:28:20 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] No BDM found with device name hda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:28:20 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] No VIF found with MAC fa:16:3e:05:3e:4e, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:28:20 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Using config drive
Apr 11 15:28:20 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Creating config drive at /opt/stack/data/nova/instances/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/disk.config
Apr 11 15:28:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzar9t7rd {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:28:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzar9t7rd" returned: 0 in 0.070s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:28:21 user nova-compute[71229]: DEBUG nova.network.neutron [req-30e954a2-cf48-4d32-b8bb-d4a075a36953 req-ebbf71a0-6ee2-43c1-aa0f-6631fdb1cc1b service nova] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Updated VIF entry in instance network info cache for port 40f1797d-278c-4676-8413-3b0c0f113dd9. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:28:21 user nova-compute[71229]: DEBUG nova.network.neutron [req-30e954a2-cf48-4d32-b8bb-d4a075a36953 req-ebbf71a0-6ee2-43c1-aa0f-6631fdb1cc1b service nova] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Updating instance_info_cache with network_info: [{"id": "40f1797d-278c-4676-8413-3b0c0f113dd9", "address": "fa:16:3e:05:3e:4e", "network": {"id": "921b7e62-65aa-426c-9286-8b31b88588a8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1464327252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82dec4b679f24d1e85b1105b4849cddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40f1797d-27", "ovs_interfaceid": "40f1797d-278c-4676-8413-3b0c0f113dd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:28:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-30e954a2-cf48-4d32-b8bb-d4a075a36953 req-ebbf71a0-6ee2-43c1-aa0f-6631fdb1cc1b service nova] Releasing lock "refresh_cache-1424f1ff-6c0f-4f9a-bddc-6c448a768a7a" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:28:21 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:22 user nova-compute[71229]: DEBUG nova.compute.manager [req-0c87599f-92c1-486c-b682-2359bec3fa89 req-7cc2fedf-04bd-4d7f-9f96-24164ac8afef service nova] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Received event network-vif-plugged-40f1797d-278c-4676-8413-3b0c0f113dd9 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:28:22 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-0c87599f-92c1-486c-b682-2359bec3fa89 req-7cc2fedf-04bd-4d7f-9f96-24164ac8afef service nova] Acquiring lock "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:28:22 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-0c87599f-92c1-486c-b682-2359bec3fa89 req-7cc2fedf-04bd-4d7f-9f96-24164ac8afef service nova] Lock "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:28:22 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-0c87599f-92c1-486c-b682-2359bec3fa89 req-7cc2fedf-04bd-4d7f-9f96-24164ac8afef service nova] Lock "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:28:22 user nova-compute[71229]: DEBUG nova.compute.manager [req-0c87599f-92c1-486c-b682-2359bec3fa89 req-7cc2fedf-04bd-4d7f-9f96-24164ac8afef service nova] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] No waiting events found dispatching network-vif-plugged-40f1797d-278c-4676-8413-3b0c0f113dd9 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:28:22 user nova-compute[71229]: WARNING nova.compute.manager [req-0c87599f-92c1-486c-b682-2359bec3fa89 req-7cc2fedf-04bd-4d7f-9f96-24164ac8afef service nova] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Received unexpected event network-vif-plugged-40f1797d-278c-4676-8413-3b0c0f113dd9 for instance with vm_state building and task_state spawning.
Apr 11 15:28:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:24 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681226904.7389016, 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:28:24 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] VM Resumed (Lifecycle Event)
Apr 11 15:28:24 user nova-compute[71229]: DEBUG nova.compute.manager [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 15:28:24 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Guest created on hypervisor {{(pid=71229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 15:28:24 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Instance spawned successfully.
Apr 11 15:28:24 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 15:28:24 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:28:24 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:28:24 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Found default for hw_cdrom_bus of ide {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:28:24 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Found default for hw_disk_bus of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:28:24 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Found default for hw_input_bus of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:28:24 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Found default for hw_pointer_model of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:28:24 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Found default for hw_video_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:28:24 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Found default for hw_vif_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:28:24 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:28:24 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681226904.740815, 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:28:24 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] VM Started (Lifecycle Event)
Apr 11 15:28:24 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:28:24 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:28:24 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:28:24 user nova-compute[71229]: INFO nova.compute.manager [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Took 5.83 seconds to spawn the instance on the hypervisor.
Apr 11 15:28:24 user nova-compute[71229]: DEBUG nova.compute.manager [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:28:24 user nova-compute[71229]: DEBUG nova.compute.manager [req-67445046-ba32-4860-9514-f2e722b944fb req-a5a53f9b-6373-40e8-a97d-5615e32b49fd service nova] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Received event network-vif-plugged-40f1797d-278c-4676-8413-3b0c0f113dd9 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:28:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-67445046-ba32-4860-9514-f2e722b944fb req-a5a53f9b-6373-40e8-a97d-5615e32b49fd service nova] Acquiring lock "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:28:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-67445046-ba32-4860-9514-f2e722b944fb req-a5a53f9b-6373-40e8-a97d-5615e32b49fd service nova] Lock "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:28:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-67445046-ba32-4860-9514-f2e722b944fb req-a5a53f9b-6373-40e8-a97d-5615e32b49fd service nova] Lock "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:28:24 user nova-compute[71229]: DEBUG nova.compute.manager [req-67445046-ba32-4860-9514-f2e722b944fb req-a5a53f9b-6373-40e8-a97d-5615e32b49fd service nova] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] No waiting events found dispatching network-vif-plugged-40f1797d-278c-4676-8413-3b0c0f113dd9 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:28:24 user nova-compute[71229]: WARNING nova.compute.manager [req-67445046-ba32-4860-9514-f2e722b944fb req-a5a53f9b-6373-40e8-a97d-5615e32b49fd service nova] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Received unexpected event network-vif-plugged-40f1797d-278c-4676-8413-3b0c0f113dd9 for instance with vm_state building and task_state spawning.
Apr 11 15:28:24 user nova-compute[71229]: INFO nova.compute.manager [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Took 6.64 seconds to build instance.
Apr 11 15:28:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f18ec800-dcae-465b-a6e2-edd609e6fcb6 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.743s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:28:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Acquiring lock "39e3dfb1-bc09-474d-b8cb-f01b11923eae" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:28:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "39e3dfb1-bc09-474d-b8cb-f01b11923eae" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:28:25 user nova-compute[71229]: INFO nova.compute.manager [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Unshelving
Apr 11 15:28:25 user nova-compute[71229]: INFO nova.virt.block_device [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Booting with volume 3132ad02-1f63-469b-b802-d814466b9ad7 at /dev/vda
Apr 11 15:28:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:25 user nova-compute[71229]: DEBUG os_brick.utils [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:28:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:28:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:28:25 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5286165d-d2a9-49a1-8641-132a8d2e3549]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d55e24a97c90\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:28:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:28:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.026s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:28:25 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3766e2-5054-40f9-b1a9-6ac71a0e4748]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:28:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:28:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:28:25 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ab3acd-749e-4afb-99c4-f969b758644b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:28:25 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec9aac5-fa44-43b3-ae93-23109f8fbe8f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:28:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Running cmd (subprocess): nvme version {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:28:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] 'nvme version' failed. Not Retrying. {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:28:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] nvme not present on system {{(pid=71229) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 15:28:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:28:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:28:25 user nova-compute[71229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 15:28:25 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[29da25dd-ac1c-4910-accd-1afdc90b00eb]: (4, '') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:28:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71229) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 15:28:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 15:28:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] LIGHTOS: no hostnqn found. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 15:28:25 user nova-compute[71229]: DEBUG os_brick.utils [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d55e24a97c90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:28:25 user nova-compute[71229]: DEBUG nova.virt.block_device [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Updating existing volume attachment record: 1835af7c-224d-4d18-ae06-e8d80d893e2c {{(pid=71229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 15:28:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:30 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:28:30 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:28:30 user nova-compute[71229]: DEBUG nova.objects.instance [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lazy-loading 'pci_requests' on Instance uuid 39e3dfb1-bc09-474d-b8cb-f01b11923eae {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:28:30 user nova-compute[71229]: DEBUG nova.objects.instance [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lazy-loading 'numa_topology' on Instance uuid 39e3dfb1-bc09-474d-b8cb-f01b11923eae {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:28:30 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 15:28:30 user nova-compute[71229]: INFO nova.compute.claims [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Claim successful on node user
Apr 11 15:28:30 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:28:30 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:28:30 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.414s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:28:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:30 user nova-compute[71229]: INFO nova.network.neutron [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Updating port 21d628ba-6bae-4d98-94df-bb6fbb4f1c24 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 11 15:28:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Acquiring lock "refresh_cache-39e3dfb1-bc09-474d-b8cb-f01b11923eae" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:28:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Acquired lock "refresh_cache-39e3dfb1-bc09-474d-b8cb-f01b11923eae" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:28:31 user nova-compute[71229]: DEBUG nova.network.neutron [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:28:31 user nova-compute[71229]: DEBUG nova.compute.manager [req-f07a78e7-61c3-488b-add7-dbfc0248f341 req-aede65f1-9a10-4aff-8aaa-65a4859b50af service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Received event network-changed-21d628ba-6bae-4d98-94df-bb6fbb4f1c24 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:28:31 user nova-compute[71229]: DEBUG nova.compute.manager [req-f07a78e7-61c3-488b-add7-dbfc0248f341 req-aede65f1-9a10-4aff-8aaa-65a4859b50af service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Refreshing instance network info cache due to event network-changed-21d628ba-6bae-4d98-94df-bb6fbb4f1c24. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:28:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-f07a78e7-61c3-488b-add7-dbfc0248f341 req-aede65f1-9a10-4aff-8aaa-65a4859b50af service nova] Acquiring lock "refresh_cache-39e3dfb1-bc09-474d-b8cb-f01b11923eae" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:28:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG nova.network.neutron [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Updating instance_info_cache with network_info: [{"id": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24", "address": "fa:16:3e:97:55:b0", "network": {"id": "75a41a6a-1c7b-47b0-907e-2015d56f554e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1001895705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ed867a40534b70bf75dc0cc28fdfec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d628ba-6b", "ovs_interfaceid": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Releasing lock "refresh_cache-39e3dfb1-bc09-474d-b8cb-f01b11923eae" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Creating instance directory {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 15:28:32 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Creating image(s)
Apr 11 15:28:32 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Did not create local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Ensure instance console log exists: /opt/stack/data/nova/instances/39e3dfb1-bc09-474d-b8cb-f01b11923eae/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Start _get_guest_xml network_info=[{"id": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24", "address": "fa:16:3e:97:55:b0", "network": {"id": "75a41a6a-1c7b-47b0-907e-2015d56f554e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1001895705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ed867a40534b70bf75dc0cc28fdfec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d628ba-6b", "ovs_interfaceid": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rEkFuIDz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '39e3dfb1-bc09-474d-b8cb-f01b11923eae', 'attached_at': '', 'detached_at': '', 'volume_id': '3132ad02-1f63-469b-b802-d814466b9ad7', 'serial': '3132ad02-1f63-469b-b802-d814466b9ad7'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '1835af7c-224d-4d18-ae06-e8d80d893e2c', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-f07a78e7-61c3-488b-add7-dbfc0248f341 req-aede65f1-9a10-4aff-8aaa-65a4859b50af service nova] Acquired lock "refresh_cache-39e3dfb1-bc09-474d-b8cb-f01b11923eae" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG nova.network.neutron [req-f07a78e7-61c3-488b-add7-dbfc0248f341 req-aede65f1-9a10-4aff-8aaa-65a4859b50af service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Refreshing network info cache for port 21d628ba-6bae-4d98-94df-bb6fbb4f1c24 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:28:32 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:28:32 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:28:32 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG nova.objects.instance [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lazy-loading 'vcpu_model' on Instance uuid 39e3dfb1-bc09-474d-b8cb-f01b11923eae {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rEkFuIDz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:28:32 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:28:32 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:28:32 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:28:32 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:28:32 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 15:28:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[387d881c-67d0-4fc3-bb4f-bd9db1ceb111]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 15:28:32 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 -p 172.16.0.220:3260 --interface default --op new {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[29148257-b980-47ec-bd0e-5680fcbcb533]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7] added\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7] added
Apr 11 15:28:32 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50376c9-7535-4164-b78e-b8bfbacc3332]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[729a1fb9-ec8d-4136-aa3b-ca2ca6c39135]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rEkFuIDz {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rEkFuIDz" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb5d90f-c67d-41d0-9f39-6aac39acee97]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rEkFuIDz'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc7c643-d31f-4d62-8de2-6faf5a783a20]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ab968e-7a74-421b-826f-46524d724248]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:28:32 user nova-compute[71229]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122 (non-flash)
Apr 11 15:28:32 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:28:32 user nova-compute[71229]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122 (non-flash)
Apr 11 15:28:32 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 -p 172.16.0.220:3260 --login {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5fae35-035b-4d4b-8b30-d1c1f6244cef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7, portal: 172.16.0.220,3260]
Apr 11 15:28:32 user nova-compute[71229]: Login to [iface: default, target: iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7, portal: 172.16.0.220,3260] successful.
Apr 11 15:28:32 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf68d1d-c7a2-4dfc-b8c0-4d9bf6c8d9ba]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ad083d-0e0d-4e53-9463-9ea47540fb43]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:28:32 user nova-compute[71229]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122 (non-flash)
Apr 11 15:28:32 user nova-compute[71229]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)
Apr 11 15:28:32 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:28:32 user nova-compute[71229]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122 (non-flash)
Apr 11 15:28:32 user nova-compute[71229]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)
Apr 11 15:28:32 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] HCTL ('35', '-', '-', 0) found on session 18 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[559be47b-977e-4b66-893c-e393cb13e27f]: (4, ('- - 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rEkFuIDz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG nova.network.neutron [req-f07a78e7-61c3-488b-add7-dbfc0248f341 req-aede65f1-9a10-4aff-8aaa-65a4859b50af service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Updated VIF entry in instance network info cache for port 21d628ba-6bae-4d98-94df-bb6fbb4f1c24. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:28:32 user nova-compute[71229]: DEBUG nova.network.neutron [req-f07a78e7-61c3-488b-add7-dbfc0248f341 req-aede65f1-9a10-4aff-8aaa-65a4859b50af service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Updating instance_info_cache with network_info: [{"id": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24", "address": "fa:16:3e:97:55:b0", "network": {"id": "75a41a6a-1c7b-47b0-907e-2015d56f554e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1001895705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ed867a40534b70bf75dc0cc28fdfec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d628ba-6b", "ovs_interfaceid": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:28:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-f07a78e7-61c3-488b-add7-dbfc0248f341 req-aede65f1-9a10-4aff-8aaa-65a4859b50af service nova] Releasing lock "refresh_cache-39e3dfb1-bc09-474d-b8cb-f01b11923eae" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:28:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-068d1bca-8d23-4dd3-9ed0-9ea1f51c367e tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Acquiring lock "fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:28:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-068d1bca-8d23-4dd3-9ed0-9ea1f51c367e tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Lock "fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:28:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-068d1bca-8d23-4dd3-9ed0-9ea1f51c367e tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Acquiring lock "fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:28:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-068d1bca-8d23-4dd3-9ed0-9ea1f51c367e tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Lock "fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:28:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-068d1bca-8d23-4dd3-9ed0-9ea1f51c367e tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Lock "fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:28:33 user nova-compute[71229]: INFO nova.compute.manager [None req-068d1bca-8d23-4dd3-9ed0-9ea1f51c367e tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Terminating instance
Apr 11 15:28:33 user nova-compute[71229]: DEBUG nova.compute.manager [None req-068d1bca-8d23-4dd3-9ed0-9ea1f51c367e tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Start destroying the instance on the hypervisor. {{(pid=71229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 15:28:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:33 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:28:33 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '26434303966343363', 'path': '/dev/sdd'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:28:33 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434303966343363', 'path': '/dev/sdd'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 15:28:33 user nova-compute[71229]: DEBUG nova.compute.manager [req-04e100e0-9332-4e54-bbff-157873a1eeee req-fa103052-910f-4137-8b9f-cbc94dc505aa service nova] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Received event network-vif-unplugged-836289ee-6293-49b3-b0c2-7012ceae0c97 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:28:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-04e100e0-9332-4e54-bbff-157873a1eeee req-fa103052-910f-4137-8b9f-cbc94dc505aa service nova] Acquiring lock "fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:28:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-04e100e0-9332-4e54-bbff-157873a1eeee req-fa103052-910f-4137-8b9f-cbc94dc505aa service nova] Lock "fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:28:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-04e100e0-9332-4e54-bbff-157873a1eeee req-fa103052-910f-4137-8b9f-cbc94dc505aa service nova] Lock "fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:28:33 user nova-compute[71229]: DEBUG nova.compute.manager [req-04e100e0-9332-4e54-bbff-157873a1eeee req-fa103052-910f-4137-8b9f-cbc94dc505aa service nova] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] No waiting events found dispatching network-vif-unplugged-836289ee-6293-49b3-b0c2-7012ceae0c97 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:28:33 user nova-compute[71229]: DEBUG nova.compute.manager [req-04e100e0-9332-4e54-bbff-157873a1eeee req-fa103052-910f-4137-8b9f-cbc94dc505aa service nova] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Received event network-vif-unplugged-836289ee-6293-49b3-b0c2-7012ceae0c97 for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 15:28:33 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T15:24:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2037395852',display_name='tempest-TestShelveInstance-server-2037395852',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2037395852',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1630475072',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:24:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='63ed867a40534b70bf75dc0cc28fdfec',ramdisk_id='',reservation_id='r-vsdu64f3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-602339736',owner_user_name='tempest-TestShelveInstance-602339736-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:28:26Z,user_data=None,user_id='49e1716b2bb2438b93d46dc8052c788b',uuid=39e3dfb1-bc09-474d-b8cb-f01b11923eae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24", "address": "fa:16:3e:97:55:b0", "network": {"id": "75a41a6a-1c7b-47b0-907e-2015d56f554e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1001895705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ed867a40534b70bf75dc0cc28fdfec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d628ba-6b", "ovs_interfaceid": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:28:33 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Converting VIF {"id": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24", "address": "fa:16:3e:97:55:b0", "network": {"id": "75a41a6a-1c7b-47b0-907e-2015d56f554e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1001895705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ed867a40534b70bf75dc0cc28fdfec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d628ba-6b", "ovs_interfaceid": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:28:33 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:55:b0,bridge_name='br-int',has_traffic_filtering=True,id=21d628ba-6bae-4d98-94df-bb6fbb4f1c24,network=Network(75a41a6a-1c7b-47b0-907e-2015d56f554e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21d628ba-6b') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:28:33 user nova-compute[71229]: DEBUG nova.objects.instance [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lazy-loading 'pci_devices' on Instance uuid 39e3dfb1-bc09-474d-b8cb-f01b11923eae {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:28:33 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:28:33 user nova-compute[71229]:   <uuid>39e3dfb1-bc09-474d-b8cb-f01b11923eae</uuid>
Apr 11 15:28:33 user nova-compute[71229]:   <name>instance-0000000e</name>
Apr 11 15:28:33 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:28:33 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:28:33 user nova-compute[71229]:   <metadata>
Apr 11 15:28:33 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:28:33 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:28:33 user nova-compute[71229]:       <nova:name>tempest-TestShelveInstance-server-2037395852</nova:name>
Apr 11 15:28:33 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:28:32</nova:creationTime>
Apr 11 15:28:33 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:28:33 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:28:33 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:28:33 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:28:33 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:28:33 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:28:33 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:28:33 user nova-compute[71229]:       <nova:owner>
Apr 11 15:28:33 user nova-compute[71229]:         <nova:user uuid="49e1716b2bb2438b93d46dc8052c788b">tempest-TestShelveInstance-602339736-project-member</nova:user>
Apr 11 15:28:33 user nova-compute[71229]:         <nova:project uuid="63ed867a40534b70bf75dc0cc28fdfec">tempest-TestShelveInstance-602339736</nova:project>
Apr 11 15:28:33 user nova-compute[71229]:       </nova:owner>
Apr 11 15:28:33 user nova-compute[71229]:       <nova:ports>
Apr 11 15:28:33 user nova-compute[71229]:         <nova:port uuid="21d628ba-6bae-4d98-94df-bb6fbb4f1c24">
Apr 11 15:28:33 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 11 15:28:33 user nova-compute[71229]:         </nova:port>
Apr 11 15:28:33 user nova-compute[71229]:       </nova:ports>
Apr 11 15:28:33 user nova-compute[71229]:     </nova:instance>
Apr 11 15:28:33 user nova-compute[71229]:   </metadata>
Apr 11 15:28:33 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:28:33 user nova-compute[71229]:     <system>
Apr 11 15:28:33 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:28:33 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:28:33 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:28:33 user nova-compute[71229]:       <entry name="serial">39e3dfb1-bc09-474d-b8cb-f01b11923eae</entry>
Apr 11 15:28:33 user nova-compute[71229]:       <entry name="uuid">39e3dfb1-bc09-474d-b8cb-f01b11923eae</entry>
Apr 11 15:28:33 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:28:33 user nova-compute[71229]:     </system>
Apr 11 15:28:33 user nova-compute[71229]:   </sysinfo>
Apr 11 15:28:33 user nova-compute[71229]:   <os>
Apr 11 15:28:33 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:28:33 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 15:28:33 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:28:33 user nova-compute[71229]:   </os>
Apr 11 15:28:33 user nova-compute[71229]:   <features>
Apr 11 15:28:33 user nova-compute[71229]:     <acpi/>
Apr 11 15:28:33 user nova-compute[71229]:     <apic/>
Apr 11 15:28:33 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:28:33 user nova-compute[71229]:   </features>
Apr 11 15:28:33 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:28:33 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:28:33 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:28:33 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:28:33 user nova-compute[71229]:   </clock>
Apr 11 15:28:33 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:28:33 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:28:33 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:28:33 user nova-compute[71229]:   </cpu>
Apr 11 15:28:33 user nova-compute[71229]:   <devices>
Apr 11 15:28:33 user nova-compute[71229]:     <disk type="block" device="disk">
Apr 11 15:28:33 user nova-compute[71229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:28:33 user nova-compute[71229]:       <source dev="/dev/sdd"/>
Apr 11 15:28:33 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:28:33 user nova-compute[71229]:       <serial>3132ad02-1f63-469b-b802-d814466b9ad7</serial>
Apr 11 15:28:33 user nova-compute[71229]:     </disk>
Apr 11 15:28:33 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:28:33 user nova-compute[71229]:       <mac address="fa:16:3e:97:55:b0"/>
Apr 11 15:28:33 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:28:33 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:28:33 user nova-compute[71229]:       <target dev="tap21d628ba-6b"/>
Apr 11 15:28:33 user nova-compute[71229]:     </interface>
Apr 11 15:28:33 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:28:33 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/39e3dfb1-bc09-474d-b8cb-f01b11923eae/console.log" append="off"/>
Apr 11 15:28:33 user nova-compute[71229]:     </serial>
Apr 11 15:28:33 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:28:33 user nova-compute[71229]:     <video>
Apr 11 15:28:33 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:28:33 user nova-compute[71229]:     </video>
Apr 11 15:28:33 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:28:33 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:28:33 user nova-compute[71229]:     </rng>
Apr 11 15:28:33 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:28:33 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:28:33 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:28:33 user nova-compute[71229]:     </memballoon>
Apr 11 15:28:33 user nova-compute[71229]:   </devices>
Apr 11 15:28:33 user nova-compute[71229]: </domain>
Apr 11 15:28:33 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:28:33 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T15:24:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2037395852',display_name='tempest-TestShelveInstance-server-2037395852',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2037395852',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1630475072',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:24:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='63ed867a40534b70bf75dc0cc28fdfec',ramdisk_id='',reservation_id='r-vsdu64f3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-602339736',owner_user_name='tempest-TestShelveInstance-602339736-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:28:26Z,user_data=None,user_id='49e1716b2bb2438b93d46dc8052c788b',uuid=39e3dfb1-bc09-474d-b8cb-f01b11923eae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24", "address": "fa:16:3e:97:55:b0", "network": {"id": "75a41a6a-1c7b-47b0-907e-2015d56f554e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1001895705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ed867a40534b70bf75dc0cc28fdfec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d628ba-6b", "ovs_interfaceid": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:28:33 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Converting VIF {"id": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24", "address": "fa:16:3e:97:55:b0", "network": {"id": "75a41a6a-1c7b-47b0-907e-2015d56f554e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1001895705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ed867a40534b70bf75dc0cc28fdfec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d628ba-6b", "ovs_interfaceid": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:28:33 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:55:b0,bridge_name='br-int',has_traffic_filtering=True,id=21d628ba-6bae-4d98-94df-bb6fbb4f1c24,network=Network(75a41a6a-1c7b-47b0-907e-2015d56f554e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21d628ba-6b') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:28:33 user nova-compute[71229]: DEBUG os_vif [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:55:b0,bridge_name='br-int',has_traffic_filtering=True,id=21d628ba-6bae-4d98-94df-bb6fbb4f1c24,network=Network(75a41a6a-1c7b-47b0-907e-2015d56f554e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21d628ba-6b') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:28:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:28:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:28:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21d628ba-6b, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:28:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap21d628ba-6b, col_values=(('external_ids', {'iface-id': '21d628ba-6bae-4d98-94df-bb6fbb4f1c24', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:55:b0', 'vm-uuid': '39e3dfb1-bc09-474d-b8cb-f01b11923eae'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:28:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:28:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:33 user nova-compute[71229]: INFO os_vif [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:55:b0,bridge_name='br-int',has_traffic_filtering=True,id=21d628ba-6bae-4d98-94df-bb6fbb4f1c24,network=Network(75a41a6a-1c7b-47b0-907e-2015d56f554e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21d628ba-6b')
Apr 11 15:28:34 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:28:34 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] No VIF found with MAC fa:16:3e:97:55:b0, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:28:34 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:34 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:34 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:34 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:34 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Instance destroyed successfully.
Apr 11 15:28:34 user nova-compute[71229]: DEBUG nova.objects.instance [None req-068d1bca-8d23-4dd3-9ed0-9ea1f51c367e tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Lazy-loading 'resources' on Instance uuid fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:28:34 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-068d1bca-8d23-4dd3-9ed0-9ea1f51c367e tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:26:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1343431818',display_name='tempest-VolumesActionsTest-instance-1343431818',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1343431818',id=16,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:26:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='14c9c879d28040aba0ebc76bc2a80693',ramdisk_id='',reservation_id='r-mk5dk8r9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-955235995',owner_user_name='tempest-VolumesActionsTest-955235995-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:26:46Z,user_data=None,user_id='90c7f9af6776413c91e2638712a142f7',uuid=fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "836289ee-6293-49b3-b0c2-7012ceae0c97", "address": "fa:16:3e:20:c1:85", "network": {"id": "80c5b877-1e8a-4e8f-8490-7cb77946f044", "bridge": "br-int", "label": "tempest-VolumesActionsTest-60003582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "14c9c879d28040aba0ebc76bc2a80693", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap836289ee-62", "ovs_interfaceid": "836289ee-6293-49b3-b0c2-7012ceae0c97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:28:34 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-068d1bca-8d23-4dd3-9ed0-9ea1f51c367e tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Converting VIF {"id": "836289ee-6293-49b3-b0c2-7012ceae0c97", "address": "fa:16:3e:20:c1:85", "network": {"id": "80c5b877-1e8a-4e8f-8490-7cb77946f044", "bridge": "br-int", "label": "tempest-VolumesActionsTest-60003582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "14c9c879d28040aba0ebc76bc2a80693", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap836289ee-62", "ovs_interfaceid": "836289ee-6293-49b3-b0c2-7012ceae0c97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:28:34 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-068d1bca-8d23-4dd3-9ed0-9ea1f51c367e tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:c1:85,bridge_name='br-int',has_traffic_filtering=True,id=836289ee-6293-49b3-b0c2-7012ceae0c97,network=Network(80c5b877-1e8a-4e8f-8490-7cb77946f044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap836289ee-62') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:28:34 user nova-compute[71229]: DEBUG os_vif [None req-068d1bca-8d23-4dd3-9ed0-9ea1f51c367e tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:c1:85,bridge_name='br-int',has_traffic_filtering=True,id=836289ee-6293-49b3-b0c2-7012ceae0c97,network=Network(80c5b877-1e8a-4e8f-8490-7cb77946f044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap836289ee-62') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:28:34 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:34 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap836289ee-62, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:28:34 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:34 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:28:34 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:34 user nova-compute[71229]: INFO os_vif [None req-068d1bca-8d23-4dd3-9ed0-9ea1f51c367e tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:c1:85,bridge_name='br-int',has_traffic_filtering=True,id=836289ee-6293-49b3-b0c2-7012ceae0c97,network=Network(80c5b877-1e8a-4e8f-8490-7cb77946f044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap836289ee-62')
Apr 11 15:28:34 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-068d1bca-8d23-4dd3-9ed0-9ea1f51c367e tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Deleting instance files /opt/stack/data/nova/instances/fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5_del
Apr 11 15:28:34 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-068d1bca-8d23-4dd3-9ed0-9ea1f51c367e tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Deletion of /opt/stack/data/nova/instances/fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5_del complete
Apr 11 15:28:34 user nova-compute[71229]: INFO nova.compute.manager [None req-068d1bca-8d23-4dd3-9ed0-9ea1f51c367e tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Took 1.12 seconds to destroy the instance on the hypervisor.
Apr 11 15:28:34 user nova-compute[71229]: DEBUG oslo.service.loopingcall [None req-068d1bca-8d23-4dd3-9ed0-9ea1f51c367e tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71229) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 15:28:34 user nova-compute[71229]: DEBUG nova.compute.manager [-] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Deallocating network for instance {{(pid=71229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 15:28:34 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] deallocate_for_instance() {{(pid=71229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 15:28:35 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:28:35 user nova-compute[71229]: DEBUG nova.compute.manager [req-6168acc8-76c9-4b25-8da3-8a22dc33eb4b req-ef390d4f-eb9f-44df-a557-ec685c4634ba service nova] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Received event network-vif-deleted-836289ee-6293-49b3-b0c2-7012ceae0c97 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:28:35 user nova-compute[71229]: INFO nova.compute.manager [req-6168acc8-76c9-4b25-8da3-8a22dc33eb4b req-ef390d4f-eb9f-44df-a557-ec685c4634ba service nova] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Neutron deleted interface 836289ee-6293-49b3-b0c2-7012ceae0c97; detaching it from the instance and deleting it from the info cache
Apr 11 15:28:35 user nova-compute[71229]: DEBUG nova.network.neutron [req-6168acc8-76c9-4b25-8da3-8a22dc33eb4b req-ef390d4f-eb9f-44df-a557-ec685c4634ba service nova] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:28:35 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Took 0.56 seconds to deallocate network for instance.
Apr 11 15:28:35 user nova-compute[71229]: DEBUG nova.compute.manager [req-6168acc8-76c9-4b25-8da3-8a22dc33eb4b req-ef390d4f-eb9f-44df-a557-ec685c4634ba service nova] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Detach interface failed, port_id=836289ee-6293-49b3-b0c2-7012ceae0c97, reason: Instance fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5 could not be found. {{(pid=71229) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 15:28:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-068d1bca-8d23-4dd3-9ed0-9ea1f51c367e tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:28:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-068d1bca-8d23-4dd3-9ed0-9ea1f51c367e tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:28:35 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:35 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:35 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:35 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-068d1bca-8d23-4dd3-9ed0-9ea1f51c367e tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:28:35 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-068d1bca-8d23-4dd3-9ed0-9ea1f51c367e tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:28:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-068d1bca-8d23-4dd3-9ed0-9ea1f51c367e tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:28:35 user nova-compute[71229]: INFO nova.scheduler.client.report [None req-068d1bca-8d23-4dd3-9ed0-9ea1f51c367e tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Deleted allocations for instance fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5
Apr 11 15:28:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-068d1bca-8d23-4dd3-9ed0-9ea1f51c367e tempest-VolumesActionsTest-955235995 tempest-VolumesActionsTest-955235995-project-member] Lock "fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.302s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:28:35 user nova-compute[71229]: DEBUG nova.compute.manager [req-92185f72-defe-440e-a70c-24fffc8dcaef req-83633bbd-39e4-4df1-9769-132261c9a433 service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Received event network-vif-plugged-21d628ba-6bae-4d98-94df-bb6fbb4f1c24 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:28:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-92185f72-defe-440e-a70c-24fffc8dcaef req-83633bbd-39e4-4df1-9769-132261c9a433 service nova] Acquiring lock "39e3dfb1-bc09-474d-b8cb-f01b11923eae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:28:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-92185f72-defe-440e-a70c-24fffc8dcaef req-83633bbd-39e4-4df1-9769-132261c9a433 service nova] Lock "39e3dfb1-bc09-474d-b8cb-f01b11923eae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:28:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-92185f72-defe-440e-a70c-24fffc8dcaef req-83633bbd-39e4-4df1-9769-132261c9a433 service nova] Lock "39e3dfb1-bc09-474d-b8cb-f01b11923eae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:28:35 user nova-compute[71229]: DEBUG nova.compute.manager [req-92185f72-defe-440e-a70c-24fffc8dcaef req-83633bbd-39e4-4df1-9769-132261c9a433 service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] No waiting events found dispatching network-vif-plugged-21d628ba-6bae-4d98-94df-bb6fbb4f1c24 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:28:35 user nova-compute[71229]: WARNING nova.compute.manager [req-92185f72-defe-440e-a70c-24fffc8dcaef req-83633bbd-39e4-4df1-9769-132261c9a433 service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Received unexpected event network-vif-plugged-21d628ba-6bae-4d98-94df-bb6fbb4f1c24 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 11 15:28:35 user nova-compute[71229]: DEBUG nova.compute.manager [req-2e3d442b-3ba5-44e3-a447-78dfe7bf59b8 req-0e0d3c77-1815-48cb-a27a-93b92423c09f service nova] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Received event network-vif-plugged-836289ee-6293-49b3-b0c2-7012ceae0c97 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:28:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2e3d442b-3ba5-44e3-a447-78dfe7bf59b8 req-0e0d3c77-1815-48cb-a27a-93b92423c09f service nova] Acquiring lock "fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:28:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2e3d442b-3ba5-44e3-a447-78dfe7bf59b8 req-0e0d3c77-1815-48cb-a27a-93b92423c09f service nova] Lock "fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:28:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2e3d442b-3ba5-44e3-a447-78dfe7bf59b8 req-0e0d3c77-1815-48cb-a27a-93b92423c09f service nova] Lock "fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:28:35 user nova-compute[71229]: DEBUG nova.compute.manager [req-2e3d442b-3ba5-44e3-a447-78dfe7bf59b8 req-0e0d3c77-1815-48cb-a27a-93b92423c09f service nova] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] No waiting events found dispatching network-vif-plugged-836289ee-6293-49b3-b0c2-7012ceae0c97 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:28:35 user nova-compute[71229]: WARNING nova.compute.manager [req-2e3d442b-3ba5-44e3-a447-78dfe7bf59b8 req-0e0d3c77-1815-48cb-a27a-93b92423c09f service nova] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Received unexpected event network-vif-plugged-836289ee-6293-49b3-b0c2-7012ceae0c97 for instance with vm_state deleted and task_state None.
Apr 11 15:28:35 user nova-compute[71229]: DEBUG nova.compute.manager [req-2e3d442b-3ba5-44e3-a447-78dfe7bf59b8 req-0e0d3c77-1815-48cb-a27a-93b92423c09f service nova] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Received event network-vif-plugged-836289ee-6293-49b3-b0c2-7012ceae0c97 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:28:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2e3d442b-3ba5-44e3-a447-78dfe7bf59b8 req-0e0d3c77-1815-48cb-a27a-93b92423c09f service nova] Acquiring lock "fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:28:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2e3d442b-3ba5-44e3-a447-78dfe7bf59b8 req-0e0d3c77-1815-48cb-a27a-93b92423c09f service nova] Lock "fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:28:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2e3d442b-3ba5-44e3-a447-78dfe7bf59b8 req-0e0d3c77-1815-48cb-a27a-93b92423c09f service nova] Lock "fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:28:35 user nova-compute[71229]: DEBUG nova.compute.manager [req-2e3d442b-3ba5-44e3-a447-78dfe7bf59b8 req-0e0d3c77-1815-48cb-a27a-93b92423c09f service nova] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] No waiting events found dispatching network-vif-plugged-836289ee-6293-49b3-b0c2-7012ceae0c97 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:28:35 user nova-compute[71229]: WARNING nova.compute.manager [req-2e3d442b-3ba5-44e3-a447-78dfe7bf59b8 req-0e0d3c77-1815-48cb-a27a-93b92423c09f service nova] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Received unexpected event network-vif-plugged-836289ee-6293-49b3-b0c2-7012ceae0c97 for instance with vm_state deleted and task_state None.
Apr 11 15:28:35 user nova-compute[71229]: DEBUG nova.compute.manager [req-2e3d442b-3ba5-44e3-a447-78dfe7bf59b8 req-0e0d3c77-1815-48cb-a27a-93b92423c09f service nova] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Received event network-vif-plugged-836289ee-6293-49b3-b0c2-7012ceae0c97 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:28:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2e3d442b-3ba5-44e3-a447-78dfe7bf59b8 req-0e0d3c77-1815-48cb-a27a-93b92423c09f service nova] Acquiring lock "fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:28:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2e3d442b-3ba5-44e3-a447-78dfe7bf59b8 req-0e0d3c77-1815-48cb-a27a-93b92423c09f service nova] Lock "fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:28:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2e3d442b-3ba5-44e3-a447-78dfe7bf59b8 req-0e0d3c77-1815-48cb-a27a-93b92423c09f service nova] Lock "fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:28:35 user nova-compute[71229]: DEBUG nova.compute.manager [req-2e3d442b-3ba5-44e3-a447-78dfe7bf59b8 req-0e0d3c77-1815-48cb-a27a-93b92423c09f service nova] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] No waiting events found dispatching network-vif-plugged-836289ee-6293-49b3-b0c2-7012ceae0c97 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:28:35 user nova-compute[71229]: WARNING nova.compute.manager [req-2e3d442b-3ba5-44e3-a447-78dfe7bf59b8 req-0e0d3c77-1815-48cb-a27a-93b92423c09f service nova] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Received unexpected event network-vif-plugged-836289ee-6293-49b3-b0c2-7012ceae0c97 for instance with vm_state deleted and task_state None.
Apr 11 15:28:35 user nova-compute[71229]: DEBUG nova.compute.manager [req-2e3d442b-3ba5-44e3-a447-78dfe7bf59b8 req-0e0d3c77-1815-48cb-a27a-93b92423c09f service nova] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Received event network-vif-unplugged-836289ee-6293-49b3-b0c2-7012ceae0c97 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:28:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2e3d442b-3ba5-44e3-a447-78dfe7bf59b8 req-0e0d3c77-1815-48cb-a27a-93b92423c09f service nova] Acquiring lock "fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:28:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2e3d442b-3ba5-44e3-a447-78dfe7bf59b8 req-0e0d3c77-1815-48cb-a27a-93b92423c09f service nova] Lock "fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:28:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2e3d442b-3ba5-44e3-a447-78dfe7bf59b8 req-0e0d3c77-1815-48cb-a27a-93b92423c09f service nova] Lock "fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:28:35 user nova-compute[71229]: DEBUG nova.compute.manager [req-2e3d442b-3ba5-44e3-a447-78dfe7bf59b8 req-0e0d3c77-1815-48cb-a27a-93b92423c09f service nova] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] No waiting events found dispatching network-vif-unplugged-836289ee-6293-49b3-b0c2-7012ceae0c97 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:28:35 user nova-compute[71229]: WARNING nova.compute.manager [req-2e3d442b-3ba5-44e3-a447-78dfe7bf59b8 req-0e0d3c77-1815-48cb-a27a-93b92423c09f service nova] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Received unexpected event network-vif-unplugged-836289ee-6293-49b3-b0c2-7012ceae0c97 for instance with vm_state deleted and task_state None.
Apr 11 15:28:35 user nova-compute[71229]: DEBUG nova.compute.manager [req-2e3d442b-3ba5-44e3-a447-78dfe7bf59b8 req-0e0d3c77-1815-48cb-a27a-93b92423c09f service nova] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Received event network-vif-plugged-836289ee-6293-49b3-b0c2-7012ceae0c97 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:28:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2e3d442b-3ba5-44e3-a447-78dfe7bf59b8 req-0e0d3c77-1815-48cb-a27a-93b92423c09f service nova] Acquiring lock "fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:28:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2e3d442b-3ba5-44e3-a447-78dfe7bf59b8 req-0e0d3c77-1815-48cb-a27a-93b92423c09f service nova] Lock "fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:28:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2e3d442b-3ba5-44e3-a447-78dfe7bf59b8 req-0e0d3c77-1815-48cb-a27a-93b92423c09f service nova] Lock "fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:28:35 user nova-compute[71229]: DEBUG nova.compute.manager [req-2e3d442b-3ba5-44e3-a447-78dfe7bf59b8 req-0e0d3c77-1815-48cb-a27a-93b92423c09f service nova] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] No waiting events found dispatching network-vif-plugged-836289ee-6293-49b3-b0c2-7012ceae0c97 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:28:35 user nova-compute[71229]: WARNING nova.compute.manager [req-2e3d442b-3ba5-44e3-a447-78dfe7bf59b8 req-0e0d3c77-1815-48cb-a27a-93b92423c09f service nova] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Received unexpected event network-vif-plugged-836289ee-6293-49b3-b0c2-7012ceae0c97 for instance with vm_state deleted and task_state None.
Apr 11 15:28:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:37 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681226917.76804, 39e3dfb1-bc09-474d-b8cb-f01b11923eae => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:28:37 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] VM Resumed (Lifecycle Event)
Apr 11 15:28:37 user nova-compute[71229]: DEBUG nova.compute.manager [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 15:28:37 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Guest created on hypervisor {{(pid=71229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 15:28:37 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Instance spawned successfully.
Apr 11 15:28:37 user nova-compute[71229]: DEBUG nova.compute.manager [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:28:37 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:28:37 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:28:37 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:28:37 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681226917.7698982, 39e3dfb1-bc09-474d-b8cb-f01b11923eae => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:28:37 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] VM Started (Lifecycle Event)
Apr 11 15:28:37 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:28:37 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:28:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f673c973-bac3-4b85-9c95-7acc3a8d6223 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "39e3dfb1-bc09-474d-b8cb-f01b11923eae" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.182s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:28:37 user nova-compute[71229]: DEBUG nova.compute.manager [req-5bd479b0-4d22-4726-88b1-001517ab7c68 req-a4f71964-9a42-4638-bcc6-0e035d2b51de service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Received event network-vif-plugged-21d628ba-6bae-4d98-94df-bb6fbb4f1c24 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:28:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-5bd479b0-4d22-4726-88b1-001517ab7c68 req-a4f71964-9a42-4638-bcc6-0e035d2b51de service nova] Acquiring lock "39e3dfb1-bc09-474d-b8cb-f01b11923eae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:28:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-5bd479b0-4d22-4726-88b1-001517ab7c68 req-a4f71964-9a42-4638-bcc6-0e035d2b51de service nova] Lock "39e3dfb1-bc09-474d-b8cb-f01b11923eae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:28:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-5bd479b0-4d22-4726-88b1-001517ab7c68 req-a4f71964-9a42-4638-bcc6-0e035d2b51de service nova] Lock "39e3dfb1-bc09-474d-b8cb-f01b11923eae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:28:37 user nova-compute[71229]: DEBUG nova.compute.manager [req-5bd479b0-4d22-4726-88b1-001517ab7c68 req-a4f71964-9a42-4638-bcc6-0e035d2b51de service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] No waiting events found dispatching network-vif-plugged-21d628ba-6bae-4d98-94df-bb6fbb4f1c24 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:28:37 user nova-compute[71229]: WARNING nova.compute.manager [req-5bd479b0-4d22-4726-88b1-001517ab7c68 req-a4f71964-9a42-4638-bcc6-0e035d2b51de service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Received unexpected event network-vif-plugged-21d628ba-6bae-4d98-94df-bb6fbb4f1c24 for instance with vm_state active and task_state None.
Apr 11 15:28:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b6a951b9-ee8c-46d2-955c-97d13337e49b tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Acquiring lock "f846ecc9-ecc4-4e8f-aca3-39d83b56f414" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:28:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b6a951b9-ee8c-46d2-955c-97d13337e49b tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "f846ecc9-ecc4-4e8f-aca3-39d83b56f414" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:28:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b6a951b9-ee8c-46d2-955c-97d13337e49b tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Acquiring lock "f846ecc9-ecc4-4e8f-aca3-39d83b56f414-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:28:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b6a951b9-ee8c-46d2-955c-97d13337e49b tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "f846ecc9-ecc4-4e8f-aca3-39d83b56f414-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:28:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b6a951b9-ee8c-46d2-955c-97d13337e49b tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "f846ecc9-ecc4-4e8f-aca3-39d83b56f414-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:28:43 user nova-compute[71229]: INFO nova.compute.manager [None req-b6a951b9-ee8c-46d2-955c-97d13337e49b tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Terminating instance
Apr 11 15:28:43 user nova-compute[71229]: DEBUG nova.compute.manager [None req-b6a951b9-ee8c-46d2-955c-97d13337e49b tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Start destroying the instance on the hypervisor. {{(pid=71229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 15:28:43 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:43 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:43 user nova-compute[71229]: DEBUG nova.compute.manager [req-9c9ae32c-60c5-4a16-8d91-f079720974a0 req-ddbb96a8-0c8e-43b6-ad54-bec14a24c9a5 service nova] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Received event network-vif-unplugged-ce99a25f-dfdb-4798-8830-d2f4a66e6cc8 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:28:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-9c9ae32c-60c5-4a16-8d91-f079720974a0 req-ddbb96a8-0c8e-43b6-ad54-bec14a24c9a5 service nova] Acquiring lock "f846ecc9-ecc4-4e8f-aca3-39d83b56f414-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:28:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-9c9ae32c-60c5-4a16-8d91-f079720974a0 req-ddbb96a8-0c8e-43b6-ad54-bec14a24c9a5 service nova] Lock "f846ecc9-ecc4-4e8f-aca3-39d83b56f414-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:28:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-9c9ae32c-60c5-4a16-8d91-f079720974a0 req-ddbb96a8-0c8e-43b6-ad54-bec14a24c9a5 service nova] Lock "f846ecc9-ecc4-4e8f-aca3-39d83b56f414-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:28:43 user nova-compute[71229]: DEBUG nova.compute.manager [req-9c9ae32c-60c5-4a16-8d91-f079720974a0 req-ddbb96a8-0c8e-43b6-ad54-bec14a24c9a5 service nova] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] No waiting events found dispatching network-vif-unplugged-ce99a25f-dfdb-4798-8830-d2f4a66e6cc8 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:28:43 user nova-compute[71229]: DEBUG nova.compute.manager [req-9c9ae32c-60c5-4a16-8d91-f079720974a0 req-ddbb96a8-0c8e-43b6-ad54-bec14a24c9a5 service nova] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Received event network-vif-unplugged-ce99a25f-dfdb-4798-8830-d2f4a66e6cc8 for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 15:28:43 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:43 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:44 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Instance destroyed successfully.
Apr 11 15:28:44 user nova-compute[71229]: DEBUG nova.objects.instance [None req-b6a951b9-ee8c-46d2-955c-97d13337e49b tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lazy-loading 'resources' on Instance uuid f846ecc9-ecc4-4e8f-aca3-39d83b56f414 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:28:44 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-b6a951b9-ee8c-46d2-955c-97d13337e49b tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:26:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-791973205',display_name='tempest-ServersNegativeTestJSON-server-791973205',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-791973205',id=17,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:27:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='561130d089c8415297697bcedc93aefc',ramdisk_id='',reservation_id='r-l971skxg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1004375615',owner_user_name='tempest-ServersNegativeTestJSON-1004375615-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:27:03Z,user_data=None,user_id='b2538af5c739404aa433b766976e5b2d',uuid=f846ecc9-ecc4-4e8f-aca3-39d83b56f414,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce99a25f-dfdb-4798-8830-d2f4a66e6cc8", "address": "fa:16:3e:33:21:56", "network": {"id": "f9b1d398-27cb-42de-9d95-0e031b1bd6ec", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1833751152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "561130d089c8415297697bcedc93aefc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce99a25f-df", "ovs_interfaceid": "ce99a25f-dfdb-4798-8830-d2f4a66e6cc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:28:44 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-b6a951b9-ee8c-46d2-955c-97d13337e49b tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Converting VIF {"id": "ce99a25f-dfdb-4798-8830-d2f4a66e6cc8", "address": "fa:16:3e:33:21:56", "network": {"id": "f9b1d398-27cb-42de-9d95-0e031b1bd6ec", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1833751152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "561130d089c8415297697bcedc93aefc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce99a25f-df", "ovs_interfaceid": "ce99a25f-dfdb-4798-8830-d2f4a66e6cc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:28:44 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-b6a951b9-ee8c-46d2-955c-97d13337e49b tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:21:56,bridge_name='br-int',has_traffic_filtering=True,id=ce99a25f-dfdb-4798-8830-d2f4a66e6cc8,network=Network(f9b1d398-27cb-42de-9d95-0e031b1bd6ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce99a25f-df') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:28:44 user nova-compute[71229]: DEBUG os_vif [None req-b6a951b9-ee8c-46d2-955c-97d13337e49b tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:21:56,bridge_name='br-int',has_traffic_filtering=True,id=ce99a25f-dfdb-4798-8830-d2f4a66e6cc8,network=Network(f9b1d398-27cb-42de-9d95-0e031b1bd6ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce99a25f-df') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:28:44 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:44 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce99a25f-df, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:28:44 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:44 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:28:44 user nova-compute[71229]: INFO os_vif [None req-b6a951b9-ee8c-46d2-955c-97d13337e49b tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:21:56,bridge_name='br-int',has_traffic_filtering=True,id=ce99a25f-dfdb-4798-8830-d2f4a66e6cc8,network=Network(f9b1d398-27cb-42de-9d95-0e031b1bd6ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce99a25f-df')
Apr 11 15:28:44 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-b6a951b9-ee8c-46d2-955c-97d13337e49b tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Deleting instance files /opt/stack/data/nova/instances/f846ecc9-ecc4-4e8f-aca3-39d83b56f414_del
Apr 11 15:28:44 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-b6a951b9-ee8c-46d2-955c-97d13337e49b tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Deletion of /opt/stack/data/nova/instances/f846ecc9-ecc4-4e8f-aca3-39d83b56f414_del complete
Apr 11 15:28:44 user nova-compute[71229]: INFO nova.compute.manager [None req-b6a951b9-ee8c-46d2-955c-97d13337e49b tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Took 0.67 seconds to destroy the instance on the hypervisor.
Apr 11 15:28:44 user nova-compute[71229]: DEBUG oslo.service.loopingcall [None req-b6a951b9-ee8c-46d2-955c-97d13337e49b tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71229) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 15:28:44 user nova-compute[71229]: DEBUG nova.compute.manager [-] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Deallocating network for instance {{(pid=71229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 15:28:44 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] deallocate_for_instance() {{(pid=71229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 15:28:44 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:28:44 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Took 0.44 seconds to deallocate network for instance.
Apr 11 15:28:44 user nova-compute[71229]: DEBUG nova.compute.manager [req-6c0d58f4-ae80-4654-990e-429b6f7ac991 req-94fe4a36-a621-4322-bd1e-c809f99c52f7 service nova] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Received event network-vif-deleted-ce99a25f-dfdb-4798-8830-d2f4a66e6cc8 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:28:44 user nova-compute[71229]: INFO nova.compute.manager [req-6c0d58f4-ae80-4654-990e-429b6f7ac991 req-94fe4a36-a621-4322-bd1e-c809f99c52f7 service nova] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Neutron deleted interface ce99a25f-dfdb-4798-8830-d2f4a66e6cc8; detaching it from the instance and deleting it from the info cache
Apr 11 15:28:44 user nova-compute[71229]: DEBUG nova.network.neutron [req-6c0d58f4-ae80-4654-990e-429b6f7ac991 req-94fe4a36-a621-4322-bd1e-c809f99c52f7 service nova] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:28:44 user nova-compute[71229]: DEBUG nova.compute.manager [req-6c0d58f4-ae80-4654-990e-429b6f7ac991 req-94fe4a36-a621-4322-bd1e-c809f99c52f7 service nova] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Detach interface failed, port_id=ce99a25f-dfdb-4798-8830-d2f4a66e6cc8, reason: Instance f846ecc9-ecc4-4e8f-aca3-39d83b56f414 could not be found. {{(pid=71229) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 15:28:44 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b6a951b9-ee8c-46d2-955c-97d13337e49b tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:28:44 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b6a951b9-ee8c-46d2-955c-97d13337e49b tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:28:44 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-b6a951b9-ee8c-46d2-955c-97d13337e49b tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:28:44 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-b6a951b9-ee8c-46d2-955c-97d13337e49b tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:28:44 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b6a951b9-ee8c-46d2-955c-97d13337e49b tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.325s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:28:45 user nova-compute[71229]: INFO nova.scheduler.client.report [None req-b6a951b9-ee8c-46d2-955c-97d13337e49b tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Deleted allocations for instance f846ecc9-ecc4-4e8f-aca3-39d83b56f414
Apr 11 15:28:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b6a951b9-ee8c-46d2-955c-97d13337e49b tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "f846ecc9-ecc4-4e8f-aca3-39d83b56f414" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.609s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:28:46 user nova-compute[71229]: DEBUG nova.compute.manager [req-0d1b70ae-c788-43ed-8d74-c21b196c94a9 req-53e97fb2-9664-4b7d-a6ae-7a465e8a9de0 service nova] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Received event network-vif-plugged-ce99a25f-dfdb-4798-8830-d2f4a66e6cc8 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:28:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-0d1b70ae-c788-43ed-8d74-c21b196c94a9 req-53e97fb2-9664-4b7d-a6ae-7a465e8a9de0 service nova] Acquiring lock "f846ecc9-ecc4-4e8f-aca3-39d83b56f414-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:28:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-0d1b70ae-c788-43ed-8d74-c21b196c94a9 req-53e97fb2-9664-4b7d-a6ae-7a465e8a9de0 service nova] Lock "f846ecc9-ecc4-4e8f-aca3-39d83b56f414-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:28:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-0d1b70ae-c788-43ed-8d74-c21b196c94a9 req-53e97fb2-9664-4b7d-a6ae-7a465e8a9de0 service nova] Lock "f846ecc9-ecc4-4e8f-aca3-39d83b56f414-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:28:46 user nova-compute[71229]: DEBUG nova.compute.manager [req-0d1b70ae-c788-43ed-8d74-c21b196c94a9 req-53e97fb2-9664-4b7d-a6ae-7a465e8a9de0 service nova] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] No waiting events found dispatching network-vif-plugged-ce99a25f-dfdb-4798-8830-d2f4a66e6cc8 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:28:46 user nova-compute[71229]: WARNING nova.compute.manager [req-0d1b70ae-c788-43ed-8d74-c21b196c94a9 req-53e97fb2-9664-4b7d-a6ae-7a465e8a9de0 service nova] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Received unexpected event network-vif-plugged-ce99a25f-dfdb-4798-8830-d2f4a66e6cc8 for instance with vm_state deleted and task_state None.
Apr 11 15:28:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:49 user nova-compute[71229]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681226914.6233993, fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5 => Stopped> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:28:49 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] VM Stopped (Lifecycle Event)
Apr 11 15:28:49 user nova-compute[71229]: DEBUG nova.compute.manager [None req-f3e47649-49fd-483c-82a4-6f05075fb304 None None] [instance: fd5ba7c6-c2aa-4569-89dd-2d49327d7ed5] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:28:51 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:54 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:54 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:28:54 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 15:28:54 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:28:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:28:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:28:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:28:54 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 15:28:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:28:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:28:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:28:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:28:55 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:28:55 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:28:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d534d17d-ba77-4447-8a63-7d6021ad7896/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:28:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d534d17d-ba77-4447-8a63-7d6021ad7896/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:28:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d534d17d-ba77-4447-8a63-7d6021ad7896/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:28:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d534d17d-ba77-4447-8a63-7d6021ad7896/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:28:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:28:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:28:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:28:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:28:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4555892-7abb-4a3c-a4ae-a27ad4902708/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:28:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4555892-7abb-4a3c-a4ae-a27ad4902708/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:28:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4555892-7abb-4a3c-a4ae-a27ad4902708/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:28:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4555892-7abb-4a3c-a4ae-a27ad4902708/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:28:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:28:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:28:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:28:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:28:56 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:28:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:28:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:28:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:28:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:28:57 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:57 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:28:57 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:28:57 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8033MB free_disk=26.1978759765625GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 15:28:57 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:28:57 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:28:57 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance de1a45fd-27be-4438-80a4-2f3a100643c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:28:57 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 6a805345-374c-4326-9e8f-39bfc7947a35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:28:57 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance b0d90fd2-6a95-43c4-8756-e82071d99154 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:28:57 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance e4555892-7abb-4a3c-a4ae-a27ad4902708 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:28:57 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance d534d17d-ba77-4447-8a63-7d6021ad7896 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:28:57 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:28:57 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:28:57 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 39e3dfb1-bc09-474d-b8cb-f01b11923eae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:28:57 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 15:28:57 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 15:28:57 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:28:57 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:28:57 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 15:28:57 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.527s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:28:59 user nova-compute[71229]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681226924.0425968, f846ecc9-ecc4-4e8f-aca3-39d83b56f414 => Stopped> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:28:59 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] VM Stopped (Lifecycle Event)
Apr 11 15:28:59 user nova-compute[71229]: DEBUG nova.compute.manager [None req-d56a6689-3fee-4b0d-9fcb-d4e8ce8fac96 None None] [instance: f846ecc9-ecc4-4e8f-aca3-39d83b56f414] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:28:59 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:28:59 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:28:59 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:28:59 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:28:59 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 15:28:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "refresh_cache-b0d90fd2-6a95-43c4-8756-e82071d99154" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:28:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquired lock "refresh_cache-b0d90fd2-6a95-43c4-8756-e82071d99154" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:28:59 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Forcefully refreshing network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 15:29:00 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Updating instance_info_cache with network_info: [{"id": "4718fa68-0eb9-4592-8c43-981438e3d0b8", "address": "fa:16:3e:e4:28:3b", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4718fa68-0e", "ovs_interfaceid": "4718fa68-0eb9-4592-8c43-981438e3d0b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:29:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Releasing lock "refresh_cache-b0d90fd2-6a95-43c4-8756-e82071d99154" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:29:00 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Updated the network info_cache for instance {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 15:29:00 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:29:00 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:29:00 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:29:00 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:29:00 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:29:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:29:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:29:09 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:29:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:29:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:29:19 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:29:24 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:29:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:29:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "7c4329ae-07cb-4f28-9fd6-29b398517d2b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:29:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "7c4329ae-07cb-4f28-9fd6-29b398517d2b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:29:27 user nova-compute[71229]: DEBUG nova.compute.manager [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Starting instance... {{(pid=71229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 15:29:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:29:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:29:27 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 15:29:27 user nova-compute[71229]: INFO nova.compute.claims [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Claim successful on node user
Apr 11 15:29:28 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:29:28 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:29:28 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.360s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:29:28 user nova-compute[71229]: DEBUG nova.compute.manager [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Start building networks asynchronously for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 15:29:28 user nova-compute[71229]: DEBUG nova.compute.manager [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Allocating IP information in the background. {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 15:29:28 user nova-compute[71229]: DEBUG nova.network.neutron [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] allocate_for_instance() {{(pid=71229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 15:29:28 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 15:29:28 user nova-compute[71229]: DEBUG nova.compute.manager [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Start building block device mappings for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 15:29:28 user nova-compute[71229]: DEBUG nova.policy [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71229) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 15:29:28 user nova-compute[71229]: DEBUG nova.compute.manager [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Start spawning the instance on the hypervisor. {{(pid=71229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 15:29:28 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Creating instance directory {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 15:29:28 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Creating image(s)
Apr 11 15:29:28 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "/opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:29:28 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "/opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:29:28 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "/opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:29:28 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:29 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.151s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:29 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:29:29 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:29:29 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:29 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:29:29 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.149s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:29 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b/disk 1073741824 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:29 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b/disk 1073741824" returned: 0 in 0.057s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:29 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:29:29 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:29 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.154s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:29 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b/disk. size=1073741824 {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 15:29:29 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:29 user nova-compute[71229]: DEBUG nova.network.neutron [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Successfully created port: 37d248cb-99ae-4dcd-adfe-46bce9920d3e {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 15:29:29 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:29 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Cannot resize image /opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b/disk to a smaller size. {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 15:29:29 user nova-compute[71229]: DEBUG nova.objects.instance [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lazy-loading 'migration_context' on Instance uuid 7c4329ae-07cb-4f28-9fd6-29b398517d2b {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:29:29 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Created local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 15:29:29 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Ensure instance console log exists: /opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 15:29:29 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:29:29 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:29:29 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:29:30 user nova-compute[71229]: DEBUG nova.network.neutron [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Successfully updated port: 37d248cb-99ae-4dcd-adfe-46bce9920d3e {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:29:30 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "refresh_cache-7c4329ae-07cb-4f28-9fd6-29b398517d2b" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:29:30 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquired lock "refresh_cache-7c4329ae-07cb-4f28-9fd6-29b398517d2b" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:29:30 user nova-compute[71229]: DEBUG nova.network.neutron [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:29:30 user nova-compute[71229]: DEBUG nova.compute.manager [req-73388cac-5943-4a85-9e9c-ebf628d492e6 req-3297c749-4c15-4c56-9dd8-6671beef143f service nova] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Received event network-changed-37d248cb-99ae-4dcd-adfe-46bce9920d3e {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:29:30 user nova-compute[71229]: DEBUG nova.compute.manager [req-73388cac-5943-4a85-9e9c-ebf628d492e6 req-3297c749-4c15-4c56-9dd8-6671beef143f service nova] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Refreshing instance network info cache due to event network-changed-37d248cb-99ae-4dcd-adfe-46bce9920d3e. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:29:30 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-73388cac-5943-4a85-9e9c-ebf628d492e6 req-3297c749-4c15-4c56-9dd8-6671beef143f service nova] Acquiring lock "refresh_cache-7c4329ae-07cb-4f28-9fd6-29b398517d2b" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:29:30 user nova-compute[71229]: DEBUG nova.network.neutron [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:29:30 user nova-compute[71229]: DEBUG nova.network.neutron [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Updating instance_info_cache with network_info: [{"id": "37d248cb-99ae-4dcd-adfe-46bce9920d3e", "address": "fa:16:3e:c2:89:8a", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d248cb-99", "ovs_interfaceid": "37d248cb-99ae-4dcd-adfe-46bce9920d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:29:30 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Releasing lock "refresh_cache-7c4329ae-07cb-4f28-9fd6-29b398517d2b" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:29:30 user nova-compute[71229]: DEBUG nova.compute.manager [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Instance network_info: |[{"id": "37d248cb-99ae-4dcd-adfe-46bce9920d3e", "address": "fa:16:3e:c2:89:8a", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d248cb-99", "ovs_interfaceid": "37d248cb-99ae-4dcd-adfe-46bce9920d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 15:29:30 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-73388cac-5943-4a85-9e9c-ebf628d492e6 req-3297c749-4c15-4c56-9dd8-6671beef143f service nova] Acquired lock "refresh_cache-7c4329ae-07cb-4f28-9fd6-29b398517d2b" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:29:30 user nova-compute[71229]: DEBUG nova.network.neutron [req-73388cac-5943-4a85-9e9c-ebf628d492e6 req-3297c749-4c15-4c56-9dd8-6671beef143f service nova] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Refreshing network info cache for port 37d248cb-99ae-4dcd-adfe-46bce9920d3e {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:29:30 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Start _get_guest_xml network_info=[{"id": "37d248cb-99ae-4dcd-adfe-46bce9920d3e", "address": "fa:16:3e:c2:89:8a", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d248cb-99", "ovs_interfaceid": "37d248cb-99ae-4dcd-adfe-46bce9920d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '52fe638c-5ada-47d5-b376-233bfa808a37'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:29:30 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:29:30 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:29:30 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:29:30 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:29:30 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:29:30 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:29:30 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:29:30 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:29:30 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:29:30 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:29:30 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:29:30 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:29:30 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:29:30 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:29:30 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-858493461',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-858493461',id=20,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ddc05e9bf5ab426982ccb3092ad596e4',ramdisk_id='',reservation_id='r-axycit9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1907753459',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:29:29Z,user_data=None,user_id='1d60ce27bfad4d7c9b976e834df35ad4',uuid=7c4329ae-07cb-4f28-9fd6-29b398517d2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37d248cb-99ae-4dcd-adfe-46bce9920d3e", "address": "fa:16:3e:c2:89:8a", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d248cb-99", "ovs_interfaceid": "37d248cb-99ae-4dcd-adfe-46bce9920d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:29:30 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Converting VIF {"id": "37d248cb-99ae-4dcd-adfe-46bce9920d3e", "address": "fa:16:3e:c2:89:8a", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d248cb-99", "ovs_interfaceid": "37d248cb-99ae-4dcd-adfe-46bce9920d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:29:30 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:89:8a,bridge_name='br-int',has_traffic_filtering=True,id=37d248cb-99ae-4dcd-adfe-46bce9920d3e,network=Network(1cf4cec3-ff08-4320-89e4-aa7e8cf75eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37d248cb-99') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:29:30 user nova-compute[71229]: DEBUG nova.objects.instance [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c4329ae-07cb-4f28-9fd6-29b398517d2b {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:29:30 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:29:30 user nova-compute[71229]:   <uuid>7c4329ae-07cb-4f28-9fd6-29b398517d2b</uuid>
Apr 11 15:29:30 user nova-compute[71229]:   <name>instance-00000014</name>
Apr 11 15:29:30 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:29:30 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:29:30 user nova-compute[71229]:   <metadata>
Apr 11 15:29:30 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:29:30 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:29:30 user nova-compute[71229]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-858493461</nova:name>
Apr 11 15:29:30 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:29:30</nova:creationTime>
Apr 11 15:29:30 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:29:30 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:29:30 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:29:30 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:29:30 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:29:30 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:29:30 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:29:30 user nova-compute[71229]:       <nova:owner>
Apr 11 15:29:30 user nova-compute[71229]:         <nova:user uuid="1d60ce27bfad4d7c9b976e834df35ad4">tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member</nova:user>
Apr 11 15:29:30 user nova-compute[71229]:         <nova:project uuid="ddc05e9bf5ab426982ccb3092ad596e4">tempest-ServerBootFromVolumeStableRescueTest-1907753459</nova:project>
Apr 11 15:29:30 user nova-compute[71229]:       </nova:owner>
Apr 11 15:29:30 user nova-compute[71229]:       <nova:root type="image" uuid="52fe638c-5ada-47d5-b376-233bfa808a37"/>
Apr 11 15:29:30 user nova-compute[71229]:       <nova:ports>
Apr 11 15:29:30 user nova-compute[71229]:         <nova:port uuid="37d248cb-99ae-4dcd-adfe-46bce9920d3e">
Apr 11 15:29:30 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 11 15:29:30 user nova-compute[71229]:         </nova:port>
Apr 11 15:29:30 user nova-compute[71229]:       </nova:ports>
Apr 11 15:29:30 user nova-compute[71229]:     </nova:instance>
Apr 11 15:29:30 user nova-compute[71229]:   </metadata>
Apr 11 15:29:30 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:29:30 user nova-compute[71229]:     <system>
Apr 11 15:29:30 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:29:30 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:29:30 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:29:30 user nova-compute[71229]:       <entry name="serial">7c4329ae-07cb-4f28-9fd6-29b398517d2b</entry>
Apr 11 15:29:30 user nova-compute[71229]:       <entry name="uuid">7c4329ae-07cb-4f28-9fd6-29b398517d2b</entry>
Apr 11 15:29:30 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:29:30 user nova-compute[71229]:     </system>
Apr 11 15:29:30 user nova-compute[71229]:   </sysinfo>
Apr 11 15:29:30 user nova-compute[71229]:   <os>
Apr 11 15:29:30 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:29:30 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 15:29:30 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:29:30 user nova-compute[71229]:   </os>
Apr 11 15:29:30 user nova-compute[71229]:   <features>
Apr 11 15:29:30 user nova-compute[71229]:     <acpi/>
Apr 11 15:29:30 user nova-compute[71229]:     <apic/>
Apr 11 15:29:30 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:29:30 user nova-compute[71229]:   </features>
Apr 11 15:29:30 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:29:30 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:29:30 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:29:30 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:29:30 user nova-compute[71229]:   </clock>
Apr 11 15:29:30 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:29:30 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:29:30 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:29:30 user nova-compute[71229]:   </cpu>
Apr 11 15:29:30 user nova-compute[71229]:   <devices>
Apr 11 15:29:30 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 15:29:30 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 15:29:30 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b/disk"/>
Apr 11 15:29:30 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:29:30 user nova-compute[71229]:     </disk>
Apr 11 15:29:30 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:29:30 user nova-compute[71229]:       <mac address="fa:16:3e:c2:89:8a"/>
Apr 11 15:29:30 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:29:30 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:29:30 user nova-compute[71229]:       <target dev="tap37d248cb-99"/>
Apr 11 15:29:30 user nova-compute[71229]:     </interface>
Apr 11 15:29:30 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:29:30 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b/console.log" append="off"/>
Apr 11 15:29:30 user nova-compute[71229]:     </serial>
Apr 11 15:29:30 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:29:30 user nova-compute[71229]:     <video>
Apr 11 15:29:30 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:29:30 user nova-compute[71229]:     </video>
Apr 11 15:29:30 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:29:30 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:29:30 user nova-compute[71229]:     </rng>
Apr 11 15:29:30 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:29:30 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:29:30 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:29:30 user nova-compute[71229]:     </memballoon>
Apr 11 15:29:30 user nova-compute[71229]:   </devices>
Apr 11 15:29:30 user nova-compute[71229]: </domain>
Apr 11 15:29:30 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:29:30 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-858493461',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-858493461',id=20,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ddc05e9bf5ab426982ccb3092ad596e4',ramdisk_id='',reservation_id='r-axycit9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1907753459',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:29:29Z,user_data=None,user_id='1d60ce27bfad4d7c9b976e834df35ad4',uuid=7c4329ae-07cb-4f28-9fd6-29b398517d2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37d248cb-99ae-4dcd-adfe-46bce9920d3e", "address": "fa:16:3e:c2:89:8a", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d248cb-99", "ovs_interfaceid": "37d248cb-99ae-4dcd-adfe-46bce9920d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:29:30 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Converting VIF {"id": "37d248cb-99ae-4dcd-adfe-46bce9920d3e", "address": "fa:16:3e:c2:89:8a", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d248cb-99", "ovs_interfaceid": "37d248cb-99ae-4dcd-adfe-46bce9920d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:29:30 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:89:8a,bridge_name='br-int',has_traffic_filtering=True,id=37d248cb-99ae-4dcd-adfe-46bce9920d3e,network=Network(1cf4cec3-ff08-4320-89e4-aa7e8cf75eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37d248cb-99') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:29:30 user nova-compute[71229]: DEBUG os_vif [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:89:8a,bridge_name='br-int',has_traffic_filtering=True,id=37d248cb-99ae-4dcd-adfe-46bce9920d3e,network=Network(1cf4cec3-ff08-4320-89e4-aa7e8cf75eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37d248cb-99') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:29:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:29:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:29:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:29:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:29:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37d248cb-99, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:29:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap37d248cb-99, col_values=(('external_ids', {'iface-id': '37d248cb-99ae-4dcd-adfe-46bce9920d3e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:89:8a', 'vm-uuid': '7c4329ae-07cb-4f28-9fd6-29b398517d2b'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:29:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:29:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:29:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:29:30 user nova-compute[71229]: INFO os_vif [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:89:8a,bridge_name='br-int',has_traffic_filtering=True,id=37d248cb-99ae-4dcd-adfe-46bce9920d3e,network=Network(1cf4cec3-ff08-4320-89e4-aa7e8cf75eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37d248cb-99')
Apr 11 15:29:30 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:29:30 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] No VIF found with MAC fa:16:3e:c2:89:8a, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:29:31 user nova-compute[71229]: DEBUG nova.network.neutron [req-73388cac-5943-4a85-9e9c-ebf628d492e6 req-3297c749-4c15-4c56-9dd8-6671beef143f service nova] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Updated VIF entry in instance network info cache for port 37d248cb-99ae-4dcd-adfe-46bce9920d3e. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:29:31 user nova-compute[71229]: DEBUG nova.network.neutron [req-73388cac-5943-4a85-9e9c-ebf628d492e6 req-3297c749-4c15-4c56-9dd8-6671beef143f service nova] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Updating instance_info_cache with network_info: [{"id": "37d248cb-99ae-4dcd-adfe-46bce9920d3e", "address": "fa:16:3e:c2:89:8a", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d248cb-99", "ovs_interfaceid": "37d248cb-99ae-4dcd-adfe-46bce9920d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:29:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-73388cac-5943-4a85-9e9c-ebf628d492e6 req-3297c749-4c15-4c56-9dd8-6671beef143f service nova] Releasing lock "refresh_cache-7c4329ae-07cb-4f28-9fd6-29b398517d2b" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:29:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:29:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:29:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:29:32 user nova-compute[71229]: DEBUG nova.compute.manager [req-3832d850-833c-4c74-ac7c-6b5516f69ebb req-efa3c20d-b1d9-4f19-8242-79be86f83f15 service nova] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Received event network-vif-plugged-37d248cb-99ae-4dcd-adfe-46bce9920d3e {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:29:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3832d850-833c-4c74-ac7c-6b5516f69ebb req-efa3c20d-b1d9-4f19-8242-79be86f83f15 service nova] Acquiring lock "7c4329ae-07cb-4f28-9fd6-29b398517d2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:29:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3832d850-833c-4c74-ac7c-6b5516f69ebb req-efa3c20d-b1d9-4f19-8242-79be86f83f15 service nova] Lock "7c4329ae-07cb-4f28-9fd6-29b398517d2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:29:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3832d850-833c-4c74-ac7c-6b5516f69ebb req-efa3c20d-b1d9-4f19-8242-79be86f83f15 service nova] Lock "7c4329ae-07cb-4f28-9fd6-29b398517d2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:29:32 user nova-compute[71229]: DEBUG nova.compute.manager [req-3832d850-833c-4c74-ac7c-6b5516f69ebb req-efa3c20d-b1d9-4f19-8242-79be86f83f15 service nova] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] No waiting events found dispatching network-vif-plugged-37d248cb-99ae-4dcd-adfe-46bce9920d3e {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:29:32 user nova-compute[71229]: WARNING nova.compute.manager [req-3832d850-833c-4c74-ac7c-6b5516f69ebb req-efa3c20d-b1d9-4f19-8242-79be86f83f15 service nova] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Received unexpected event network-vif-plugged-37d248cb-99ae-4dcd-adfe-46bce9920d3e for instance with vm_state building and task_state spawning.
Apr 11 15:29:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:29:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:29:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:29:34 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681226974.188112, 7c4329ae-07cb-4f28-9fd6-29b398517d2b => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:29:34 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] VM Resumed (Lifecycle Event)
Apr 11 15:29:34 user nova-compute[71229]: DEBUG nova.compute.manager [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 15:29:34 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Guest created on hypervisor {{(pid=71229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 15:29:34 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Instance spawned successfully.
Apr 11 15:29:34 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 15:29:34 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:29:34 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:29:34 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Found default for hw_cdrom_bus of ide {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:29:34 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Found default for hw_disk_bus of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:29:34 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Found default for hw_input_bus of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:29:34 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Found default for hw_pointer_model of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:29:34 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Found default for hw_video_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:29:34 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Found default for hw_vif_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:29:34 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:29:34 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681226974.1899288, 7c4329ae-07cb-4f28-9fd6-29b398517d2b => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:29:34 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] VM Started (Lifecycle Event)
Apr 11 15:29:34 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:29:34 user nova-compute[71229]: DEBUG nova.compute.manager [req-e63fe311-8173-4103-8bcb-2f12a1a38a97 req-b1bf5cd9-8ae7-420f-8999-6cb4043f2020 service nova] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Received event network-vif-plugged-37d248cb-99ae-4dcd-adfe-46bce9920d3e {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:29:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e63fe311-8173-4103-8bcb-2f12a1a38a97 req-b1bf5cd9-8ae7-420f-8999-6cb4043f2020 service nova] Acquiring lock "7c4329ae-07cb-4f28-9fd6-29b398517d2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:29:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e63fe311-8173-4103-8bcb-2f12a1a38a97 req-b1bf5cd9-8ae7-420f-8999-6cb4043f2020 service nova] Lock "7c4329ae-07cb-4f28-9fd6-29b398517d2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:29:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e63fe311-8173-4103-8bcb-2f12a1a38a97 req-b1bf5cd9-8ae7-420f-8999-6cb4043f2020 service nova] Lock "7c4329ae-07cb-4f28-9fd6-29b398517d2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:29:34 user nova-compute[71229]: DEBUG nova.compute.manager [req-e63fe311-8173-4103-8bcb-2f12a1a38a97 req-b1bf5cd9-8ae7-420f-8999-6cb4043f2020 service nova] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] No waiting events found dispatching network-vif-plugged-37d248cb-99ae-4dcd-adfe-46bce9920d3e {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:29:34 user nova-compute[71229]: WARNING nova.compute.manager [req-e63fe311-8173-4103-8bcb-2f12a1a38a97 req-b1bf5cd9-8ae7-420f-8999-6cb4043f2020 service nova] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Received unexpected event network-vif-plugged-37d248cb-99ae-4dcd-adfe-46bce9920d3e for instance with vm_state building and task_state spawning.
Apr 11 15:29:34 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:29:34 user nova-compute[71229]: INFO nova.compute.manager [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Took 5.47 seconds to spawn the instance on the hypervisor.
Apr 11 15:29:34 user nova-compute[71229]: DEBUG nova.compute.manager [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:29:34 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:29:34 user nova-compute[71229]: INFO nova.compute.manager [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Took 6.55 seconds to build instance.
Apr 11 15:29:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-dd8d6358-cd62-4791-9f4a-f84895d46144 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "7c4329ae-07cb-4f28-9fd6-29b398517d2b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.649s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:29:35 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:29:36 user nova-compute[71229]: DEBUG nova.compute.manager [req-f237f52c-a0ca-414a-a59e-55fe4ec3df3e req-d563cf5d-71fb-4fc9-8fa8-8c4339e414f6 service nova] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Received event network-changed-05f23fee-4450-48d6-8b2f-6c1fcf308da6 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:29:36 user nova-compute[71229]: DEBUG nova.compute.manager [req-f237f52c-a0ca-414a-a59e-55fe4ec3df3e req-d563cf5d-71fb-4fc9-8fa8-8c4339e414f6 service nova] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Refreshing instance network info cache due to event network-changed-05f23fee-4450-48d6-8b2f-6c1fcf308da6. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:29:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-f237f52c-a0ca-414a-a59e-55fe4ec3df3e req-d563cf5d-71fb-4fc9-8fa8-8c4339e414f6 service nova] Acquiring lock "refresh_cache-d534d17d-ba77-4447-8a63-7d6021ad7896" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:29:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-f237f52c-a0ca-414a-a59e-55fe4ec3df3e req-d563cf5d-71fb-4fc9-8fa8-8c4339e414f6 service nova] Acquired lock "refresh_cache-d534d17d-ba77-4447-8a63-7d6021ad7896" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:29:36 user nova-compute[71229]: DEBUG nova.network.neutron [req-f237f52c-a0ca-414a-a59e-55fe4ec3df3e req-d563cf5d-71fb-4fc9-8fa8-8c4339e414f6 service nova] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Refreshing network info cache for port 05f23fee-4450-48d6-8b2f-6c1fcf308da6 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:29:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:29:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "d534d17d-ba77-4447-8a63-7d6021ad7896" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:29:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "d534d17d-ba77-4447-8a63-7d6021ad7896" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:29:36 user nova-compute[71229]: DEBUG nova.objects.instance [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lazy-loading 'flavor' on Instance uuid d534d17d-ba77-4447-8a63-7d6021ad7896 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:29:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "d534d17d-ba77-4447-8a63-7d6021ad7896" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:29:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "d534d17d-ba77-4447-8a63-7d6021ad7896" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:29:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "d534d17d-ba77-4447-8a63-7d6021ad7896" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:29:36 user nova-compute[71229]: INFO nova.compute.manager [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Attaching volume 929df1ae-4b01-4bfb-aa54-9da994b764c5 to /dev/vdb
Apr 11 15:29:37 user nova-compute[71229]: DEBUG nova.network.neutron [req-f237f52c-a0ca-414a-a59e-55fe4ec3df3e req-d563cf5d-71fb-4fc9-8fa8-8c4339e414f6 service nova] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Updated VIF entry in instance network info cache for port 05f23fee-4450-48d6-8b2f-6c1fcf308da6. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:29:37 user nova-compute[71229]: DEBUG nova.network.neutron [req-f237f52c-a0ca-414a-a59e-55fe4ec3df3e req-d563cf5d-71fb-4fc9-8fa8-8c4339e414f6 service nova] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Updating instance_info_cache with network_info: [{"id": "05f23fee-4450-48d6-8b2f-6c1fcf308da6", "address": "fa:16:3e:61:6a:d2", "network": {"id": "fc99abc0-f7ce-488e-b3d5-926973bb5e6b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2010457639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90bfd48094c54cd5b13dabf27ebdd5dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05f23fee-44", "ovs_interfaceid": "05f23fee-4450-48d6-8b2f-6c1fcf308da6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:29:37 user nova-compute[71229]: DEBUG os_brick.utils [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:29:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-f237f52c-a0ca-414a-a59e-55fe4ec3df3e req-d563cf5d-71fb-4fc9-8fa8-8c4339e414f6 service nova] Releasing lock "refresh_cache-d534d17d-ba77-4447-8a63-7d6021ad7896" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:29:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:37 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8eeac9b-d70a-47da-beda-a253a5c47638]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d55e24a97c90\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:37 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[387aceac-b856-47f3-9c3e-6e24fc8a44e4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:37 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c65d107-96c1-4063-92ee-255bf21887c6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:37 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0b4727-0dd7-408b-8522-d8d28a7ddb88]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Running cmd (subprocess): nvme version {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] 'nvme version' failed. Not Retrying. {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:29:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] nvme not present on system {{(pid=71229) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 15:29:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:29:37 user nova-compute[71229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 15:29:37 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[540bb0fa-4276-4cab-9e82-6d9db3c4d436]: (4, '') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71229) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 15:29:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 15:29:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] LIGHTOS: no hostnqn found. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 15:29:37 user nova-compute[71229]: DEBUG os_brick.utils [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d55e24a97c90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:29:37 user nova-compute[71229]: DEBUG nova.virt.block_device [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Updating existing volume attachment record: f5bc37ad-0b9d-4d4f-bcff-c68ec2de2a7a {{(pid=71229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 15:29:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:29:39 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-96a3104a-44b7-4432-9a2e-7262c774d55b tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:29:39 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-96a3104a-44b7-4432-9a2e-7262c774d55b tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:29:39 user nova-compute[71229]: INFO nova.compute.manager [None req-96a3104a-44b7-4432-9a2e-7262c774d55b tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Detaching volume 092c1963-af41-4f6f-9205-8970fc6e3122
Apr 11 15:29:39 user nova-compute[71229]: INFO nova.virt.block_device [None req-96a3104a-44b7-4432-9a2e-7262c774d55b tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Attempting to driver detach volume 092c1963-af41-4f6f-9205-8970fc6e3122 from mountpoint /dev/vdc
Apr 11 15:29:39 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-96a3104a-44b7-4432-9a2e-7262c774d55b tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Attempting to detach device vdc from instance 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d from the persistent domain config. {{(pid=71229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 15:29:39 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-96a3104a-44b7-4432-9a2e-7262c774d55b tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 15:29:39 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:29:39 user nova-compute[71229]:   <source dev="/dev/sdc"/>
Apr 11 15:29:39 user nova-compute[71229]:   <target dev="vdc" bus="virtio"/>
Apr 11 15:29:39 user nova-compute[71229]:   <serial>092c1963-af41-4f6f-9205-8970fc6e3122</serial>
Apr 11 15:29:39 user nova-compute[71229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 15:29:39 user nova-compute[71229]: </disk>
Apr 11 15:29:39 user nova-compute[71229]:  {{(pid=71229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 15:29:39 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-96a3104a-44b7-4432-9a2e-7262c774d55b tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Successfully detached device vdc from instance 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d from the persistent domain config.
Apr 11 15:29:39 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-96a3104a-44b7-4432-9a2e-7262c774d55b tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d from the live domain config. {{(pid=71229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 15:29:39 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-96a3104a-44b7-4432-9a2e-7262c774d55b tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 15:29:39 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:29:39 user nova-compute[71229]:   <source dev="/dev/sdc"/>
Apr 11 15:29:39 user nova-compute[71229]:   <target dev="vdc" bus="virtio"/>
Apr 11 15:29:39 user nova-compute[71229]:   <serial>092c1963-af41-4f6f-9205-8970fc6e3122</serial>
Apr 11 15:29:39 user nova-compute[71229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 15:29:39 user nova-compute[71229]: </disk>
Apr 11 15:29:39 user nova-compute[71229]:  {{(pid=71229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Received event <DeviceRemovedEvent: 1681226980.35294, 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71229) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-96a3104a-44b7-4432-9a2e-7262c774d55b tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d {{(pid=71229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 15:29:40 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-96a3104a-44b7-4432-9a2e-7262c774d55b tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Successfully detached device vdc from instance 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d from the live domain config.
Apr 11 15:29:40 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96a3104a-44b7-4432-9a2e-7262c774d55b tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a3104a-44b7-4432-9a2e-7262c774d55b tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vXtplGab', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:29:40 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-96a3104a-44b7-4432-9a2e-7262c774d55b tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:29:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-96a3104a-44b7-4432-9a2e-7262c774d55b tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-96a3104a-44b7-4432-9a2e-7262c774d55b tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8753887-bc61-461a-9b09-3745560d3d9e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a3104a-44b7-4432-9a2e-7262c774d55b tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 15:29:40 user nova-compute[71229]: No targets found.
Apr 11 15:29:40 user nova-compute[71229]: iSNS:
Apr 11 15:29:40 user nova-compute[71229]: No targets found.
Apr 11 15:29:40 user nova-compute[71229]: STATIC:
Apr 11 15:29:40 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb
Apr 11 15:29:40 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:29:40 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:29:40 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122
Apr 11 15:29:40 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:29:40 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:29:40 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7
Apr 11 15:29:40 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:29:40 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:29:40 user nova-compute[71229]: FIRMWARE:
Apr 11 15:29:40 user nova-compute[71229]: No targets found.
Apr 11 15:29:40 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a3104a-44b7-4432-9a2e-7262c774d55b tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 15:29:40 user nova-compute[71229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 15:29:40 user nova-compute[71229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71229) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a3104a-44b7-4432-9a2e-7262c774d55b tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122', 0)] {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[08fb5118-634d-42c7-aa92-f89cab00738d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5c1750-9ca5-44fc-bcca-4cae0dd5eb09]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a3104a-44b7-4432-9a2e-7262c774d55b tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:29:40 user nova-compute[71229]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122 (non-flash)
Apr 11 15:29:40 user nova-compute[71229]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)
Apr 11 15:29:40 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a3104a-44b7-4432-9a2e-7262c774d55b tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:29:40 user nova-compute[71229]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122 (non-flash)
Apr 11 15:29:40 user nova-compute[71229]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)
Apr 11 15:29:40 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a3104a-44b7-4432-9a2e-7262c774d55b tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb5c2fd480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122'): ({'sdc'}, set())}) {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-96a3104a-44b7-4432-9a2e-7262c774d55b tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Removing single pathed devices sdc {{(pid=71229) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d858a046-52c2-47d8-a389-4185b0865392]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0fd6711-5243-4b8a-8a8c-9b005b3bf304]: (4, ('ok\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-96a3104a-44b7-4432-9a2e-7262c774d55b tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Flushing IO for device /dev/sdc {{(pid=71229) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3531d8-7e30-499f-94a9-ddf12be2783c]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-96a3104a-44b7-4432-9a2e-7262c774d55b tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71229) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[64aadd30-1220-4ded-875c-70168e051ef8]: (4, ('1', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-96a3104a-44b7-4432-9a2e-7262c774d55b tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-96a3104a-44b7-4432-9a2e-7262c774d55b tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] SCSI volumes sdc have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a3104a-44b7-4432-9a2e-7262c774d55b tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122')] {{(pid=71229) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3334a16-11cf-4e9d-a6c9-abe2befda156]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a3104a-44b7-4432-9a2e-7262c774d55b tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122 -p 172.16.0.220:3260 --logout {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bab4cdb-1780-402a-b476-be1f0390cab4]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a3104a-44b7-4432-9a2e-7262c774d55b tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122, portal: 172.16.0.220,3260]
Apr 11 15:29:40 user nova-compute[71229]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122, portal: 172.16.0.220,3260] successful.
Apr 11 15:29:40 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122 -p 172.16.0.220:3260 --op delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:092c1963-af41-4f6f-9205-8970fc6e3122 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f4d02e-c308-444c-a46e-89ef3297c283]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a3104a-44b7-4432-9a2e-7262c774d55b tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-96a3104a-44b7-4432-9a2e-7262c774d55b tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a3104a-44b7-4432-9a2e-7262c774d55b tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] <== disconnect_volume: return (327ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96a3104a-44b7-4432-9a2e-7262c774d55b tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 15:29:40 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CGSJUwZo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:29:41 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:29:41 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:29:41 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:29:41 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:29:41 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 15:29:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5 -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5268be0-14e7-4fd1-9a9b-b3ffa7c7d1a4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 15:29:41 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5 -p 172.16.0.220:3260 --interface default --op new {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.042s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff2ac7e-68f8-41db-a302-54c5c250f126]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5] added\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5] added
Apr 11 15:29:41 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b1d05d-3e15-4156-b645-02ecf3a42acf]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[678c2964-9495-4023-a38c-4197bc658afd]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CGSJUwZo {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG nova.objects.instance [None req-96a3104a-44b7-4432-9a2e-7262c774d55b tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lazy-loading 'flavor' on Instance uuid 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CGSJUwZo" returned: 0 in 0.024s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3527e9-0ca5-421f-9b99-34fd45f51402]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CGSJUwZo'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-96a3104a-44b7-4432-9a2e-7262c774d55b tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.972s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a570fec2-9d24-4911-9e09-5901e9bb01ad]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ada9a87-c73e-45e1-8157-9cfe2b96f370]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:29:41 user nova-compute[71229]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)
Apr 11 15:29:41 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:29:41 user nova-compute[71229]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)
Apr 11 15:29:41 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5 -p 172.16.0.220:3260 --login {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc13afb1-a6a4-4dfc-a9b9-cf9c808d82a9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5, portal: 172.16.0.220,3260]
Apr 11 15:29:41 user nova-compute[71229]: Login to [iface: default, target: iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5, portal: 172.16.0.220,3260] successful.
Apr 11 15:29:41 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d29134f-7f1f-41ce-9a85-97febcd5fd90]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5038c144-1807-41e9-b4ab-80ce5f7adcec]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:29:41 user nova-compute[71229]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)
Apr 11 15:29:41 user nova-compute[71229]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5 (non-flash)
Apr 11 15:29:41 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:29:41 user nova-compute[71229]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)
Apr 11 15:29:41 user nova-compute[71229]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5 (non-flash)
Apr 11 15:29:41 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b902c67-bcf9-4601-b199-5ff8f1884820]: (4, ('- - 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:29:41 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CGSJUwZo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 15:29:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "6a805345-374c-4326-9e8f-39bfc7947a35" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:29:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "6a805345-374c-4326-9e8f-39bfc7947a35" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:29:42 user nova-compute[71229]: DEBUG nova.objects.instance [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lazy-loading 'flavor' on Instance uuid 6a805345-374c-4326-9e8f-39bfc7947a35 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:29:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "6a805345-374c-4326-9e8f-39bfc7947a35" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:29:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "6a805345-374c-4326-9e8f-39bfc7947a35" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:29:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "6a805345-374c-4326-9e8f-39bfc7947a35" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:29:42 user nova-compute[71229]: INFO nova.compute.manager [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Attaching volume e168e446-1ecb-4f58-bc6c-0f488fa989a2 to /dev/vdb
Apr 11 15:29:42 user nova-compute[71229]: DEBUG os_brick.utils [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:29:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:42 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9476aac3-7379-4256-92c7-b6c36e16694b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d55e24a97c90\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:42 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2d43e4-63b5-4b68-a5bc-de3e1fd8468b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:42 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f10d71-8b43-4d71-907c-2ff81a9e5f71]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:42 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29ccbfb-7238-4672-8c15-bcd5f1b26a76]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Running cmd (subprocess): nvme version {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 'nvme version' failed. Not Retrying. {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:29:42 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] nvme not present on system {{(pid=71229) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 15:29:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:29:42 user nova-compute[71229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 15:29:42 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ec043d-1c6e-4456-b0f8-2ffa0fce78b3]: (4, '') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:42 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71229) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 15:29:42 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 15:29:42 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] LIGHTOS: no hostnqn found. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 15:29:42 user nova-compute[71229]: DEBUG os_brick.utils [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d55e24a97c90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:29:42 user nova-compute[71229]: DEBUG nova.virt.block_device [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Updating existing volume attachment record: e4404544-a075-4bba-aeab-c97d9bb271de {{(pid=71229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 15:29:42 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:29:42 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '23037313034633762', 'path': '/dev/sdc'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:29:42 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037313034633762', 'path': '/dev/sdc'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 15:29:42 user nova-compute[71229]: DEBUG nova.objects.instance [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lazy-loading 'flavor' on Instance uuid d534d17d-ba77-4447-8a63-7d6021ad7896 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:29:42 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 15:29:42 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:29:42 user nova-compute[71229]:   <source dev="/dev/sdc"/>
Apr 11 15:29:42 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 15:29:42 user nova-compute[71229]:   <serial>929df1ae-4b01-4bfb-aa54-9da994b764c5</serial>
Apr 11 15:29:42 user nova-compute[71229]: </disk>
Apr 11 15:29:42 user nova-compute[71229]:  {{(pid=71229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 15:29:43 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:29:43 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:29:43 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] No VIF found with MAC fa:16:3e:61:6a:d2, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:29:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-65bc3f8d-fbf8-4431-bc2a-97bac7833d80 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "d534d17d-ba77-4447-8a63-7d6021ad7896" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.417s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:29:45 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:29:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XapmTvFn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:29:47 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:29:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:29:47 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:29:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:29:47 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 15:29:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1ac4d7-7196-4d80-91d9-2c84bd7d7ba0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 15:29:47 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --interface default --op new {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f45177b-7f27-4f91-87fb-5b3dfeb9ac98]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2] added\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2] added
Apr 11 15:29:47 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[32df46e0-fc54-412e-8a32-99c711f4edad]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d5364c-2027-4bd9-a582-b9ff317f82eb]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XapmTvFn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XapmTvFn" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c55d295-4a88-4107-99b4-e8fbbaa992b2]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XapmTvFn'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb722ca5-93e5-4997-a3e6-8282a71bef6a]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3044784c-8fcf-4ef8-8802-db0b7a732593]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:29:47 user nova-compute[71229]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)
Apr 11 15:29:47 user nova-compute[71229]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5 (non-flash)
Apr 11 15:29:47 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:29:47 user nova-compute[71229]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)
Apr 11 15:29:47 user nova-compute[71229]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5 (non-flash)
Apr 11 15:29:47 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --login {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6979c034-6d30-4612-9af2-99a0226c0068]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2, portal: 172.16.0.220,3260]
Apr 11 15:29:47 user nova-compute[71229]: Login to [iface: default, target: iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2, portal: 172.16.0.220,3260] successful.
Apr 11 15:29:47 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b7d5c0-04d5-493b-beb9-547246aca7d1]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c89d796-ba08-40e9-834d-9e61047d47f8]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:29:47 user nova-compute[71229]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)
Apr 11 15:29:47 user nova-compute[71229]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5 (non-flash)
Apr 11 15:29:47 user nova-compute[71229]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:29:47 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:29:47 user nova-compute[71229]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)
Apr 11 15:29:47 user nova-compute[71229]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5 (non-flash)
Apr 11 15:29:47 user nova-compute[71229]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:29:47 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] HCTL ('36', '-', '-', 0) found on session 20 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1613ff-372c-4234-b88a-d0e6c584f6c0]: (4, ('- - 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:47 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Searching for a device in session 20 and hctl ['36', '*', '*', 0] yield: None {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:29:48 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Searching for a device in session 20 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:29:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XapmTvFn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 15:29:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:29:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23532643732633938', 'path': '/dev/sde'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:29:48 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532643732633938', 'path': '/dev/sde'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 15:29:48 user nova-compute[71229]: DEBUG nova.objects.instance [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lazy-loading 'flavor' on Instance uuid 6a805345-374c-4326-9e8f-39bfc7947a35 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:29:48 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 15:29:48 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:29:48 user nova-compute[71229]:   <source dev="/dev/sde"/>
Apr 11 15:29:48 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 15:29:48 user nova-compute[71229]:   <serial>e168e446-1ecb-4f58-bc6c-0f488fa989a2</serial>
Apr 11 15:29:48 user nova-compute[71229]: </disk>
Apr 11 15:29:48 user nova-compute[71229]:  {{(pid=71229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 15:29:49 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:29:49 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:29:49 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] No VIF found with MAC fa:16:3e:0f:f8:cb, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:29:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-21839f60-f913-4eaa-85b4-6e00687f16dd tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "6a805345-374c-4326-9e8f-39bfc7947a35" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.767s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:29:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f156c211-5e35-4c24-a746-e995ad8df62e tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "d534d17d-ba77-4447-8a63-7d6021ad7896" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:29:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f156c211-5e35-4c24-a746-e995ad8df62e tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "d534d17d-ba77-4447-8a63-7d6021ad7896" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:29:49 user nova-compute[71229]: INFO nova.compute.manager [None req-f156c211-5e35-4c24-a746-e995ad8df62e tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Detaching volume 929df1ae-4b01-4bfb-aa54-9da994b764c5
Apr 11 15:29:49 user nova-compute[71229]: INFO nova.virt.block_device [None req-f156c211-5e35-4c24-a746-e995ad8df62e tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Attempting to driver detach volume 929df1ae-4b01-4bfb-aa54-9da994b764c5 from mountpoint /dev/vdb
Apr 11 15:29:49 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f156c211-5e35-4c24-a746-e995ad8df62e tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Attempting to detach device vdb from instance d534d17d-ba77-4447-8a63-7d6021ad7896 from the persistent domain config. {{(pid=71229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 15:29:49 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-f156c211-5e35-4c24-a746-e995ad8df62e tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 15:29:49 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:29:49 user nova-compute[71229]:   <source dev="/dev/sdc"/>
Apr 11 15:29:49 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 15:29:49 user nova-compute[71229]:   <serial>929df1ae-4b01-4bfb-aa54-9da994b764c5</serial>
Apr 11 15:29:49 user nova-compute[71229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 15:29:49 user nova-compute[71229]: </disk>
Apr 11 15:29:49 user nova-compute[71229]:  {{(pid=71229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 15:29:49 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-f156c211-5e35-4c24-a746-e995ad8df62e tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Successfully detached device vdb from instance d534d17d-ba77-4447-8a63-7d6021ad7896 from the persistent domain config.
Apr 11 15:29:49 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f156c211-5e35-4c24-a746-e995ad8df62e tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d534d17d-ba77-4447-8a63-7d6021ad7896 from the live domain config. {{(pid=71229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 15:29:49 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-f156c211-5e35-4c24-a746-e995ad8df62e tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 15:29:49 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:29:49 user nova-compute[71229]:   <source dev="/dev/sdc"/>
Apr 11 15:29:49 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 15:29:49 user nova-compute[71229]:   <serial>929df1ae-4b01-4bfb-aa54-9da994b764c5</serial>
Apr 11 15:29:49 user nova-compute[71229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 15:29:49 user nova-compute[71229]: </disk>
Apr 11 15:29:49 user nova-compute[71229]:  {{(pid=71229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Received event <DeviceRemovedEvent: 1681226990.1074703, d534d17d-ba77-4447-8a63-7d6021ad7896 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71229) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f156c211-5e35-4c24-a746-e995ad8df62e tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d534d17d-ba77-4447-8a63-7d6021ad7896 {{(pid=71229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 15:29:50 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-f156c211-5e35-4c24-a746-e995ad8df62e tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Successfully detached device vdb from instance d534d17d-ba77-4447-8a63-7d6021ad7896 from the live domain config.
Apr 11 15:29:50 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f156c211-5e35-4c24-a746-e995ad8df62e tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f156c211-5e35-4c24-a746-e995ad8df62e tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CGSJUwZo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:29:50 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-f156c211-5e35-4c24-a746-e995ad8df62e tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:29:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-f156c211-5e35-4c24-a746-e995ad8df62e tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-f156c211-5e35-4c24-a746-e995ad8df62e tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aedd4c2-5145-47ec-811c-b8c06a61d7f8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f156c211-5e35-4c24-a746-e995ad8df62e tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 15:29:50 user nova-compute[71229]: No targets found.
Apr 11 15:29:50 user nova-compute[71229]: iSNS:
Apr 11 15:29:50 user nova-compute[71229]: No targets found.
Apr 11 15:29:50 user nova-compute[71229]: STATIC:
Apr 11 15:29:50 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb
Apr 11 15:29:50 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:29:50 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:29:50 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2
Apr 11 15:29:50 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:29:50 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:29:50 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5
Apr 11 15:29:50 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:29:50 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:29:50 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7
Apr 11 15:29:50 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:29:50 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:29:50 user nova-compute[71229]: FIRMWARE:
Apr 11 15:29:50 user nova-compute[71229]: No targets found.
Apr 11 15:29:50 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f156c211-5e35-4c24-a746-e995ad8df62e tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 15:29:50 user nova-compute[71229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 15:29:50 user nova-compute[71229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71229) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f156c211-5e35-4c24-a746-e995ad8df62e tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5', 0)] {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0224005d-8485-43b9-b43f-bf1c1862689b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d65e851-fdc3-4810-8049-e5a4b9f339b4]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f156c211-5e35-4c24-a746-e995ad8df62e tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:29:50 user nova-compute[71229]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)
Apr 11 15:29:50 user nova-compute[71229]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5 (non-flash)
Apr 11 15:29:50 user nova-compute[71229]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:29:50 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f156c211-5e35-4c24-a746-e995ad8df62e tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:29:50 user nova-compute[71229]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)
Apr 11 15:29:50 user nova-compute[71229]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5 (non-flash)
Apr 11 15:29:50 user nova-compute[71229]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:29:50 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f156c211-5e35-4c24-a746-e995ad8df62e tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb5c1928c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5'): ({'sdc'}, set())}) {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-f156c211-5e35-4c24-a746-e995ad8df62e tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Removing single pathed devices sdc {{(pid=71229) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[128a3a9a-9364-40a9-9dd4-3499ca570e37]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc05348-948a-4a1e-9473-527218a128ff]: (4, ('ok\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-f156c211-5e35-4c24-a746-e995ad8df62e tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Flushing IO for device /dev/sdc {{(pid=71229) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[45870316-88b8-4146-9b3a-204541b735cb]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-f156c211-5e35-4c24-a746-e995ad8df62e tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71229) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1474a7f-6e00-4e6a-aa22-55249d85793a]: (4, ('1', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-f156c211-5e35-4c24-a746-e995ad8df62e tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-f156c211-5e35-4c24-a746-e995ad8df62e tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] SCSI volumes sdc have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f156c211-5e35-4c24-a746-e995ad8df62e tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5')] {{(pid=71229) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ca8257-df3f-4c0d-999c-566d1d4ae1f9]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f156c211-5e35-4c24-a746-e995ad8df62e tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5 -p 172.16.0.220:3260 --logout {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4a2e8e-89cb-4e52-aa4e-e1a77e430fdb]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f156c211-5e35-4c24-a746-e995ad8df62e tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5, portal: 172.16.0.220,3260]
Apr 11 15:29:50 user nova-compute[71229]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5, portal: 172.16.0.220,3260] successful.
Apr 11 15:29:50 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5 -p 172.16.0.220:3260 --op delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:929df1ae-4b01-4bfb-aa54-9da994b764c5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e376a837-4eca-4a2e-8b36-97ecbaa3e98c]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f156c211-5e35-4c24-a746-e995ad8df62e tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-f156c211-5e35-4c24-a746-e995ad8df62e tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f156c211-5e35-4c24-a746-e995ad8df62e tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] <== disconnect_volume: return (328ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f156c211-5e35-4c24-a746-e995ad8df62e tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 15:29:50 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:29:51 user nova-compute[71229]: DEBUG nova.objects.instance [None req-f156c211-5e35-4c24-a746-e995ad8df62e tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lazy-loading 'flavor' on Instance uuid d534d17d-ba77-4447-8a63-7d6021ad7896 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:29:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f156c211-5e35-4c24-a746-e995ad8df62e tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "d534d17d-ba77-4447-8a63-7d6021ad7896" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.769s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:29:51 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:29:51 user nova-compute[71229]: DEBUG nova.compute.manager [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Stashing vm_state: active {{(pid=71229) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 11 15:29:52 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:29:52 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:29:52 user nova-compute[71229]: DEBUG nova.objects.instance [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lazy-loading 'pci_requests' on Instance uuid 6a805345-374c-4326-9e8f-39bfc7947a35 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:29:52 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 15:29:52 user nova-compute[71229]: INFO nova.compute.claims [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Claim successful on node user
Apr 11 15:29:52 user nova-compute[71229]: DEBUG nova.objects.instance [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lazy-loading 'resources' on Instance uuid 6a805345-374c-4326-9e8f-39bfc7947a35 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:29:52 user nova-compute[71229]: DEBUG nova.objects.instance [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a805345-374c-4326-9e8f-39bfc7947a35 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:29:52 user nova-compute[71229]: INFO nova.compute.resource_tracker [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Updating resource usage from migration 61539203-b1fe-440c-9138-018e0db6e179
Apr 11 15:29:52 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:29:52 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:29:52 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.418s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:29:52 user nova-compute[71229]: INFO nova.compute.manager [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Migrating
Apr 11 15:29:52 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:29:52 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquired lock "compute-rpcapi-router" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:29:52 user nova-compute[71229]: INFO nova.compute.rpcapi [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Apr 11 15:29:52 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Releasing lock "compute-rpcapi-router" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:29:52 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "refresh_cache-6a805345-374c-4326-9e8f-39bfc7947a35" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:29:52 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquired lock "refresh_cache-6a805345-374c-4326-9e8f-39bfc7947a35" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:29:52 user nova-compute[71229]: DEBUG nova.network.neutron [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:29:53 user nova-compute[71229]: DEBUG nova.network.neutron [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Updating instance_info_cache with network_info: [{"id": "d8c64197-b034-4f38-821d-ba030f1fca6b", "address": "fa:16:3e:0f:f8:cb", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c64197-b0", "ovs_interfaceid": "d8c64197-b034-4f38-821d-ba030f1fca6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:29:53 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Releasing lock "refresh_cache-6a805345-374c-4326-9e8f-39bfc7947a35" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:29:53 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Starting migrate_disk_and_power_off {{(pid=71229) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 11 15:29:53 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:29:53 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:29:53 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:29:53 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:29:53 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:29:53 user nova-compute[71229]: DEBUG nova.compute.manager [req-e05de44c-3fc2-4773-9b64-357a6f999571 req-9664d049-1699-498b-b2c9-98b22cd16dfb service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Received event network-vif-unplugged-d8c64197-b034-4f38-821d-ba030f1fca6b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:29:53 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e05de44c-3fc2-4773-9b64-357a6f999571 req-9664d049-1699-498b-b2c9-98b22cd16dfb service nova] Acquiring lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:29:53 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e05de44c-3fc2-4773-9b64-357a6f999571 req-9664d049-1699-498b-b2c9-98b22cd16dfb service nova] Lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:29:53 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e05de44c-3fc2-4773-9b64-357a6f999571 req-9664d049-1699-498b-b2c9-98b22cd16dfb service nova] Lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:29:53 user nova-compute[71229]: DEBUG nova.compute.manager [req-e05de44c-3fc2-4773-9b64-357a6f999571 req-9664d049-1699-498b-b2c9-98b22cd16dfb service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] No waiting events found dispatching network-vif-unplugged-d8c64197-b034-4f38-821d-ba030f1fca6b {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:29:53 user nova-compute[71229]: WARNING nova.compute.manager [req-e05de44c-3fc2-4773-9b64-357a6f999571 req-9664d049-1699-498b-b2c9-98b22cd16dfb service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Received unexpected event network-vif-unplugged-d8c64197-b034-4f38-821d-ba030f1fca6b for instance with vm_state active and task_state resize_migrating.
Apr 11 15:29:53 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Instance destroyed successfully.
Apr 11 15:29:53 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T15:21:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1386574519',display_name='tempest-ServerActionsTestJSON-server-252985182',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1386574519',id=3,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfAJGQ+GOa8zW+jlKgD9Kz6/k6iEv9pZIOIjICzcstJ92AAS94+47mc3fRsqyx5FaTMV9P4lTsW4Fy7tKIAtMpRx0Sl7sa6ttQnPbPhlcYqfbdWbTqmmKi6+BuZpqSknA==',key_name='tempest-keypair-1137963694',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:25:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bb7660e8f76b471487136806ee9eec62',ramdisk_id='',reservation_id='r-hmn5p3xn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1659503440',owner_user_name='tempest-ServerActionsTestJSON-1659503440-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:29:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10720df0ac4f4e62a0a5c9883d600add',uuid=6a805345-374c-4326-9e8f-39bfc7947a35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8c64197-b034-4f38-821d-ba030f1fca6b", "address": "fa:16:3e:0f:f8:cb", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-665410087-network", "vif_mac": "fa:16:3e:0f:f8:cb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c64197-b0", "ovs_interfaceid": "d8c64197-b034-4f38-821d-ba030f1fca6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:29:53 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Converting VIF {"id": "d8c64197-b034-4f38-821d-ba030f1fca6b", "address": "fa:16:3e:0f:f8:cb", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-665410087-network", "vif_mac": "fa:16:3e:0f:f8:cb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c64197-b0", "ovs_interfaceid": "d8c64197-b034-4f38-821d-ba030f1fca6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:29:53 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:f8:cb,bridge_name='br-int',has_traffic_filtering=True,id=d8c64197-b034-4f38-821d-ba030f1fca6b,network=Network(1bd215e8-0459-4dd2-893b-096b6e31ac08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c64197-b0') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:29:53 user nova-compute[71229]: DEBUG os_vif [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:f8:cb,bridge_name='br-int',has_traffic_filtering=True,id=d8c64197-b034-4f38-821d-ba030f1fca6b,network=Network(1bd215e8-0459-4dd2-893b-096b6e31ac08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c64197-b0') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:29:53 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:29:53 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd8c64197-b0, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:29:53 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:29:53 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:29:53 user nova-compute[71229]: INFO os_vif [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:f8:cb,bridge_name='br-int',has_traffic_filtering=True,id=d8c64197-b034-4f38-821d-ba030f1fca6b,network=Network(1bd215e8-0459-4dd2-893b-096b6e31ac08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c64197-b0')
Apr 11 15:29:53 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 15:29:53 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XapmTvFn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:29:53 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:29:53 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:29:53 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:29:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a70dcb-6fc0-4273-8f06-1de065b4a79f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 15:29:54 user nova-compute[71229]: No targets found.
Apr 11 15:29:54 user nova-compute[71229]: iSNS:
Apr 11 15:29:54 user nova-compute[71229]: No targets found.
Apr 11 15:29:54 user nova-compute[71229]: STATIC:
Apr 11 15:29:54 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb
Apr 11 15:29:54 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:29:54 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:29:54 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2
Apr 11 15:29:54 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:29:54 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:29:54 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7
Apr 11 15:29:54 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:29:54 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:29:54 user nova-compute[71229]: FIRMWARE:
Apr 11 15:29:54 user nova-compute[71229]: No targets found.
Apr 11 15:29:54 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 15:29:54 user nova-compute[71229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 15:29:54 user nova-compute[71229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71229) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2', 0)] {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48b78fd-63c5-4fda-a788-33e0aaf91c57]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d03b34-0574-4f79-b3c7-a3a043f9dbe4]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:29:54 user nova-compute[71229]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)
Apr 11 15:29:54 user nova-compute[71229]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:29:54 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:29:54 user nova-compute[71229]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)
Apr 11 15:29:54 user nova-compute[71229]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:29:54 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb5c2fd090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2'): ({'sde'}, set())}) {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Removing single pathed devices sde {{(pid=71229) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c918bc-d15a-4fb3-8082-40317b93947e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce297c03-3122-4a5f-b32d-19620ac6c306]: (4, ('ok\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Flushing IO for device /dev/sde {{(pid=71229) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5158e79b-fa6d-4230-9bf1-fbd40c9f05fc]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71229) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.032s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1bb3fa0-57e9-4a6b-aa24-c4789c488f52]: (4, ('1', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] SCSI volumes sde have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2')] {{(pid=71229) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6a09fd-7c74-410a-9446-edefa2f555b6]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --logout {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[035093fd-56a5-4c6b-89e6-15302a73f63e]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2, portal: 172.16.0.220,3260]
Apr 11 15:29:54 user nova-compute[71229]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2, portal: 172.16.0.220,3260] successful.
Apr 11 15:29:54 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --op delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f5d3cc-d9f5-4c32-98c4-e59cb9a7f378]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] <== disconnect_volume: return (320ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35_resize/disk /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] CMD "cp -r /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35_resize/disk /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk" returned: 0 in 0.227s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35_resize/disk.info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk.info {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] CMD "cp -r /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35_resize/disk.info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk.info" returned: 0 in 0.040s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:55 user nova-compute[71229]: DEBUG nova.compute.manager [req-fd7699fe-6875-4503-8dcc-96411e640198 req-c172aa28-2126-430f-ab5f-6387a49a6818 service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Received event network-vif-plugged-d8c64197-b034-4f38-821d-ba030f1fca6b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:29:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-fd7699fe-6875-4503-8dcc-96411e640198 req-c172aa28-2126-430f-ab5f-6387a49a6818 service nova] Acquiring lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:29:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-fd7699fe-6875-4503-8dcc-96411e640198 req-c172aa28-2126-430f-ab5f-6387a49a6818 service nova] Lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:29:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-fd7699fe-6875-4503-8dcc-96411e640198 req-c172aa28-2126-430f-ab5f-6387a49a6818 service nova] Lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:29:55 user nova-compute[71229]: DEBUG nova.compute.manager [req-fd7699fe-6875-4503-8dcc-96411e640198 req-c172aa28-2126-430f-ab5f-6387a49a6818 service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] No waiting events found dispatching network-vif-plugged-d8c64197-b034-4f38-821d-ba030f1fca6b {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:29:55 user nova-compute[71229]: WARNING nova.compute.manager [req-fd7699fe-6875-4503-8dcc-96411e640198 req-c172aa28-2126-430f-ab5f-6387a49a6818 service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Received unexpected event network-vif-plugged-d8c64197-b034-4f38-821d-ba030f1fca6b for instance with vm_state active and task_state resize_migrating.
Apr 11 15:29:55 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:29:55 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 15:29:55 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:29:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:29:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:29:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:29:55 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 15:29:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:55 user nova-compute[71229]: DEBUG nova.network.neutron [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Port d8c64197-b034-4f38-821d-ba030f1fca6b binding to destination host user is already ACTIVE {{(pid=71229) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 11 15:29:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:56 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:29:56 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:29:56 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:29:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:56 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:29:56 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:29:56 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "refresh_cache-6a805345-374c-4326-9e8f-39bfc7947a35" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:29:56 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquired lock "refresh_cache-6a805345-374c-4326-9e8f-39bfc7947a35" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:29:56 user nova-compute[71229]: DEBUG nova.network.neutron [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:29:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d534d17d-ba77-4447-8a63-7d6021ad7896/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d534d17d-ba77-4447-8a63-7d6021ad7896/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:29:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d534d17d-ba77-4447-8a63-7d6021ad7896/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:56 user nova-compute[71229]: DEBUG nova.network.neutron [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Updating instance_info_cache with network_info: [{"id": "d8c64197-b034-4f38-821d-ba030f1fca6b", "address": "fa:16:3e:0f:f8:cb", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c64197-b0", "ovs_interfaceid": "d8c64197-b034-4f38-821d-ba030f1fca6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:29:56 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Releasing lock "refresh_cache-6a805345-374c-4326-9e8f-39bfc7947a35" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:29:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d534d17d-ba77-4447-8a63-7d6021ad7896/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:56 user nova-compute[71229]: DEBUG os_brick.utils [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:29:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:56 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b521f0d6-9b56-4597-b442-0eceef58f320]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d55e24a97c90\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:56 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d9a984-330f-4fb3-9c47-715554755137]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:56 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c450a4a-08dd-49e8-86be-1e5fd3f293df]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:56 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ddb518c-bce6-461a-b60d-604b8713d47f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Running cmd (subprocess): nvme version {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 'nvme version' failed. Not Retrying. {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:29:57 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] nvme not present on system {{(pid=71229) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 15:29:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:29:57 user nova-compute[71229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 15:29:57 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca75bd0-d535-435e-ba66-6c616fd57367]: (4, '') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:29:57 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71229) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 15:29:57 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 15:29:57 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] LIGHTOS: no hostnqn found. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 15:29:57 user nova-compute[71229]: DEBUG os_brick.utils [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d55e24a97c90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:29:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4555892-7abb-4a3c-a4ae-a27ad4902708/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4555892-7abb-4a3c-a4ae-a27ad4902708/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4555892-7abb-4a3c-a4ae-a27ad4902708/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4555892-7abb-4a3c-a4ae-a27ad4902708/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:29:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:29:58 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:29:58 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:29:58 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:29:58 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8055MB free_disk=26.1461181640625GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 15:29:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:29:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:29:58 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Applying migration context for instance 6a805345-374c-4326-9e8f-39bfc7947a35 as it has an incoming, in-progress migration 61539203-b1fe-440c-9138-018e0db6e179. Migration status is post-migrating {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 11 15:29:58 user nova-compute[71229]: INFO nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Updating resource usage from migration 61539203-b1fe-440c-9138-018e0db6e179
Apr 11 15:29:58 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance de1a45fd-27be-4438-80a4-2f3a100643c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:29:58 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance b0d90fd2-6a95-43c4-8756-e82071d99154 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:29:58 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance e4555892-7abb-4a3c-a4ae-a27ad4902708 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:29:58 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance d534d17d-ba77-4447-8a63-7d6021ad7896 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:29:58 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:29:58 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:29:58 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 39e3dfb1-bc09-474d-b8cb-f01b11923eae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:29:58 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 7c4329ae-07cb-4f28-9fd6-29b398517d2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:29:58 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Migration 61539203-b1fe-440c-9138-018e0db6e179 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 11 15:29:58 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 6a805345-374c-4326-9e8f-39bfc7947a35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:29:58 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 15:29:58 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=1856MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 15:29:58 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:29:58 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:29:58 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 15:29:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.441s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:29:58 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:29:59 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:29:59 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 15:30:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "refresh_cache-e4555892-7abb-4a3c-a4ae-a27ad4902708" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:30:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquired lock "refresh_cache-e4555892-7abb-4a3c-a4ae-a27ad4902708" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:30:00 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Forcefully refreshing network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 15:30:00 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Updating instance_info_cache with network_info: [{"id": "a002e821-ea54-4d5c-b25c-8c517fab4e92", "address": "fa:16:3e:49:8a:71", "network": {"id": "f9b1d398-27cb-42de-9d95-0e031b1bd6ec", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1833751152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "561130d089c8415297697bcedc93aefc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa002e821-ea", "ovs_interfaceid": "a002e821-ea54-4d5c-b25c-8c517fab4e92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:30:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Releasing lock "refresh_cache-e4555892-7abb-4a3c-a4ae-a27ad4902708" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:30:00 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Updated the network info_cache for instance {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 15:30:00 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:30:00 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:30:00 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:30:00 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:30:00 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:30:00 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Starting finish_migration {{(pid=71229) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Instance directory exists: not creating {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 15:30:01 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Creating image(s)
Apr 11 15:30:01 user nova-compute[71229]: DEBUG nova.objects.instance [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6a805345-374c-4326-9e8f-39bfc7947a35 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.148s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk. size=1073741824 {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Cannot resize image /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk to a smaller size. {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Did not create local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Ensure instance console log exists: /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Start _get_guest_xml network_info=[{"id": "d8c64197-b034-4f38-821d-ba030f1fca6b", "address": "fa:16:3e:0f:f8:cb", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-665410087-network", "vif_mac": "fa:16:3e:0f:f8:cb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c64197-b0", "ovs_interfaceid": "d8c64197-b034-4f38-821d-ba030f1fca6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '52fe638c-5ada-47d5-b376-233bfa808a37'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XapmTvFn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '6a805345-374c-4326-9e8f-39bfc7947a35', 'attached_at': '2023-04-11T15:30:01.000000', 'detached_at': '', 'volume_id': 'e168e446-1ecb-4f58-bc6c-0f488fa989a2', 'serial': 'e168e446-1ecb-4f58-bc6c-0f488fa989a2'}, 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '52b2612d-3c8c-44e8-b909-3d61dd0974f8', 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:30:01 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:30:01 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:30:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG nova.objects.instance [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6a805345-374c-4326-9e8f-39bfc7947a35 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XapmTvFn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:30:01 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:30:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:30:01 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:30:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:30:01 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 15:30:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[316030e7-cf93-4e4a-849d-c91835c46b88]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 15:30:01 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --interface default --op new {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8b8922-3bc3-4653-a0a9-310e770b3e6e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2] added\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2] added
Apr 11 15:30:01 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4defd1e-f4e8-429f-8942-d09bbf5a957d]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb51536-0f6e-4137-a358-4c4c4ee88793]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XapmTvFn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XapmTvFn" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6881cca-4edb-4b76-a3a4-feade49510a3]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XapmTvFn'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a77be32-0464-475b-aa8d-623457bf3f3f]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b42383d-ee3b-4a2a-85aa-5e508438c47b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:30:01 user nova-compute[71229]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)
Apr 11 15:30:01 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:30:01 user nova-compute[71229]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)
Apr 11 15:30:01 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --login {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --login" returned: 0 in 0.134s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b44564-9247-453d-be9d-9f2e60c91cff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2, portal: 172.16.0.220,3260]
Apr 11 15:30:01 user nova-compute[71229]: Login to [iface: default, target: iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2, portal: 172.16.0.220,3260] successful.
Apr 11 15:30:01 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff5a27b-5314-45d2-9f6f-b92c81a88f51]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7012e091-40cd-4b5c-af76-388378eadc67]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:30:01 user nova-compute[71229]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)
Apr 11 15:30:01 user nova-compute[71229]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:30:01 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:30:01 user nova-compute[71229]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)
Apr 11 15:30:01 user nova-compute[71229]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:30:01 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8c477f-2760-4448-a35d-cf539de506fa]: (4, ('- - 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:01 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: None {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:30:02 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:30:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XapmTvFn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 15:30:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.399s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:30:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] <== connect_volume: return (1401ms) {'type': 'block', 'scsi_wwn': '23532643732633938', 'path': '/dev/sdc'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:30:02 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532643732633938', 'path': '/dev/sdc'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 15:30:02 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T15:21:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1386574519',display_name='tempest-ServerActionsTestJSON-server-252985182',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1386574519',id=3,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfAJGQ+GOa8zW+jlKgD9Kz6/k6iEv9pZIOIjICzcstJ92AAS94+47mc3fRsqyx5FaTMV9P4lTsW4Fy7tKIAtMpRx0Sl7sa6ttQnPbPhlcYqfbdWbTqmmKi6+BuZpqSknA==',key_name='tempest-keypair-1137963694',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:25:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bb7660e8f76b471487136806ee9eec62',ramdisk_id='',reservation_id='r-hmn5p3xn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1659503440',owner_user_name='tempest-ServerActionsTestJSON-1659503440-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:29:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10720df0ac4f4e62a0a5c9883d600add',uuid=6a805345-374c-4326-9e8f-39bfc7947a35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8c64197-b034-4f38-821d-ba030f1fca6b", "address": "fa:16:3e:0f:f8:cb", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-665410087-network", "vif_mac": "fa:16:3e:0f:f8:cb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c64197-b0", "ovs_interfaceid": "d8c64197-b034-4f38-821d-ba030f1fca6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:30:02 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Converting VIF {"id": "d8c64197-b034-4f38-821d-ba030f1fca6b", "address": "fa:16:3e:0f:f8:cb", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-665410087-network", "vif_mac": "fa:16:3e:0f:f8:cb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c64197-b0", "ovs_interfaceid": "d8c64197-b034-4f38-821d-ba030f1fca6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:30:02 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:f8:cb,bridge_name='br-int',has_traffic_filtering=True,id=d8c64197-b034-4f38-821d-ba030f1fca6b,network=Network(1bd215e8-0459-4dd2-893b-096b6e31ac08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c64197-b0') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:30:02 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:30:02 user nova-compute[71229]:   <uuid>6a805345-374c-4326-9e8f-39bfc7947a35</uuid>
Apr 11 15:30:02 user nova-compute[71229]:   <name>instance-00000003</name>
Apr 11 15:30:02 user nova-compute[71229]:   <memory>196608</memory>
Apr 11 15:30:02 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:30:02 user nova-compute[71229]:   <metadata>
Apr 11 15:30:02 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:30:02 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:30:02 user nova-compute[71229]:       <nova:name>tempest-ServerActionsTestJSON-server-252985182</nova:name>
Apr 11 15:30:02 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:30:01</nova:creationTime>
Apr 11 15:30:02 user nova-compute[71229]:       <nova:flavor name="m1.micro">
Apr 11 15:30:02 user nova-compute[71229]:         <nova:memory>192</nova:memory>
Apr 11 15:30:02 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:30:02 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:30:02 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:30:02 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:30:02 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:30:02 user nova-compute[71229]:       <nova:owner>
Apr 11 15:30:02 user nova-compute[71229]:         <nova:user uuid="10720df0ac4f4e62a0a5c9883d600add">tempest-ServerActionsTestJSON-1659503440-project-member</nova:user>
Apr 11 15:30:02 user nova-compute[71229]:         <nova:project uuid="bb7660e8f76b471487136806ee9eec62">tempest-ServerActionsTestJSON-1659503440</nova:project>
Apr 11 15:30:02 user nova-compute[71229]:       </nova:owner>
Apr 11 15:30:02 user nova-compute[71229]:       <nova:root type="image" uuid="52fe638c-5ada-47d5-b376-233bfa808a37"/>
Apr 11 15:30:02 user nova-compute[71229]:       <nova:ports>
Apr 11 15:30:02 user nova-compute[71229]:         <nova:port uuid="d8c64197-b034-4f38-821d-ba030f1fca6b">
Apr 11 15:30:02 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 11 15:30:02 user nova-compute[71229]:         </nova:port>
Apr 11 15:30:02 user nova-compute[71229]:       </nova:ports>
Apr 11 15:30:02 user nova-compute[71229]:     </nova:instance>
Apr 11 15:30:02 user nova-compute[71229]:   </metadata>
Apr 11 15:30:02 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:30:02 user nova-compute[71229]:     <system>
Apr 11 15:30:02 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:30:02 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:30:02 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:30:02 user nova-compute[71229]:       <entry name="serial">6a805345-374c-4326-9e8f-39bfc7947a35</entry>
Apr 11 15:30:02 user nova-compute[71229]:       <entry name="uuid">6a805345-374c-4326-9e8f-39bfc7947a35</entry>
Apr 11 15:30:02 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:30:02 user nova-compute[71229]:     </system>
Apr 11 15:30:02 user nova-compute[71229]:   </sysinfo>
Apr 11 15:30:02 user nova-compute[71229]:   <os>
Apr 11 15:30:02 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:30:02 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 15:30:02 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:30:02 user nova-compute[71229]:   </os>
Apr 11 15:30:02 user nova-compute[71229]:   <features>
Apr 11 15:30:02 user nova-compute[71229]:     <acpi/>
Apr 11 15:30:02 user nova-compute[71229]:     <apic/>
Apr 11 15:30:02 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:30:02 user nova-compute[71229]:   </features>
Apr 11 15:30:02 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:30:02 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:30:02 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:30:02 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:30:02 user nova-compute[71229]:   </clock>
Apr 11 15:30:02 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:30:02 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:30:02 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:30:02 user nova-compute[71229]:   </cpu>
Apr 11 15:30:02 user nova-compute[71229]:   <devices>
Apr 11 15:30:02 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 15:30:02 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 15:30:02 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk"/>
Apr 11 15:30:02 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:30:02 user nova-compute[71229]:     </disk>
Apr 11 15:30:02 user nova-compute[71229]:     <disk type="block" device="disk">
Apr 11 15:30:02 user nova-compute[71229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:30:02 user nova-compute[71229]:       <source dev="/dev/sdc"/>
Apr 11 15:30:02 user nova-compute[71229]:       <target dev="vdb" bus="virtio"/>
Apr 11 15:30:02 user nova-compute[71229]:       <serial>e168e446-1ecb-4f58-bc6c-0f488fa989a2</serial>
Apr 11 15:30:02 user nova-compute[71229]:     </disk>
Apr 11 15:30:02 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:30:02 user nova-compute[71229]:       <mac address="fa:16:3e:0f:f8:cb"/>
Apr 11 15:30:02 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:30:02 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:30:02 user nova-compute[71229]:       <target dev="tapd8c64197-b0"/>
Apr 11 15:30:02 user nova-compute[71229]:     </interface>
Apr 11 15:30:02 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:30:02 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/console.log" append="off"/>
Apr 11 15:30:02 user nova-compute[71229]:     </serial>
Apr 11 15:30:02 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:30:02 user nova-compute[71229]:     <video>
Apr 11 15:30:02 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:30:02 user nova-compute[71229]:     </video>
Apr 11 15:30:02 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:30:02 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:30:02 user nova-compute[71229]:     </rng>
Apr 11 15:30:02 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:30:02 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:30:02 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:30:02 user nova-compute[71229]:     </memballoon>
Apr 11 15:30:02 user nova-compute[71229]:   </devices>
Apr 11 15:30:02 user nova-compute[71229]: </domain>
Apr 11 15:30:02 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:30:02 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T15:21:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1386574519',display_name='tempest-ServerActionsTestJSON-server-252985182',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1386574519',id=3,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfAJGQ+GOa8zW+jlKgD9Kz6/k6iEv9pZIOIjICzcstJ92AAS94+47mc3fRsqyx5FaTMV9P4lTsW4Fy7tKIAtMpRx0Sl7sa6ttQnPbPhlcYqfbdWbTqmmKi6+BuZpqSknA==',key_name='tempest-keypair-1137963694',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:25:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bb7660e8f76b471487136806ee9eec62',ramdisk_id='',reservation_id='r-hmn5p3xn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1659503440',owner_user_name='tempest-ServerActionsTestJSON-1659503440-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:29:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10720df0ac4f4e62a0a5c9883d600add',uuid=6a805345-374c-4326-9e8f-39bfc7947a35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8c64197-b034-4f38-821d-ba030f1fca6b", "address": "fa:16:3e:0f:f8:cb", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-665410087-network", "vif_mac": "fa:16:3e:0f:f8:cb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c64197-b0", "ovs_interfaceid": "d8c64197-b034-4f38-821d-ba030f1fca6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:30:02 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Converting VIF {"id": "d8c64197-b034-4f38-821d-ba030f1fca6b", "address": "fa:16:3e:0f:f8:cb", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-665410087-network", "vif_mac": "fa:16:3e:0f:f8:cb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c64197-b0", "ovs_interfaceid": "d8c64197-b034-4f38-821d-ba030f1fca6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:30:02 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:f8:cb,bridge_name='br-int',has_traffic_filtering=True,id=d8c64197-b034-4f38-821d-ba030f1fca6b,network=Network(1bd215e8-0459-4dd2-893b-096b6e31ac08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c64197-b0') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:30:02 user nova-compute[71229]: DEBUG os_vif [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:f8:cb,bridge_name='br-int',has_traffic_filtering=True,id=d8c64197-b034-4f38-821d-ba030f1fca6b,network=Network(1bd215e8-0459-4dd2-893b-096b6e31ac08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c64197-b0') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:30:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:30:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:30:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd8c64197-b0, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:30:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd8c64197-b0, col_values=(('external_ids', {'iface-id': 'd8c64197-b034-4f38-821d-ba030f1fca6b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:f8:cb', 'vm-uuid': '6a805345-374c-4326-9e8f-39bfc7947a35'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:30:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:30:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:02 user nova-compute[71229]: INFO os_vif [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:f8:cb,bridge_name='br-int',has_traffic_filtering=True,id=d8c64197-b034-4f38-821d-ba030f1fca6b,network=Network(1bd215e8-0459-4dd2-893b-096b6e31ac08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c64197-b0')
Apr 11 15:30:03 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:30:03 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:30:03 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] No VIF found with MAC fa:16:3e:0f:f8:cb, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:30:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:04 user nova-compute[71229]: DEBUG nova.compute.manager [req-49d0135a-f02d-4a06-bb12-074f09e516da req-fa534f60-d009-419a-9d0f-83c567522062 service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Received event network-vif-plugged-d8c64197-b034-4f38-821d-ba030f1fca6b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:30:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-49d0135a-f02d-4a06-bb12-074f09e516da req-fa534f60-d009-419a-9d0f-83c567522062 service nova] Acquiring lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:30:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-49d0135a-f02d-4a06-bb12-074f09e516da req-fa534f60-d009-419a-9d0f-83c567522062 service nova] Lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:30:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-49d0135a-f02d-4a06-bb12-074f09e516da req-fa534f60-d009-419a-9d0f-83c567522062 service nova] Lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:30:04 user nova-compute[71229]: DEBUG nova.compute.manager [req-49d0135a-f02d-4a06-bb12-074f09e516da req-fa534f60-d009-419a-9d0f-83c567522062 service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] No waiting events found dispatching network-vif-plugged-d8c64197-b034-4f38-821d-ba030f1fca6b {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:30:04 user nova-compute[71229]: WARNING nova.compute.manager [req-49d0135a-f02d-4a06-bb12-074f09e516da req-fa534f60-d009-419a-9d0f-83c567522062 service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Received unexpected event network-vif-plugged-d8c64197-b034-4f38-821d-ba030f1fca6b for instance with vm_state active and task_state resize_finish.
Apr 11 15:30:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:06 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Removed pending event for 6a805345-374c-4326-9e8f-39bfc7947a35 due to event {{(pid=71229) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 15:30:06 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227006.375219, 6a805345-374c-4326-9e8f-39bfc7947a35 => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:30:06 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] VM Resumed (Lifecycle Event)
Apr 11 15:30:06 user nova-compute[71229]: DEBUG nova.compute.manager [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 15:30:06 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Instance running successfully.
Apr 11 15:30:06 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Failed to set time: agent not configured {{(pid=71229) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 11 15:30:06 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b3b3915b-ba67-4ca7-8b88-65039a8b28c6 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] finish_migration finished successfully. {{(pid=71229) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 11 15:30:06 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:30:06 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:30:06 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 11 15:30:06 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227006.3777547, 6a805345-374c-4326-9e8f-39bfc7947a35 => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:30:06 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] VM Started (Lifecycle Event)
Apr 11 15:30:06 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:30:06 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:30:06 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 11 15:30:06 user nova-compute[71229]: DEBUG nova.compute.manager [req-4f9070df-3c53-4169-ad33-db1854197e4b req-6b2913a8-8b74-4158-ac3f-40d60cac8033 service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Received event network-vif-plugged-d8c64197-b034-4f38-821d-ba030f1fca6b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:30:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4f9070df-3c53-4169-ad33-db1854197e4b req-6b2913a8-8b74-4158-ac3f-40d60cac8033 service nova] Acquiring lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:30:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4f9070df-3c53-4169-ad33-db1854197e4b req-6b2913a8-8b74-4158-ac3f-40d60cac8033 service nova] Lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:30:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4f9070df-3c53-4169-ad33-db1854197e4b req-6b2913a8-8b74-4158-ac3f-40d60cac8033 service nova] Lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:30:06 user nova-compute[71229]: DEBUG nova.compute.manager [req-4f9070df-3c53-4169-ad33-db1854197e4b req-6b2913a8-8b74-4158-ac3f-40d60cac8033 service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] No waiting events found dispatching network-vif-plugged-d8c64197-b034-4f38-821d-ba030f1fca6b {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:30:06 user nova-compute[71229]: WARNING nova.compute.manager [req-4f9070df-3c53-4169-ad33-db1854197e4b req-6b2913a8-8b74-4158-ac3f-40d60cac8033 service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Received unexpected event network-vif-plugged-d8c64197-b034-4f38-821d-ba030f1fca6b for instance with vm_state resized and task_state None.
Apr 11 15:30:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:09 user nova-compute[71229]: DEBUG nova.compute.manager [req-46b28ea9-4245-4a89-9838-c956f5ec76d1 req-0993200c-53d5-44b0-a7f3-464989d1d31f service nova] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Received event network-changed-40f1797d-278c-4676-8413-3b0c0f113dd9 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:30:09 user nova-compute[71229]: DEBUG nova.compute.manager [req-46b28ea9-4245-4a89-9838-c956f5ec76d1 req-0993200c-53d5-44b0-a7f3-464989d1d31f service nova] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Refreshing instance network info cache due to event network-changed-40f1797d-278c-4676-8413-3b0c0f113dd9. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:30:09 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-46b28ea9-4245-4a89-9838-c956f5ec76d1 req-0993200c-53d5-44b0-a7f3-464989d1d31f service nova] Acquiring lock "refresh_cache-1424f1ff-6c0f-4f9a-bddc-6c448a768a7a" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:30:09 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-46b28ea9-4245-4a89-9838-c956f5ec76d1 req-0993200c-53d5-44b0-a7f3-464989d1d31f service nova] Acquired lock "refresh_cache-1424f1ff-6c0f-4f9a-bddc-6c448a768a7a" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:30:09 user nova-compute[71229]: DEBUG nova.network.neutron [req-46b28ea9-4245-4a89-9838-c956f5ec76d1 req-0993200c-53d5-44b0-a7f3-464989d1d31f service nova] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Refreshing network info cache for port 40f1797d-278c-4676-8413-3b0c0f113dd9 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:30:09 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4039d338-dd6e-459f-979b-dbf056c510ab tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Acquiring lock "interface-1424f1ff-6c0f-4f9a-bddc-6c448a768a7a-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:30:09 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4039d338-dd6e-459f-979b-dbf056c510ab tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "interface-1424f1ff-6c0f-4f9a-bddc-6c448a768a7a-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:30:09 user nova-compute[71229]: DEBUG nova.objects.instance [None req-4039d338-dd6e-459f-979b-dbf056c510ab tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lazy-loading 'flavor' on Instance uuid 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:30:09 user nova-compute[71229]: DEBUG nova.objects.instance [None req-4039d338-dd6e-459f-979b-dbf056c510ab tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lazy-loading 'pci_requests' on Instance uuid 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:30:09 user nova-compute[71229]: DEBUG nova.network.neutron [None req-4039d338-dd6e-459f-979b-dbf056c510ab tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] allocate_for_instance() {{(pid=71229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 15:30:09 user nova-compute[71229]: DEBUG nova.policy [None req-4039d338-dd6e-459f-979b-dbf056c510ab tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f32986358bcc4148ad3f361e3944ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82dec4b679f24d1e85b1105b4849cddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71229) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 15:30:09 user nova-compute[71229]: DEBUG nova.network.neutron [req-46b28ea9-4245-4a89-9838-c956f5ec76d1 req-0993200c-53d5-44b0-a7f3-464989d1d31f service nova] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Updated VIF entry in instance network info cache for port 40f1797d-278c-4676-8413-3b0c0f113dd9. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:30:09 user nova-compute[71229]: DEBUG nova.network.neutron [req-46b28ea9-4245-4a89-9838-c956f5ec76d1 req-0993200c-53d5-44b0-a7f3-464989d1d31f service nova] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Updating instance_info_cache with network_info: [{"id": "40f1797d-278c-4676-8413-3b0c0f113dd9", "address": "fa:16:3e:05:3e:4e", "network": {"id": "921b7e62-65aa-426c-9286-8b31b88588a8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1464327252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82dec4b679f24d1e85b1105b4849cddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40f1797d-27", "ovs_interfaceid": "40f1797d-278c-4676-8413-3b0c0f113dd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:30:09 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-46b28ea9-4245-4a89-9838-c956f5ec76d1 req-0993200c-53d5-44b0-a7f3-464989d1d31f service nova] Releasing lock "refresh_cache-1424f1ff-6c0f-4f9a-bddc-6c448a768a7a" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:30:10 user nova-compute[71229]: DEBUG nova.network.neutron [None req-4039d338-dd6e-459f-979b-dbf056c510ab tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Successfully created port: d218dc4e-de80-49ed-be04-59771f71dd3f {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 15:30:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:11 user nova-compute[71229]: DEBUG nova.network.neutron [None req-4039d338-dd6e-459f-979b-dbf056c510ab tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Successfully updated port: d218dc4e-de80-49ed-be04-59771f71dd3f {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:30:11 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4039d338-dd6e-459f-979b-dbf056c510ab tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Acquiring lock "refresh_cache-1424f1ff-6c0f-4f9a-bddc-6c448a768a7a" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:30:11 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4039d338-dd6e-459f-979b-dbf056c510ab tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Acquired lock "refresh_cache-1424f1ff-6c0f-4f9a-bddc-6c448a768a7a" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:30:11 user nova-compute[71229]: DEBUG nova.network.neutron [None req-4039d338-dd6e-459f-979b-dbf056c510ab tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:30:11 user nova-compute[71229]: DEBUG nova.compute.manager [req-7049d01f-aaa6-4b69-9c44-0bfb3cb4391e req-76d8d963-a30b-4509-9529-360cb0a4f0c2 service nova] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Received event network-changed-d218dc4e-de80-49ed-be04-59771f71dd3f {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:30:11 user nova-compute[71229]: DEBUG nova.compute.manager [req-7049d01f-aaa6-4b69-9c44-0bfb3cb4391e req-76d8d963-a30b-4509-9529-360cb0a4f0c2 service nova] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Refreshing instance network info cache due to event network-changed-d218dc4e-de80-49ed-be04-59771f71dd3f. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:30:11 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-7049d01f-aaa6-4b69-9c44-0bfb3cb4391e req-76d8d963-a30b-4509-9529-360cb0a4f0c2 service nova] Acquiring lock "refresh_cache-1424f1ff-6c0f-4f9a-bddc-6c448a768a7a" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:30:12 user nova-compute[71229]: DEBUG nova.network.neutron [None req-4039d338-dd6e-459f-979b-dbf056c510ab tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Updating instance_info_cache with network_info: [{"id": "40f1797d-278c-4676-8413-3b0c0f113dd9", "address": "fa:16:3e:05:3e:4e", "network": {"id": "921b7e62-65aa-426c-9286-8b31b88588a8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1464327252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82dec4b679f24d1e85b1105b4849cddd", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40f1797d-27", "ovs_interfaceid": "40f1797d-278c-4676-8413-3b0c0f113dd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d218dc4e-de80-49ed-be04-59771f71dd3f", "address": "fa:16:3e:83:b6:f0", "network": {"id": "f07eb0b8-74da-402a-a601-68a72f85f931", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1723277263", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "82dec4b679f24d1e85b1105b4849cddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd218dc4e-de", "ovs_interfaceid": "d218dc4e-de80-49ed-be04-59771f71dd3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:30:12 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4039d338-dd6e-459f-979b-dbf056c510ab tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Releasing lock "refresh_cache-1424f1ff-6c0f-4f9a-bddc-6c448a768a7a" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:30:12 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-7049d01f-aaa6-4b69-9c44-0bfb3cb4391e req-76d8d963-a30b-4509-9529-360cb0a4f0c2 service nova] Acquired lock "refresh_cache-1424f1ff-6c0f-4f9a-bddc-6c448a768a7a" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:30:12 user nova-compute[71229]: DEBUG nova.network.neutron [req-7049d01f-aaa6-4b69-9c44-0bfb3cb4391e req-76d8d963-a30b-4509-9529-360cb0a4f0c2 service nova] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Refreshing network info cache for port d218dc4e-de80-49ed-be04-59771f71dd3f {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:30:12 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-4039d338-dd6e-459f-979b-dbf056c510ab tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T15:28:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-982441201',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-982441201',id=19,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQhnP1Gx1ErLuuEevJpV94XRpvcJAoAfxD6RZqXP7Kvn0H8XePF/x7sWzG5H5vtetd0gs+rS/bMxjK4Qz9b0uYhYgbQvD0DmjSlBMXC1CeKAiMrjjZNT7Keb43XJ65W+w==',key_name='tempest-keypair-1011126544',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:28:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='82dec4b679f24d1e85b1105b4849cddd',ramdisk_id='',reservation_id='r-izovbhtx',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-727930312',owner_user_name='tempest-TaggedAttachmentsTest-727930312-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:28:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f32986358bcc4148ad3f361e3944ed81',uuid=1424f1ff-6c0f-4f9a-bddc-6c448a768a7a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d218dc4e-de80-49ed-be04-59771f71dd3f", "address": "fa:16:3e:83:b6:f0", "network": {"id": "f07eb0b8-74da-402a-a601-68a72f85f931", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1723277263", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "82dec4b679f24d1e85b1105b4849cddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd218dc4e-de", "ovs_interfaceid": "d218dc4e-de80-49ed-be04-59771f71dd3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:30:12 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-4039d338-dd6e-459f-979b-dbf056c510ab tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Converting VIF {"id": "d218dc4e-de80-49ed-be04-59771f71dd3f", "address": "fa:16:3e:83:b6:f0", "network": {"id": "f07eb0b8-74da-402a-a601-68a72f85f931", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1723277263", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "82dec4b679f24d1e85b1105b4849cddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd218dc4e-de", "ovs_interfaceid": "d218dc4e-de80-49ed-be04-59771f71dd3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:30:12 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-4039d338-dd6e-459f-979b-dbf056c510ab tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:b6:f0,bridge_name='br-int',has_traffic_filtering=True,id=d218dc4e-de80-49ed-be04-59771f71dd3f,network=Network(f07eb0b8-74da-402a-a601-68a72f85f931),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd218dc4e-de') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:30:12 user nova-compute[71229]: DEBUG os_vif [None req-4039d338-dd6e-459f-979b-dbf056c510ab tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:b6:f0,bridge_name='br-int',has_traffic_filtering=True,id=d218dc4e-de80-49ed-be04-59771f71dd3f,network=Network(f07eb0b8-74da-402a-a601-68a72f85f931),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd218dc4e-de') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:30:12 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:12 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:30:12 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:30:12 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:12 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd218dc4e-de, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:30:12 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd218dc4e-de, col_values=(('external_ids', {'iface-id': 'd218dc4e-de80-49ed-be04-59771f71dd3f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:b6:f0', 'vm-uuid': '1424f1ff-6c0f-4f9a-bddc-6c448a768a7a'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:30:12 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:12 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:30:12 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:12 user nova-compute[71229]: INFO os_vif [None req-4039d338-dd6e-459f-979b-dbf056c510ab tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:b6:f0,bridge_name='br-int',has_traffic_filtering=True,id=d218dc4e-de80-49ed-be04-59771f71dd3f,network=Network(f07eb0b8-74da-402a-a601-68a72f85f931),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd218dc4e-de')
Apr 11 15:30:12 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-4039d338-dd6e-459f-979b-dbf056c510ab tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T15:28:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-982441201',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-982441201',id=19,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQhnP1Gx1ErLuuEevJpV94XRpvcJAoAfxD6RZqXP7Kvn0H8XePF/x7sWzG5H5vtetd0gs+rS/bMxjK4Qz9b0uYhYgbQvD0DmjSlBMXC1CeKAiMrjjZNT7Keb43XJ65W+w==',key_name='tempest-keypair-1011126544',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:28:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='82dec4b679f24d1e85b1105b4849cddd',ramdisk_id='',reservation_id='r-izovbhtx',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-727930312',owner_user_name='tempest-TaggedAttachmentsTest-727930312-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:28:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f32986358bcc4148ad3f361e3944ed81',uuid=1424f1ff-6c0f-4f9a-bddc-6c448a768a7a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d218dc4e-de80-49ed-be04-59771f71dd3f", "address": "fa:16:3e:83:b6:f0", "network": {"id": "f07eb0b8-74da-402a-a601-68a72f85f931", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1723277263", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "82dec4b679f24d1e85b1105b4849cddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd218dc4e-de", "ovs_interfaceid": "d218dc4e-de80-49ed-be04-59771f71dd3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:30:12 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-4039d338-dd6e-459f-979b-dbf056c510ab tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Converting VIF {"id": "d218dc4e-de80-49ed-be04-59771f71dd3f", "address": "fa:16:3e:83:b6:f0", "network": {"id": "f07eb0b8-74da-402a-a601-68a72f85f931", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1723277263", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "82dec4b679f24d1e85b1105b4849cddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd218dc4e-de", "ovs_interfaceid": "d218dc4e-de80-49ed-be04-59771f71dd3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:30:12 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-4039d338-dd6e-459f-979b-dbf056c510ab tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:b6:f0,bridge_name='br-int',has_traffic_filtering=True,id=d218dc4e-de80-49ed-be04-59771f71dd3f,network=Network(f07eb0b8-74da-402a-a601-68a72f85f931),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd218dc4e-de') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:30:12 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-4039d338-dd6e-459f-979b-dbf056c510ab tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] attach device xml: <interface type="ethernet">
Apr 11 15:30:12 user nova-compute[71229]:   <mac address="fa:16:3e:83:b6:f0"/>
Apr 11 15:30:12 user nova-compute[71229]:   <model type="virtio"/>
Apr 11 15:30:12 user nova-compute[71229]:   <mtu size="1442"/>
Apr 11 15:30:12 user nova-compute[71229]:   <target dev="tapd218dc4e-de"/>
Apr 11 15:30:12 user nova-compute[71229]: </interface>
Apr 11 15:30:12 user nova-compute[71229]:  {{(pid=71229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 15:30:12 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:12 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:12 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:12 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-4039d338-dd6e-459f-979b-dbf056c510ab tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:30:12 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-4039d338-dd6e-459f-979b-dbf056c510ab tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] No BDM found with device name hda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:30:12 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-4039d338-dd6e-459f-979b-dbf056c510ab tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] No VIF found with MAC fa:16:3e:05:3e:4e, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:30:12 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-4039d338-dd6e-459f-979b-dbf056c510ab tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:30:12 user nova-compute[71229]:   <nova:package version="0.0.0"/>
Apr 11 15:30:12 user nova-compute[71229]:   <nova:name>tempest-device-tagging-server-982441201</nova:name>
Apr 11 15:30:12 user nova-compute[71229]:   <nova:creationTime>2023-04-11 15:30:12</nova:creationTime>
Apr 11 15:30:12 user nova-compute[71229]:   <nova:flavor name="m1.nano">
Apr 11 15:30:12 user nova-compute[71229]:     <nova:memory>128</nova:memory>
Apr 11 15:30:12 user nova-compute[71229]:     <nova:disk>1</nova:disk>
Apr 11 15:30:12 user nova-compute[71229]:     <nova:swap>0</nova:swap>
Apr 11 15:30:12 user nova-compute[71229]:     <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:30:12 user nova-compute[71229]:     <nova:vcpus>1</nova:vcpus>
Apr 11 15:30:12 user nova-compute[71229]:   </nova:flavor>
Apr 11 15:30:12 user nova-compute[71229]:   <nova:owner>
Apr 11 15:30:12 user nova-compute[71229]:     <nova:user uuid="f32986358bcc4148ad3f361e3944ed81">tempest-TaggedAttachmentsTest-727930312-project-member</nova:user>
Apr 11 15:30:12 user nova-compute[71229]:     <nova:project uuid="82dec4b679f24d1e85b1105b4849cddd">tempest-TaggedAttachmentsTest-727930312</nova:project>
Apr 11 15:30:12 user nova-compute[71229]:   </nova:owner>
Apr 11 15:30:12 user nova-compute[71229]:   <nova:root type="image" uuid="52fe638c-5ada-47d5-b376-233bfa808a37"/>
Apr 11 15:30:12 user nova-compute[71229]:   <nova:ports>
Apr 11 15:30:12 user nova-compute[71229]:     <nova:port uuid="40f1797d-278c-4676-8413-3b0c0f113dd9">
Apr 11 15:30:12 user nova-compute[71229]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 11 15:30:12 user nova-compute[71229]:     </nova:port>
Apr 11 15:30:12 user nova-compute[71229]:     <nova:port uuid="d218dc4e-de80-49ed-be04-59771f71dd3f">
Apr 11 15:30:12 user nova-compute[71229]:       <nova:ip type="fixed" address="10.10.10.162" ipVersion="4"/>
Apr 11 15:30:12 user nova-compute[71229]:     </nova:port>
Apr 11 15:30:12 user nova-compute[71229]:   </nova:ports>
Apr 11 15:30:12 user nova-compute[71229]: </nova:instance>
Apr 11 15:30:12 user nova-compute[71229]:  {{(pid=71229) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 11 15:30:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4039d338-dd6e-459f-979b-dbf056c510ab tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "interface-1424f1ff-6c0f-4f9a-bddc-6c448a768a7a-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.463s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:30:13 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:13 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:13 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:13 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:13 user nova-compute[71229]: DEBUG nova.network.neutron [req-7049d01f-aaa6-4b69-9c44-0bfb3cb4391e req-76d8d963-a30b-4509-9529-360cb0a4f0c2 service nova] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Updated VIF entry in instance network info cache for port d218dc4e-de80-49ed-be04-59771f71dd3f. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:30:13 user nova-compute[71229]: DEBUG nova.network.neutron [req-7049d01f-aaa6-4b69-9c44-0bfb3cb4391e req-76d8d963-a30b-4509-9529-360cb0a4f0c2 service nova] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Updating instance_info_cache with network_info: [{"id": "40f1797d-278c-4676-8413-3b0c0f113dd9", "address": "fa:16:3e:05:3e:4e", "network": {"id": "921b7e62-65aa-426c-9286-8b31b88588a8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1464327252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82dec4b679f24d1e85b1105b4849cddd", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40f1797d-27", "ovs_interfaceid": "40f1797d-278c-4676-8413-3b0c0f113dd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d218dc4e-de80-49ed-be04-59771f71dd3f", "address": "fa:16:3e:83:b6:f0", "network": {"id": "f07eb0b8-74da-402a-a601-68a72f85f931", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1723277263", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "82dec4b679f24d1e85b1105b4849cddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd218dc4e-de", "ovs_interfaceid": "d218dc4e-de80-49ed-be04-59771f71dd3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:30:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Acquiring lock "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:30:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:30:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-7049d01f-aaa6-4b69-9c44-0bfb3cb4391e req-76d8d963-a30b-4509-9529-360cb0a4f0c2 service nova] Releasing lock "refresh_cache-1424f1ff-6c0f-4f9a-bddc-6c448a768a7a" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:30:13 user nova-compute[71229]: DEBUG nova.objects.instance [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lazy-loading 'flavor' on Instance uuid 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:30:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:30:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Acquiring lock "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:30:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:30:13 user nova-compute[71229]: INFO nova.compute.manager [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Attaching volume 12415372-874e-4e85-8f69-e78ee88d4923 to /dev/vdb
Apr 11 15:30:13 user nova-compute[71229]: DEBUG os_brick.utils [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:30:13 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:13 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:13 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91013d5-95be-4efc-820b-f3b442f18937]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d55e24a97c90\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:13 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:13 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:13 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[424d2e1a-a050-44b2-b05b-ea94155591ab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:13 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:13 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:13 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be48c60-db40-4dae-a8a0-e86db24c1f1b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:13 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[406f4ae9-8170-4754-99d9-550c704221ca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:13 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Running cmd (subprocess): nvme version {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:13 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] 'nvme version' failed. Not Retrying. {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:30:13 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] nvme not present on system {{(pid=71229) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 15:30:13 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:13 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:30:13 user nova-compute[71229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 15:30:13 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[73dc5300-980f-40ff-822b-d7a3c1123237]: (4, '') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:13 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71229) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 15:30:13 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 15:30:13 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] LIGHTOS: no hostnqn found. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 15:30:13 user nova-compute[71229]: DEBUG os_brick.utils [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d55e24a97c90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:30:13 user nova-compute[71229]: DEBUG nova.virt.block_device [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Updating existing volume attachment record: ca21e9a3-fe4e-4a6f-b8ac-e186a8ed00c1 {{(pid=71229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 15:30:13 user nova-compute[71229]: DEBUG nova.compute.manager [req-6d5358dc-593b-4392-a679-c99bd1e9275a req-c0504f61-ecfe-4a45-a1f7-f67ea6749c40 service nova] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Received event network-vif-plugged-d218dc4e-de80-49ed-be04-59771f71dd3f {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:30:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-6d5358dc-593b-4392-a679-c99bd1e9275a req-c0504f61-ecfe-4a45-a1f7-f67ea6749c40 service nova] Acquiring lock "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:30:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-6d5358dc-593b-4392-a679-c99bd1e9275a req-c0504f61-ecfe-4a45-a1f7-f67ea6749c40 service nova] Lock "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:30:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-6d5358dc-593b-4392-a679-c99bd1e9275a req-c0504f61-ecfe-4a45-a1f7-f67ea6749c40 service nova] Lock "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:30:13 user nova-compute[71229]: DEBUG nova.compute.manager [req-6d5358dc-593b-4392-a679-c99bd1e9275a req-c0504f61-ecfe-4a45-a1f7-f67ea6749c40 service nova] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] No waiting events found dispatching network-vif-plugged-d218dc4e-de80-49ed-be04-59771f71dd3f {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:30:13 user nova-compute[71229]: WARNING nova.compute.manager [req-6d5358dc-593b-4392-a679-c99bd1e9275a req-c0504f61-ecfe-4a45-a1f7-f67ea6749c40 service nova] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Received unexpected event network-vif-plugged-d218dc4e-de80-49ed-be04-59771f71dd3f for instance with vm_state active and task_state None.
Apr 11 15:30:13 user nova-compute[71229]: DEBUG nova.compute.manager [req-6d5358dc-593b-4392-a679-c99bd1e9275a req-c0504f61-ecfe-4a45-a1f7-f67ea6749c40 service nova] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Received event network-vif-plugged-d218dc4e-de80-49ed-be04-59771f71dd3f {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:30:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-6d5358dc-593b-4392-a679-c99bd1e9275a req-c0504f61-ecfe-4a45-a1f7-f67ea6749c40 service nova] Acquiring lock "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:30:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-6d5358dc-593b-4392-a679-c99bd1e9275a req-c0504f61-ecfe-4a45-a1f7-f67ea6749c40 service nova] Lock "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:30:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-6d5358dc-593b-4392-a679-c99bd1e9275a req-c0504f61-ecfe-4a45-a1f7-f67ea6749c40 service nova] Lock "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:30:13 user nova-compute[71229]: DEBUG nova.compute.manager [req-6d5358dc-593b-4392-a679-c99bd1e9275a req-c0504f61-ecfe-4a45-a1f7-f67ea6749c40 service nova] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] No waiting events found dispatching network-vif-plugged-d218dc4e-de80-49ed-be04-59771f71dd3f {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:30:13 user nova-compute[71229]: WARNING nova.compute.manager [req-6d5358dc-593b-4392-a679-c99bd1e9275a req-c0504f61-ecfe-4a45-a1f7-f67ea6749c40 service nova] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Received unexpected event network-vif-plugged-d218dc4e-de80-49ed-be04-59771f71dd3f for instance with vm_state active and task_state None.
Apr 11 15:30:16 user nova-compute[71229]: DEBUG nova.compute.manager [req-aee6ebe1-78ca-4fd8-9c43-749a9eac06b8 req-9a8cbee0-e032-43c2-b28b-28777c37b46d service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Received event network-changed-21d628ba-6bae-4d98-94df-bb6fbb4f1c24 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:30:16 user nova-compute[71229]: DEBUG nova.compute.manager [req-aee6ebe1-78ca-4fd8-9c43-749a9eac06b8 req-9a8cbee0-e032-43c2-b28b-28777c37b46d service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Refreshing instance network info cache due to event network-changed-21d628ba-6bae-4d98-94df-bb6fbb4f1c24. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:30:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-aee6ebe1-78ca-4fd8-9c43-749a9eac06b8 req-9a8cbee0-e032-43c2-b28b-28777c37b46d service nova] Acquiring lock "refresh_cache-39e3dfb1-bc09-474d-b8cb-f01b11923eae" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:30:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-aee6ebe1-78ca-4fd8-9c43-749a9eac06b8 req-9a8cbee0-e032-43c2-b28b-28777c37b46d service nova] Acquired lock "refresh_cache-39e3dfb1-bc09-474d-b8cb-f01b11923eae" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:30:16 user nova-compute[71229]: DEBUG nova.network.neutron [req-aee6ebe1-78ca-4fd8-9c43-749a9eac06b8 req-9a8cbee0-e032-43c2-b28b-28777c37b46d service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Refreshing network info cache for port 21d628ba-6bae-4d98-94df-bb6fbb4f1c24 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:30:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Acquiring lock "39e3dfb1-bc09-474d-b8cb-f01b11923eae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:30:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "39e3dfb1-bc09-474d-b8cb-f01b11923eae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:30:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Acquiring lock "39e3dfb1-bc09-474d-b8cb-f01b11923eae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:30:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "39e3dfb1-bc09-474d-b8cb-f01b11923eae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:30:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "39e3dfb1-bc09-474d-b8cb-f01b11923eae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:30:16 user nova-compute[71229]: INFO nova.compute.manager [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Terminating instance
Apr 11 15:30:16 user nova-compute[71229]: DEBUG nova.compute.manager [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Start destroying the instance on the hypervisor. {{(pid=71229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 15:30:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:16 user nova-compute[71229]: DEBUG nova.compute.manager [req-bb4dd83e-4d18-498e-b6b3-56d5b068a43d req-d8ec68d6-0183-4e7f-9bab-7153fa3dd5df service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Received event network-vif-unplugged-21d628ba-6bae-4d98-94df-bb6fbb4f1c24 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:30:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-bb4dd83e-4d18-498e-b6b3-56d5b068a43d req-d8ec68d6-0183-4e7f-9bab-7153fa3dd5df service nova] Acquiring lock "39e3dfb1-bc09-474d-b8cb-f01b11923eae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:30:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-bb4dd83e-4d18-498e-b6b3-56d5b068a43d req-d8ec68d6-0183-4e7f-9bab-7153fa3dd5df service nova] Lock "39e3dfb1-bc09-474d-b8cb-f01b11923eae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:30:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-bb4dd83e-4d18-498e-b6b3-56d5b068a43d req-d8ec68d6-0183-4e7f-9bab-7153fa3dd5df service nova] Lock "39e3dfb1-bc09-474d-b8cb-f01b11923eae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:30:16 user nova-compute[71229]: DEBUG nova.compute.manager [req-bb4dd83e-4d18-498e-b6b3-56d5b068a43d req-d8ec68d6-0183-4e7f-9bab-7153fa3dd5df service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] No waiting events found dispatching network-vif-unplugged-21d628ba-6bae-4d98-94df-bb6fbb4f1c24 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:30:16 user nova-compute[71229]: DEBUG nova.compute.manager [req-bb4dd83e-4d18-498e-b6b3-56d5b068a43d req-d8ec68d6-0183-4e7f-9bab-7153fa3dd5df service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Received event network-vif-unplugged-21d628ba-6bae-4d98-94df-bb6fbb4f1c24 for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 15:30:16 user nova-compute[71229]: DEBUG nova.network.neutron [req-aee6ebe1-78ca-4fd8-9c43-749a9eac06b8 req-9a8cbee0-e032-43c2-b28b-28777c37b46d service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Updated VIF entry in instance network info cache for port 21d628ba-6bae-4d98-94df-bb6fbb4f1c24. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:30:16 user nova-compute[71229]: DEBUG nova.network.neutron [req-aee6ebe1-78ca-4fd8-9c43-749a9eac06b8 req-9a8cbee0-e032-43c2-b28b-28777c37b46d service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Updating instance_info_cache with network_info: [{"id": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24", "address": "fa:16:3e:97:55:b0", "network": {"id": "75a41a6a-1c7b-47b0-907e-2015d56f554e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1001895705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ed867a40534b70bf75dc0cc28fdfec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d628ba-6b", "ovs_interfaceid": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:30:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-aee6ebe1-78ca-4fd8-9c43-749a9eac06b8 req-9a8cbee0-e032-43c2-b28b-28777c37b46d service nova] Releasing lock "refresh_cache-39e3dfb1-bc09-474d-b8cb-f01b11923eae" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:30:17 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Instance destroyed successfully.
Apr 11 15:30:17 user nova-compute[71229]: DEBUG nova.objects.instance [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lazy-loading 'resources' on Instance uuid 39e3dfb1-bc09-474d-b8cb-f01b11923eae {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T15:24:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2037395852',display_name='tempest-TestShelveInstance-server-2037395852',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2037395852',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4WD1C8T6tkUEgT5nSc1MsqRgkLNzQRS7RjsK+eCmfdmidOraNTmKvDvSPnsYiAjMuo6nku/oKvPzyy026kIaVTiO+J+8OfPbwUqPSj0x0wpOl+Z+4f+Lo5uETYRrAumQ==',key_name='tempest-TestShelveInstance-1630475072',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:28:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63ed867a40534b70bf75dc0cc28fdfec',ramdisk_id='',reservation_id='r-vsdu64f3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-602339736',owner_user_name='tempest-TestShelveInstance-602339736-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:28:38Z,user_data=None,user_id='49e1716b2bb2438b93d46dc8052c788b',uuid=39e3dfb1-bc09-474d-b8cb-f01b11923eae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24", "address": "fa:16:3e:97:55:b0", "network": {"id": "75a41a6a-1c7b-47b0-907e-2015d56f554e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1001895705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ed867a40534b70bf75dc0cc28fdfec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d628ba-6b", "ovs_interfaceid": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Converting VIF {"id": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24", "address": "fa:16:3e:97:55:b0", "network": {"id": "75a41a6a-1c7b-47b0-907e-2015d56f554e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1001895705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ed867a40534b70bf75dc0cc28fdfec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d628ba-6b", "ovs_interfaceid": "21d628ba-6bae-4d98-94df-bb6fbb4f1c24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:55:b0,bridge_name='br-int',has_traffic_filtering=True,id=21d628ba-6bae-4d98-94df-bb6fbb4f1c24,network=Network(75a41a6a-1c7b-47b0-907e-2015d56f554e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21d628ba-6b') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG os_vif [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:55:b0,bridge_name='br-int',has_traffic_filtering=True,id=21d628ba-6bae-4d98-94df-bb6fbb4f1c24,network=Network(75a41a6a-1c7b-47b0-907e-2015d56f554e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21d628ba-6b') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21d628ba-6b, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:17 user nova-compute[71229]: INFO os_vif [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:55:b0,bridge_name='br-int',has_traffic_filtering=True,id=21d628ba-6bae-4d98-94df-bb6fbb4f1c24,network=Network(75a41a6a-1c7b-47b0-907e-2015d56f554e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21d628ba-6b')
Apr 11 15:30:17 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rEkFuIDz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:30:17 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:30:17 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0fc3f1-5390-41af-a025-55965f99a964]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 15:30:17 user nova-compute[71229]: No targets found.
Apr 11 15:30:17 user nova-compute[71229]: iSNS:
Apr 11 15:30:17 user nova-compute[71229]: No targets found.
Apr 11 15:30:17 user nova-compute[71229]: STATIC:
Apr 11 15:30:17 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb
Apr 11 15:30:17 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:30:17 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:30:17 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2
Apr 11 15:30:17 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:30:17 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:30:17 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7
Apr 11 15:30:17 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:30:17 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:30:17 user nova-compute[71229]: FIRMWARE:
Apr 11 15:30:17 user nova-compute[71229]: No targets found.
Apr 11 15:30:17 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 15:30:17 user nova-compute[71229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 15:30:17 user nova-compute[71229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71229) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7', 0)] {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ec1d97-62ab-49d0-b148-8d03ba686a50]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b80fc0-3baa-4cc3-88f4-601b1d0427c4]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:30:17 user nova-compute[71229]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)
Apr 11 15:30:17 user nova-compute[71229]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:30:17 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:30:17 user nova-compute[71229]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 (non-flash)
Apr 11 15:30:17 user nova-compute[71229]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:30:17 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb5c192b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7'): ({'sdd'}, set())}) {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Removing single pathed devices sdd {{(pid=71229) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ffc5094-fb33-49fb-ab52-c21cbb83566f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4220d88-20a1-47fb-a659-f61d1a4e6b7e]: (4, ('ok\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Flushing IO for device /dev/sdd {{(pid=71229) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e99948f-cf31-4eb9-9ae4-948a6161b321]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71229) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f695afb-dff1-4824-a4ef-ff8c88a9ac03]: (4, ('1', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] SCSI volumes sdd have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26434303966343363', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_5398496d', '/dev/disk/by-id/scsi-1SCST_BIO5398496d-d409f43c5a9795da') {{(pid=81310) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8668163f-8b1f-45c0-9be8-dcddf11c3323]: (4, None) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7')] {{(pid=71229) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[aedd8344-1dca-4e70-8766-179d5c733e53]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 -p 172.16.0.220:3260 --logout {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f1d290-6862-4565-8c45-443651af419a]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7, portal: 172.16.0.220,3260]
Apr 11 15:30:17 user nova-compute[71229]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7, portal: 172.16.0.220,3260] successful.
Apr 11 15:30:17 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 -p 172.16.0.220:3260 --op delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3132ad02-1f63-469b-b802-d814466b9ad7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5f962f-0603-4360-b9eb-fae8ad422a06]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] <== disconnect_volume: return (331ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 15:30:17 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Deleting instance files /opt/stack/data/nova/instances/39e3dfb1-bc09-474d-b8cb-f01b11923eae_del
Apr 11 15:30:17 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Deletion of /opt/stack/data/nova/instances/39e3dfb1-bc09-474d-b8cb-f01b11923eae_del complete
Apr 11 15:30:17 user nova-compute[71229]: INFO nova.compute.manager [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Took 1.22 seconds to destroy the instance on the hypervisor.
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo.service.loopingcall [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71229) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG nova.compute.manager [-] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Deallocating network for instance {{(pid=71229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] deallocate_for_instance() {{(pid=71229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:12415372-874e-4e85-8f69-e78ee88d4923', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RvXkWQiS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:30:17 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:30:17 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:30:17 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:30:17 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12415372-874e-4e85-8f69-e78ee88d4923" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12415372-874e-4e85-8f69-e78ee88d4923" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:30:17 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12415372-874e-4e85-8f69-e78ee88d4923 -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12415372-874e-4e85-8f69-e78ee88d4923 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6891b2e-d67d-4a2a-8f97-7d0ecf1ab366]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 15:30:17 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12415372-874e-4e85-8f69-e78ee88d4923 -p 172.16.0.220:3260 --interface default --op new {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12415372-874e-4e85-8f69-e78ee88d4923 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf0e924-5819-41e3-b134-af73f569eaeb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12415372-874e-4e85-8f69-e78ee88d4923] added\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12415372-874e-4e85-8f69-e78ee88d4923] added
Apr 11 15:30:17 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12415372-874e-4e85-8f69-e78ee88d4923 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12415372-874e-4e85-8f69-e78ee88d4923 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c19db7-afa2-43f7-9f85-630a4f8ca1ea]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12415372-874e-4e85-8f69-e78ee88d4923 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12415372-874e-4e85-8f69-e78ee88d4923 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d9665c-3356-4d8e-8c27-e25e66063717]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12415372-874e-4e85-8f69-e78ee88d4923 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RvXkWQiS {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12415372-874e-4e85-8f69-e78ee88d4923 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RvXkWQiS" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0045ee83-3281-44f5-98c1-6fef98aaed4d]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RvXkWQiS'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12415372-874e-4e85-8f69-e78ee88d4923 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12415372-874e-4e85-8f69-e78ee88d4923 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[218182ef-e2ba-4c8c-8437-5e9db1b156a5]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d5b21f-097f-447b-84d7-d28429da5ea4]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:30:17 user nova-compute[71229]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:30:17 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:30:17 user nova-compute[71229]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:30:17 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:30:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12415372-874e-4e85-8f69-e78ee88d4923 -p 172.16.0.220:3260 --login {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12415372-874e-4e85-8f69-e78ee88d4923 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:18 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7a930a-8252-46b8-b5ea-986e33ec769a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:12415372-874e-4e85-8f69-e78ee88d4923, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:12415372-874e-4e85-8f69-e78ee88d4923, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:18 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:12415372-874e-4e85-8f69-e78ee88d4923, portal: 172.16.0.220,3260]
Apr 11 15:30:18 user nova-compute[71229]: Login to [iface: default, target: iqn.2010-10.org.openstack:12415372-874e-4e85-8f69-e78ee88d4923, portal: 172.16.0.220,3260] successful.
Apr 11 15:30:18 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:30:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12415372-874e-4e85-8f69-e78ee88d4923 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12415372-874e-4e85-8f69-e78ee88d4923 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:18 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[173899ac-3f47-4a89-9d1d-a11bc35ecdd0]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:18 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:30:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:18 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c583b2-9910-414b-98fe-06e691275ec2]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12415372-874e-4e85-8f69-e78ee88d4923 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:18 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:30:18 user nova-compute[71229]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:30:18 user nova-compute[71229]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12415372-874e-4e85-8f69-e78ee88d4923 (non-flash)
Apr 11 15:30:18 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:30:18 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:30:18 user nova-compute[71229]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:30:18 user nova-compute[71229]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12415372-874e-4e85-8f69-e78ee88d4923 (non-flash)
Apr 11 15:30:18 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:30:18 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12415372-874e-4e85-8f69-e78ee88d4923" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:30:18 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 15:30:18 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] HCTL ('35', '-', '-', 0) found on session 22 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 15:30:18 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 15:30:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:18 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[60acc5ac-1e9a-4b9f-94b4-f4003b2e983b]: (4, ('- - 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:18 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:30:18 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:12415372-874e-4e85-8f69-e78ee88d4923', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RvXkWQiS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 15:30:18 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:30:18 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Took 0.59 seconds to deallocate network for instance.
Apr 11 15:30:18 user nova-compute[71229]: DEBUG nova.compute.manager [req-036c1593-9f48-48c8-8441-8e65c589447d req-2a4355b6-0675-42ae-98bd-68857d01d36d service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Received event network-vif-deleted-21d628ba-6bae-4d98-94df-bb6fbb4f1c24 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:30:18 user nova-compute[71229]: INFO nova.compute.manager [req-036c1593-9f48-48c8-8441-8e65c589447d req-2a4355b6-0675-42ae-98bd-68857d01d36d service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Neutron deleted interface 21d628ba-6bae-4d98-94df-bb6fbb4f1c24; detaching it from the instance and deleting it from the info cache
Apr 11 15:30:18 user nova-compute[71229]: DEBUG nova.network.neutron [req-036c1593-9f48-48c8-8441-8e65c589447d req-2a4355b6-0675-42ae-98bd-68857d01d36d service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:30:18 user nova-compute[71229]: DEBUG nova.compute.manager [req-036c1593-9f48-48c8-8441-8e65c589447d req-2a4355b6-0675-42ae-98bd-68857d01d36d service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Detach interface failed, port_id=21d628ba-6bae-4d98-94df-bb6fbb4f1c24, reason: Instance 39e3dfb1-bc09-474d-b8cb-f01b11923eae could not be found. {{(pid=71229) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 15:30:18 user nova-compute[71229]: DEBUG nova.compute.manager [req-42badac3-e057-4fe4-984c-452f66b21ce8 req-c78e9c51-e083-488d-9920-b96bfde972da service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Received event network-vif-plugged-21d628ba-6bae-4d98-94df-bb6fbb4f1c24 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:30:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-42badac3-e057-4fe4-984c-452f66b21ce8 req-c78e9c51-e083-488d-9920-b96bfde972da service nova] Acquiring lock "39e3dfb1-bc09-474d-b8cb-f01b11923eae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:30:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-42badac3-e057-4fe4-984c-452f66b21ce8 req-c78e9c51-e083-488d-9920-b96bfde972da service nova] Lock "39e3dfb1-bc09-474d-b8cb-f01b11923eae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:30:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-42badac3-e057-4fe4-984c-452f66b21ce8 req-c78e9c51-e083-488d-9920-b96bfde972da service nova] Lock "39e3dfb1-bc09-474d-b8cb-f01b11923eae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:30:18 user nova-compute[71229]: DEBUG nova.compute.manager [req-42badac3-e057-4fe4-984c-452f66b21ce8 req-c78e9c51-e083-488d-9920-b96bfde972da service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] No waiting events found dispatching network-vif-plugged-21d628ba-6bae-4d98-94df-bb6fbb4f1c24 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:30:18 user nova-compute[71229]: WARNING nova.compute.manager [req-42badac3-e057-4fe4-984c-452f66b21ce8 req-c78e9c51-e083-488d-9920-b96bfde972da service nova] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Received unexpected event network-vif-plugged-21d628ba-6bae-4d98-94df-bb6fbb4f1c24 for instance with vm_state active and task_state deleting.
Apr 11 15:30:18 user nova-compute[71229]: INFO nova.compute.manager [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Took 0.81 seconds to detach 1 volumes for instance.
Apr 11 15:30:18 user nova-compute[71229]: DEBUG nova.compute.manager [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Deleting volume: 3132ad02-1f63-469b-b802-d814466b9ad7 {{(pid=71229) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 11 15:30:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:30:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:30:19 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:30:19 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23431366234626266', 'path': '/dev/sdd'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:30:19 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431366234626266', 'path': '/dev/sdd'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 15:30:19 user nova-compute[71229]: DEBUG nova.objects.instance [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lazy-loading 'flavor' on Instance uuid 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:30:19 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 15:30:19 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:30:19 user nova-compute[71229]:   <source dev="/dev/sdd"/>
Apr 11 15:30:19 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 15:30:19 user nova-compute[71229]:   <serial>12415372-874e-4e85-8f69-e78ee88d4923</serial>
Apr 11 15:30:19 user nova-compute[71229]: </disk>
Apr 11 15:30:19 user nova-compute[71229]:  {{(pid=71229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 15:30:19 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:30:19 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:30:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.355s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:30:19 user nova-compute[71229]: INFO nova.scheduler.client.report [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Deleted allocations for instance 39e3dfb1-bc09-474d-b8cb-f01b11923eae
Apr 11 15:30:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-eca53c13-6cd6-496f-a789-20ed2052dfa8 tempest-TestShelveInstance-602339736 tempest-TestShelveInstance-602339736-project-member] Lock "39e3dfb1-bc09-474d-b8cb-f01b11923eae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.286s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:30:19 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:30:19 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] No BDM found with device name hda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:30:19 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] No VIF found with MAC fa:16:3e:05:3e:4e, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:30:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-369c947d-b936-4872-bf0d-556756b359ad tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.291s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:30:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-507c7fa3-877d-4734-817d-2a544da787fd tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Acquiring lock "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:30:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-507c7fa3-877d-4734-817d-2a544da787fd tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:30:20 user nova-compute[71229]: INFO nova.compute.manager [None req-507c7fa3-877d-4734-817d-2a544da787fd tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Detaching volume 12415372-874e-4e85-8f69-e78ee88d4923
Apr 11 15:30:20 user nova-compute[71229]: INFO nova.virt.block_device [None req-507c7fa3-877d-4734-817d-2a544da787fd tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Attempting to driver detach volume 12415372-874e-4e85-8f69-e78ee88d4923 from mountpoint /dev/vdb
Apr 11 15:30:20 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-507c7fa3-877d-4734-817d-2a544da787fd tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Attempting to detach device vdb from instance 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a from the persistent domain config. {{(pid=71229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 15:30:20 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-507c7fa3-877d-4734-817d-2a544da787fd tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 15:30:20 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:30:20 user nova-compute[71229]:   <source dev="/dev/sdd"/>
Apr 11 15:30:20 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 15:30:20 user nova-compute[71229]:   <serial>12415372-874e-4e85-8f69-e78ee88d4923</serial>
Apr 11 15:30:20 user nova-compute[71229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 11 15:30:20 user nova-compute[71229]: </disk>
Apr 11 15:30:20 user nova-compute[71229]:  {{(pid=71229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 15:30:20 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-507c7fa3-877d-4734-817d-2a544da787fd tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Successfully detached device vdb from instance 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a from the persistent domain config.
Apr 11 15:30:20 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-507c7fa3-877d-4734-817d-2a544da787fd tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a from the live domain config. {{(pid=71229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 15:30:20 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-507c7fa3-877d-4734-817d-2a544da787fd tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 15:30:20 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:30:20 user nova-compute[71229]:   <source dev="/dev/sdd"/>
Apr 11 15:30:20 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 15:30:20 user nova-compute[71229]:   <serial>12415372-874e-4e85-8f69-e78ee88d4923</serial>
Apr 11 15:30:20 user nova-compute[71229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 11 15:30:20 user nova-compute[71229]: </disk>
Apr 11 15:30:20 user nova-compute[71229]:  {{(pid=71229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Received event <DeviceRemovedEvent: 1681227021.0621665, 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71229) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-507c7fa3-877d-4734-817d-2a544da787fd tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a {{(pid=71229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 15:30:21 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-507c7fa3-877d-4734-817d-2a544da787fd tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Successfully detached device vdb from instance 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a from the live domain config.
Apr 11 15:30:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-507c7fa3-877d-4734-817d-2a544da787fd tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-507c7fa3-877d-4734-817d-2a544da787fd tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:12415372-874e-4e85-8f69-e78ee88d4923', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RvXkWQiS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:30:21 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-507c7fa3-877d-4734-817d-2a544da787fd tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:30:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-507c7fa3-877d-4734-817d-2a544da787fd tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-507c7fa3-877d-4734-817d-2a544da787fd tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7034a20-728a-43c9-941c-2a5e5c34fc18]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12415372-874e-4e85-8f69-e78ee88d4923\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-507c7fa3-877d-4734-817d-2a544da787fd tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 15:30:21 user nova-compute[71229]: No targets found.
Apr 11 15:30:21 user nova-compute[71229]: iSNS:
Apr 11 15:30:21 user nova-compute[71229]: No targets found.
Apr 11 15:30:21 user nova-compute[71229]: STATIC:
Apr 11 15:30:21 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb
Apr 11 15:30:21 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:30:21 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:30:21 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:12415372-874e-4e85-8f69-e78ee88d4923
Apr 11 15:30:21 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:30:21 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:30:21 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2
Apr 11 15:30:21 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:30:21 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:30:21 user nova-compute[71229]: FIRMWARE:
Apr 11 15:30:21 user nova-compute[71229]: No targets found.
Apr 11 15:30:21 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-507c7fa3-877d-4734-817d-2a544da787fd tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 15:30:21 user nova-compute[71229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 15:30:21 user nova-compute[71229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71229) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-507c7fa3-877d-4734-817d-2a544da787fd tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12415372-874e-4e85-8f69-e78ee88d4923', 0)] {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c423b41a-c096-4115-93bc-ca641353ebe1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12415372-874e-4e85-8f69-e78ee88d4923\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5173a9-fbdf-4665-8ae0-374a1f86cbd4]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12415372-874e-4e85-8f69-e78ee88d4923 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-507c7fa3-877d-4734-817d-2a544da787fd tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:30:21 user nova-compute[71229]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:30:21 user nova-compute[71229]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12415372-874e-4e85-8f69-e78ee88d4923 (non-flash)
Apr 11 15:30:21 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-507c7fa3-877d-4734-817d-2a544da787fd tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:30:21 user nova-compute[71229]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:30:21 user nova-compute[71229]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12415372-874e-4e85-8f69-e78ee88d4923 (non-flash)
Apr 11 15:30:21 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-507c7fa3-877d-4734-817d-2a544da787fd tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb643a16c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12415372-874e-4e85-8f69-e78ee88d4923'): ({'sdd'}, set())}) {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-507c7fa3-877d-4734-817d-2a544da787fd tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Removing single pathed devices sdd {{(pid=71229) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81ccb29-dfbd-4976-bec2-ca386535ce0d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e62dd0-b71d-4bb1-9443-d7f2bf9d0982]: (4, ('ok\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-507c7fa3-877d-4734-817d-2a544da787fd tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Flushing IO for device /dev/sdd {{(pid=71229) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[599d33da-48ea-496e-80f4-6a62cc27a74a]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-507c7fa3-877d-4734-817d-2a544da787fd tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71229) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.058s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[621ec6a3-f85c-4438-8818-ce0cd68233e9]: (4, ('1', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-507c7fa3-877d-4734-817d-2a544da787fd tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-507c7fa3-877d-4734-817d-2a544da787fd tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] SCSI volumes sdd have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-507c7fa3-877d-4734-817d-2a544da787fd tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12415372-874e-4e85-8f69-e78ee88d4923')] {{(pid=71229) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12415372-874e-4e85-8f69-e78ee88d4923 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12415372-874e-4e85-8f69-e78ee88d4923 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03687e7-f3af-42d0-9cb7-564057f5bb5b]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-507c7fa3-877d-4734-817d-2a544da787fd tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12415372-874e-4e85-8f69-e78ee88d4923 -p 172.16.0.220:3260 --logout {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12415372-874e-4e85-8f69-e78ee88d4923 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d4a312-ff86-43fc-be07-be4d7cb5acfb]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:12415372-874e-4e85-8f69-e78ee88d4923, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:12415372-874e-4e85-8f69-e78ee88d4923, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-507c7fa3-877d-4734-817d-2a544da787fd tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:12415372-874e-4e85-8f69-e78ee88d4923, portal: 172.16.0.220,3260]
Apr 11 15:30:21 user nova-compute[71229]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:12415372-874e-4e85-8f69-e78ee88d4923, portal: 172.16.0.220,3260] successful.
Apr 11 15:30:21 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12415372-874e-4e85-8f69-e78ee88d4923 -p 172.16.0.220:3260 --op delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12415372-874e-4e85-8f69-e78ee88d4923 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a899ca2e-286f-4b2d-a6a7-51df257a08ce]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-507c7fa3-877d-4734-817d-2a544da787fd tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-507c7fa3-877d-4734-817d-2a544da787fd tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-507c7fa3-877d-4734-817d-2a544da787fd tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] <== disconnect_volume: return (345ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-507c7fa3-877d-4734-817d-2a544da787fd tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 15:30:21 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:22 user nova-compute[71229]: DEBUG nova.objects.instance [None req-507c7fa3-877d-4734-817d-2a544da787fd tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lazy-loading 'flavor' on Instance uuid 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:30:22 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-507c7fa3-877d-4734-817d-2a544da787fd tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.838s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:30:22 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-31d8da70-ae46-4555-bbe8-c514df73e54d tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Acquiring lock "interface-1424f1ff-6c0f-4f9a-bddc-6c448a768a7a-d218dc4e-de80-49ed-be04-59771f71dd3f" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:30:22 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-31d8da70-ae46-4555-bbe8-c514df73e54d tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "interface-1424f1ff-6c0f-4f9a-bddc-6c448a768a7a-d218dc4e-de80-49ed-be04-59771f71dd3f" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:30:22 user nova-compute[71229]: DEBUG nova.objects.instance [None req-31d8da70-ae46-4555-bbe8-c514df73e54d tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lazy-loading 'flavor' on Instance uuid 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:30:22 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-31d8da70-ae46-4555-bbe8-c514df73e54d tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T15:28:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-982441201',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-982441201',id=19,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQhnP1Gx1ErLuuEevJpV94XRpvcJAoAfxD6RZqXP7Kvn0H8XePF/x7sWzG5H5vtetd0gs+rS/bMxjK4Qz9b0uYhYgbQvD0DmjSlBMXC1CeKAiMrjjZNT7Keb43XJ65W+w==',key_name='tempest-keypair-1011126544',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:28:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='82dec4b679f24d1e85b1105b4849cddd',ramdisk_id='',reservation_id='r-izovbhtx',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-727930312',owner_user_name='tempest-TaggedAttachmentsTest-727930312-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:28:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f32986358bcc4148ad3f361e3944ed81',uuid=1424f1ff-6c0f-4f9a-bddc-6c448a768a7a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d218dc4e-de80-49ed-be04-59771f71dd3f", "address": "fa:16:3e:83:b6:f0", "network": {"id": "f07eb0b8-74da-402a-a601-68a72f85f931", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1723277263", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "82dec4b679f24d1e85b1105b4849cddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd218dc4e-de", "ovs_interfaceid": "d218dc4e-de80-49ed-be04-59771f71dd3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:30:22 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-31d8da70-ae46-4555-bbe8-c514df73e54d tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Converting VIF {"id": "d218dc4e-de80-49ed-be04-59771f71dd3f", "address": "fa:16:3e:83:b6:f0", "network": {"id": "f07eb0b8-74da-402a-a601-68a72f85f931", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1723277263", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "82dec4b679f24d1e85b1105b4849cddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd218dc4e-de", "ovs_interfaceid": "d218dc4e-de80-49ed-be04-59771f71dd3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:30:22 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-31d8da70-ae46-4555-bbe8-c514df73e54d tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:b6:f0,bridge_name='br-int',has_traffic_filtering=True,id=d218dc4e-de80-49ed-be04-59771f71dd3f,network=Network(f07eb0b8-74da-402a-a601-68a72f85f931),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd218dc4e-de') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:30:22 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-31d8da70-ae46-4555-bbe8-c514df73e54d tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:83:b6:f0"/><model type="virtio"/><mtu size="1442"/><target dev="tapd218dc4e-de"/></interface> {{(pid=71229) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 11 15:30:22 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-31d8da70-ae46-4555-bbe8-c514df73e54d tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:83:b6:f0"/><model type="virtio"/><mtu size="1442"/><target dev="tapd218dc4e-de"/></interface> {{(pid=71229) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 11 15:30:22 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-31d8da70-ae46-4555-bbe8-c514df73e54d tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Attempting to detach device tapd218dc4e-de from instance 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a from the persistent domain config. {{(pid=71229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 15:30:22 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-31d8da70-ae46-4555-bbe8-c514df73e54d tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] detach device xml: <interface type="ethernet">
Apr 11 15:30:22 user nova-compute[71229]:   <mac address="fa:16:3e:83:b6:f0"/>
Apr 11 15:30:22 user nova-compute[71229]:   <model type="virtio"/>
Apr 11 15:30:22 user nova-compute[71229]:   <mtu size="1442"/>
Apr 11 15:30:22 user nova-compute[71229]:   <target dev="tapd218dc4e-de"/>
Apr 11 15:30:22 user nova-compute[71229]: </interface>
Apr 11 15:30:22 user nova-compute[71229]:  {{(pid=71229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 15:30:22 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-31d8da70-ae46-4555-bbe8-c514df73e54d tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:83:b6:f0"/><model type="virtio"/><mtu size="1442"/><target dev="tapd218dc4e-de"/></interface> {{(pid=71229) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 11 15:30:22 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-31d8da70-ae46-4555-bbe8-c514df73e54d tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:83:b6:f0"/><model type="virtio"/><mtu size="1442"/><target dev="tapd218dc4e-de"/></interface>not found in domain: <domain type='kvm' id='23'>
Apr 11 15:30:22 user nova-compute[71229]:   <name>instance-00000013</name>
Apr 11 15:30:22 user nova-compute[71229]:   <uuid>1424f1ff-6c0f-4f9a-bddc-6c448a768a7a</uuid>
Apr 11 15:30:22 user nova-compute[71229]:   <metadata>
Apr 11 15:30:22 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:30:22 user nova-compute[71229]:   <nova:package version="0.0.0"/>
Apr 11 15:30:22 user nova-compute[71229]:   <nova:name>tempest-device-tagging-server-982441201</nova:name>
Apr 11 15:30:22 user nova-compute[71229]:   <nova:creationTime>2023-04-11 15:30:12</nova:creationTime>
Apr 11 15:30:22 user nova-compute[71229]:   <nova:flavor name="m1.nano">
Apr 11 15:30:22 user nova-compute[71229]:     <nova:memory>128</nova:memory>
Apr 11 15:30:22 user nova-compute[71229]:     <nova:disk>1</nova:disk>
Apr 11 15:30:22 user nova-compute[71229]:     <nova:swap>0</nova:swap>
Apr 11 15:30:22 user nova-compute[71229]:     <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:30:22 user nova-compute[71229]:     <nova:vcpus>1</nova:vcpus>
Apr 11 15:30:22 user nova-compute[71229]:   </nova:flavor>
Apr 11 15:30:22 user nova-compute[71229]:   <nova:owner>
Apr 11 15:30:22 user nova-compute[71229]:     <nova:user uuid="f32986358bcc4148ad3f361e3944ed81">tempest-TaggedAttachmentsTest-727930312-project-member</nova:user>
Apr 11 15:30:22 user nova-compute[71229]:     <nova:project uuid="82dec4b679f24d1e85b1105b4849cddd">tempest-TaggedAttachmentsTest-727930312</nova:project>
Apr 11 15:30:22 user nova-compute[71229]:   </nova:owner>
Apr 11 15:30:22 user nova-compute[71229]:   <nova:root type="image" uuid="52fe638c-5ada-47d5-b376-233bfa808a37"/>
Apr 11 15:30:22 user nova-compute[71229]:   <nova:ports>
Apr 11 15:30:22 user nova-compute[71229]:     <nova:port uuid="40f1797d-278c-4676-8413-3b0c0f113dd9">
Apr 11 15:30:22 user nova-compute[71229]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 11 15:30:22 user nova-compute[71229]:     </nova:port>
Apr 11 15:30:22 user nova-compute[71229]:     <nova:port uuid="d218dc4e-de80-49ed-be04-59771f71dd3f">
Apr 11 15:30:22 user nova-compute[71229]:       <nova:ip type="fixed" address="10.10.10.162" ipVersion="4"/>
Apr 11 15:30:22 user nova-compute[71229]:     </nova:port>
Apr 11 15:30:22 user nova-compute[71229]:   </nova:ports>
Apr 11 15:30:22 user nova-compute[71229]: </nova:instance>
Apr 11 15:30:22 user nova-compute[71229]:   </metadata>
Apr 11 15:30:22 user nova-compute[71229]:   <memory unit='KiB'>131072</memory>
Apr 11 15:30:22 user nova-compute[71229]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 11 15:30:22 user nova-compute[71229]:   <vcpu placement='static'>1</vcpu>
Apr 11 15:30:22 user nova-compute[71229]:   <resource>
Apr 11 15:30:22 user nova-compute[71229]:     <partition>/machine</partition>
Apr 11 15:30:22 user nova-compute[71229]:   </resource>
Apr 11 15:30:22 user nova-compute[71229]:   <sysinfo type='smbios'>
Apr 11 15:30:22 user nova-compute[71229]:     <system>
Apr 11 15:30:22 user nova-compute[71229]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 11 15:30:22 user nova-compute[71229]:       <entry name='product'>OpenStack Nova</entry>
Apr 11 15:30:22 user nova-compute[71229]:       <entry name='version'>0.0.0</entry>
Apr 11 15:30:22 user nova-compute[71229]:       <entry name='serial'>1424f1ff-6c0f-4f9a-bddc-6c448a768a7a</entry>
Apr 11 15:30:22 user nova-compute[71229]:       <entry name='uuid'>1424f1ff-6c0f-4f9a-bddc-6c448a768a7a</entry>
Apr 11 15:30:22 user nova-compute[71229]:       <entry name='family'>Virtual Machine</entry>
Apr 11 15:30:22 user nova-compute[71229]:     </system>
Apr 11 15:30:22 user nova-compute[71229]:   </sysinfo>
Apr 11 15:30:22 user nova-compute[71229]:   <os>
Apr 11 15:30:22 user nova-compute[71229]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 11 15:30:22 user nova-compute[71229]:     <boot dev='hd'/>
Apr 11 15:30:22 user nova-compute[71229]:     <smbios mode='sysinfo'/>
Apr 11 15:30:22 user nova-compute[71229]:   </os>
Apr 11 15:30:22 user nova-compute[71229]:   <features>
Apr 11 15:30:22 user nova-compute[71229]:     <acpi/>
Apr 11 15:30:22 user nova-compute[71229]:     <apic/>
Apr 11 15:30:22 user nova-compute[71229]:     <vmcoreinfo state='on'/>
Apr 11 15:30:22 user nova-compute[71229]:   </features>
Apr 11 15:30:22 user nova-compute[71229]:   <cpu mode='custom' match='exact' check='full'>
Apr 11 15:30:22 user nova-compute[71229]:     <model fallback='forbid'>Nehalem</model>
Apr 11 15:30:22 user nova-compute[71229]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 11 15:30:22 user nova-compute[71229]:     <feature policy='require' name='vme'/>
Apr 11 15:30:22 user nova-compute[71229]:     <feature policy='require' name='x2apic'/>
Apr 11 15:30:22 user nova-compute[71229]:     <feature policy='require' name='hypervisor'/>
Apr 11 15:30:22 user nova-compute[71229]:   </cpu>
Apr 11 15:30:22 user nova-compute[71229]:   <clock offset='utc'>
Apr 11 15:30:22 user nova-compute[71229]:     <timer name='pit' tickpolicy='delay'/>
Apr 11 15:30:22 user nova-compute[71229]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 11 15:30:22 user nova-compute[71229]:     <timer name='hpet' present='no'/>
Apr 11 15:30:22 user nova-compute[71229]:   </clock>
Apr 11 15:30:22 user nova-compute[71229]:   <on_poweroff>destroy</on_poweroff>
Apr 11 15:30:22 user nova-compute[71229]:   <on_reboot>restart</on_reboot>
Apr 11 15:30:22 user nova-compute[71229]:   <on_crash>destroy</on_crash>
Apr 11 15:30:22 user nova-compute[71229]:   <devices>
Apr 11 15:30:22 user nova-compute[71229]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 11 15:30:22 user nova-compute[71229]:     <disk type='file' device='disk'>
Apr 11 15:30:22 user nova-compute[71229]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 11 15:30:22 user nova-compute[71229]:       <source file='/opt/stack/data/nova/instances/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/disk' index='2'/>
Apr 11 15:30:22 user nova-compute[71229]:       <backingStore type='file' index='3'>
Apr 11 15:30:22 user nova-compute[71229]:         <format type='raw'/>
Apr 11 15:30:22 user nova-compute[71229]:         <source file='/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a'/>
Apr 11 15:30:22 user nova-compute[71229]:         <backingStore/>
Apr 11 15:30:22 user nova-compute[71229]:       </backingStore>
Apr 11 15:30:22 user nova-compute[71229]:       <target dev='vda' bus='virtio'/>
Apr 11 15:30:22 user nova-compute[71229]:       <alias name='virtio-disk0'/>
Apr 11 15:30:22 user nova-compute[71229]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 11 15:30:22 user nova-compute[71229]:     </disk>
Apr 11 15:30:22 user nova-compute[71229]:     <disk type='file' device='cdrom'>
Apr 11 15:30:22 user nova-compute[71229]:       <driver name='qemu' type='raw' cache='none'/>
Apr 11 15:30:22 user nova-compute[71229]:       <source file='/opt/stack/data/nova/instances/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/disk.config' index='1'/>
Apr 11 15:30:22 user nova-compute[71229]:       <backingStore/>
Apr 11 15:30:22 user nova-compute[71229]:       <target dev='hda' bus='ide'/>
Apr 11 15:30:22 user nova-compute[71229]:       <readonly/>
Apr 11 15:30:22 user nova-compute[71229]:       <alias name='ide0-0-0'/>
Apr 11 15:30:22 user nova-compute[71229]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 11 15:30:22 user nova-compute[71229]:     </disk>
Apr 11 15:30:22 user nova-compute[71229]:     <controller type='usb' index='0' model='none'>
Apr 11 15:30:22 user nova-compute[71229]:       <alias name='usb'/>
Apr 11 15:30:22 user nova-compute[71229]:     </controller>
Apr 11 15:30:22 user nova-compute[71229]:     <controller type='pci' index='0' model='pci-root'>
Apr 11 15:30:22 user nova-compute[71229]:       <alias name='pci.0'/>
Apr 11 15:30:22 user nova-compute[71229]:     </controller>
Apr 11 15:30:22 user nova-compute[71229]:     <controller type='ide' index='0'>
Apr 11 15:30:22 user nova-compute[71229]:       <alias name='ide'/>
Apr 11 15:30:22 user nova-compute[71229]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 11 15:30:22 user nova-compute[71229]:     </controller>
Apr 11 15:30:22 user nova-compute[71229]:     <interface type='ethernet'>
Apr 11 15:30:22 user nova-compute[71229]:       <mac address='fa:16:3e:05:3e:4e'/>
Apr 11 15:30:22 user nova-compute[71229]:       <target dev='tap40f1797d-27'/>
Apr 11 15:30:22 user nova-compute[71229]:       <model type='virtio'/>
Apr 11 15:30:22 user nova-compute[71229]:       <mtu size='1442'/>
Apr 11 15:30:22 user nova-compute[71229]:       <alias name='net0'/>
Apr 11 15:30:22 user nova-compute[71229]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 11 15:30:22 user nova-compute[71229]:     </interface>
Apr 11 15:30:22 user nova-compute[71229]:     <interface type='ethernet'>
Apr 11 15:30:22 user nova-compute[71229]:       <mac address='fa:16:3e:83:b6:f0'/>
Apr 11 15:30:22 user nova-compute[71229]:       <target dev='tapd218dc4e-de'/>
Apr 11 15:30:22 user nova-compute[71229]:       <model type='virtio'/>
Apr 11 15:30:22 user nova-compute[71229]:       <mtu size='1442'/>
Apr 11 15:30:22 user nova-compute[71229]:       <alias name='net1'/>
Apr 11 15:30:22 user nova-compute[71229]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Apr 11 15:30:22 user nova-compute[71229]:     </interface>
Apr 11 15:30:22 user nova-compute[71229]:     <serial type='pty'>
Apr 11 15:30:22 user nova-compute[71229]:       <source path='/dev/pts/7'/>
Apr 11 15:30:22 user nova-compute[71229]:       <log file='/opt/stack/data/nova/instances/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/console.log' append='off'/>
Apr 11 15:30:22 user nova-compute[71229]:       <target type='isa-serial' port='0'>
Apr 11 15:30:22 user nova-compute[71229]:         <model name='isa-serial'/>
Apr 11 15:30:22 user nova-compute[71229]:       </target>
Apr 11 15:30:22 user nova-compute[71229]:       <alias name='serial0'/>
Apr 11 15:30:22 user nova-compute[71229]:     </serial>
Apr 11 15:30:22 user nova-compute[71229]:     <console type='pty' tty='/dev/pts/7'>
Apr 11 15:30:22 user nova-compute[71229]:       <source path='/dev/pts/7'/>
Apr 11 15:30:22 user nova-compute[71229]:       <log file='/opt/stack/data/nova/instances/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/console.log' append='off'/>
Apr 11 15:30:22 user nova-compute[71229]:       <target type='serial' port='0'/>
Apr 11 15:30:22 user nova-compute[71229]:       <alias name='serial0'/>
Apr 11 15:30:22 user nova-compute[71229]:     </console>
Apr 11 15:30:22 user nova-compute[71229]:     <input type='mouse' bus='ps2'>
Apr 11 15:30:22 user nova-compute[71229]:       <alias name='input0'/>
Apr 11 15:30:22 user nova-compute[71229]:     </input>
Apr 11 15:30:22 user nova-compute[71229]:     <input type='keyboard' bus='ps2'>
Apr 11 15:30:22 user nova-compute[71229]:       <alias name='input1'/>
Apr 11 15:30:22 user nova-compute[71229]:     </input>
Apr 11 15:30:22 user nova-compute[71229]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Apr 11 15:30:22 user nova-compute[71229]:       <listen type='address' address='0.0.0.0'/>
Apr 11 15:30:22 user nova-compute[71229]:     </graphics>
Apr 11 15:30:22 user nova-compute[71229]:     <audio id='1' type='none'/>
Apr 11 15:30:22 user nova-compute[71229]:     <video>
Apr 11 15:30:22 user nova-compute[71229]:       <model type='virtio' heads='1' primary='yes'/>
Apr 11 15:30:22 user nova-compute[71229]:       <alias name='video0'/>
Apr 11 15:30:22 user nova-compute[71229]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 11 15:30:22 user nova-compute[71229]:     </video>
Apr 11 15:30:22 user nova-compute[71229]:     <memballoon model='virtio'>
Apr 11 15:30:22 user nova-compute[71229]:       <stats period='10'/>
Apr 11 15:30:22 user nova-compute[71229]:       <alias name='balloon0'/>
Apr 11 15:30:22 user nova-compute[71229]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 11 15:30:22 user nova-compute[71229]:     </memballoon>
Apr 11 15:30:22 user nova-compute[71229]:     <rng model='virtio'>
Apr 11 15:30:22 user nova-compute[71229]:       <backend model='random'>/dev/urandom</backend>
Apr 11 15:30:22 user nova-compute[71229]:       <alias name='rng0'/>
Apr 11 15:30:22 user nova-compute[71229]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 11 15:30:22 user nova-compute[71229]:     </rng>
Apr 11 15:30:22 user nova-compute[71229]:   </devices>
Apr 11 15:30:22 user nova-compute[71229]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 11 15:30:22 user nova-compute[71229]:     <label>libvirt-1424f1ff-6c0f-4f9a-bddc-6c448a768a7a</label>
Apr 11 15:30:22 user nova-compute[71229]:     <imagelabel>libvirt-1424f1ff-6c0f-4f9a-bddc-6c448a768a7a</imagelabel>
Apr 11 15:30:22 user nova-compute[71229]:   </seclabel>
Apr 11 15:30:22 user nova-compute[71229]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 11 15:30:22 user nova-compute[71229]:     <label>+64055:+108</label>
Apr 11 15:30:22 user nova-compute[71229]:     <imagelabel>+64055:+108</imagelabel>
Apr 11 15:30:22 user nova-compute[71229]:   </seclabel>
Apr 11 15:30:22 user nova-compute[71229]: </domain>
Apr 11 15:30:22 user nova-compute[71229]:  {{(pid=71229) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 11 15:30:22 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-31d8da70-ae46-4555-bbe8-c514df73e54d tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Successfully detached device tapd218dc4e-de from instance 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a from the persistent domain config.
Apr 11 15:30:22 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-31d8da70-ae46-4555-bbe8-c514df73e54d tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] (1/8): Attempting to detach device tapd218dc4e-de with device alias net1 from instance 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a from the live domain config. {{(pid=71229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 15:30:22 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-31d8da70-ae46-4555-bbe8-c514df73e54d tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] detach device xml: <interface type="ethernet">
Apr 11 15:30:22 user nova-compute[71229]:   <mac address="fa:16:3e:83:b6:f0"/>
Apr 11 15:30:22 user nova-compute[71229]:   <model type="virtio"/>
Apr 11 15:30:22 user nova-compute[71229]:   <mtu size="1442"/>
Apr 11 15:30:22 user nova-compute[71229]:   <target dev="tapd218dc4e-de"/>
Apr 11 15:30:22 user nova-compute[71229]: </interface>
Apr 11 15:30:22 user nova-compute[71229]:  {{(pid=71229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 15:30:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:23 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Received event <DeviceRemovedEvent: 1681227023.1584184, 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71229) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 15:30:23 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-31d8da70-ae46-4555-bbe8-c514df73e54d tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Start waiting for the detach event from libvirt for device tapd218dc4e-de with device alias net1 for instance 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a {{(pid=71229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 15:30:23 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-31d8da70-ae46-4555-bbe8-c514df73e54d tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:83:b6:f0"/><model type="virtio"/><mtu size="1442"/><target dev="tapd218dc4e-de"/></interface> {{(pid=71229) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 11 15:30:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:23 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-31d8da70-ae46-4555-bbe8-c514df73e54d tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:83:b6:f0"/><model type="virtio"/><mtu size="1442"/><target dev="tapd218dc4e-de"/></interface>not found in domain: <domain type='kvm' id='23'>
Apr 11 15:30:23 user nova-compute[71229]:   <name>instance-00000013</name>
Apr 11 15:30:23 user nova-compute[71229]:   <uuid>1424f1ff-6c0f-4f9a-bddc-6c448a768a7a</uuid>
Apr 11 15:30:23 user nova-compute[71229]:   <metadata>
Apr 11 15:30:23 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:30:23 user nova-compute[71229]:   <nova:package version="0.0.0"/>
Apr 11 15:30:23 user nova-compute[71229]:   <nova:name>tempest-device-tagging-server-982441201</nova:name>
Apr 11 15:30:23 user nova-compute[71229]:   <nova:creationTime>2023-04-11 15:30:12</nova:creationTime>
Apr 11 15:30:23 user nova-compute[71229]:   <nova:flavor name="m1.nano">
Apr 11 15:30:23 user nova-compute[71229]:     <nova:memory>128</nova:memory>
Apr 11 15:30:23 user nova-compute[71229]:     <nova:disk>1</nova:disk>
Apr 11 15:30:23 user nova-compute[71229]:     <nova:swap>0</nova:swap>
Apr 11 15:30:23 user nova-compute[71229]:     <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:30:23 user nova-compute[71229]:     <nova:vcpus>1</nova:vcpus>
Apr 11 15:30:23 user nova-compute[71229]:   </nova:flavor>
Apr 11 15:30:23 user nova-compute[71229]:   <nova:owner>
Apr 11 15:30:23 user nova-compute[71229]:     <nova:user uuid="f32986358bcc4148ad3f361e3944ed81">tempest-TaggedAttachmentsTest-727930312-project-member</nova:user>
Apr 11 15:30:23 user nova-compute[71229]:     <nova:project uuid="82dec4b679f24d1e85b1105b4849cddd">tempest-TaggedAttachmentsTest-727930312</nova:project>
Apr 11 15:30:23 user nova-compute[71229]:   </nova:owner>
Apr 11 15:30:23 user nova-compute[71229]:   <nova:root type="image" uuid="52fe638c-5ada-47d5-b376-233bfa808a37"/>
Apr 11 15:30:23 user nova-compute[71229]:   <nova:ports>
Apr 11 15:30:23 user nova-compute[71229]:     <nova:port uuid="40f1797d-278c-4676-8413-3b0c0f113dd9">
Apr 11 15:30:23 user nova-compute[71229]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 11 15:30:23 user nova-compute[71229]:     </nova:port>
Apr 11 15:30:23 user nova-compute[71229]:     <nova:port uuid="d218dc4e-de80-49ed-be04-59771f71dd3f">
Apr 11 15:30:23 user nova-compute[71229]:       <nova:ip type="fixed" address="10.10.10.162" ipVersion="4"/>
Apr 11 15:30:23 user nova-compute[71229]:     </nova:port>
Apr 11 15:30:23 user nova-compute[71229]:   </nova:ports>
Apr 11 15:30:23 user nova-compute[71229]: </nova:instance>
Apr 11 15:30:23 user nova-compute[71229]:   </metadata>
Apr 11 15:30:23 user nova-compute[71229]:   <memory unit='KiB'>131072</memory>
Apr 11 15:30:23 user nova-compute[71229]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 11 15:30:23 user nova-compute[71229]:   <vcpu placement='static'>1</vcpu>
Apr 11 15:30:23 user nova-compute[71229]:   <resource>
Apr 11 15:30:23 user nova-compute[71229]:     <partition>/machine</partition>
Apr 11 15:30:23 user nova-compute[71229]:   </resource>
Apr 11 15:30:23 user nova-compute[71229]:   <sysinfo type='smbios'>
Apr 11 15:30:23 user nova-compute[71229]:     <system>
Apr 11 15:30:23 user nova-compute[71229]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 11 15:30:23 user nova-compute[71229]:       <entry name='product'>OpenStack Nova</entry>
Apr 11 15:30:23 user nova-compute[71229]:       <entry name='version'>0.0.0</entry>
Apr 11 15:30:23 user nova-compute[71229]:       <entry name='serial'>1424f1ff-6c0f-4f9a-bddc-6c448a768a7a</entry>
Apr 11 15:30:23 user nova-compute[71229]:       <entry name='uuid'>1424f1ff-6c0f-4f9a-bddc-6c448a768a7a</entry>
Apr 11 15:30:23 user nova-compute[71229]:       <entry name='family'>Virtual Machine</entry>
Apr 11 15:30:23 user nova-compute[71229]:     </system>
Apr 11 15:30:23 user nova-compute[71229]:   </sysinfo>
Apr 11 15:30:23 user nova-compute[71229]:   <os>
Apr 11 15:30:23 user nova-compute[71229]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 11 15:30:23 user nova-compute[71229]:     <boot dev='hd'/>
Apr 11 15:30:23 user nova-compute[71229]:     <smbios mode='sysinfo'/>
Apr 11 15:30:23 user nova-compute[71229]:   </os>
Apr 11 15:30:23 user nova-compute[71229]:   <features>
Apr 11 15:30:23 user nova-compute[71229]:     <acpi/>
Apr 11 15:30:23 user nova-compute[71229]:     <apic/>
Apr 11 15:30:23 user nova-compute[71229]:     <vmcoreinfo state='on'/>
Apr 11 15:30:23 user nova-compute[71229]:   </features>
Apr 11 15:30:23 user nova-compute[71229]:   <cpu mode='custom' match='exact' check='full'>
Apr 11 15:30:23 user nova-compute[71229]:     <model fallback='forbid'>Nehalem</model>
Apr 11 15:30:23 user nova-compute[71229]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 11 15:30:23 user nova-compute[71229]:     <feature policy='require' name='vme'/>
Apr 11 15:30:23 user nova-compute[71229]:     <feature policy='require' name='x2apic'/>
Apr 11 15:30:23 user nova-compute[71229]:     <feature policy='require' name='hypervisor'/>
Apr 11 15:30:23 user nova-compute[71229]:   </cpu>
Apr 11 15:30:23 user nova-compute[71229]:   <clock offset='utc'>
Apr 11 15:30:23 user nova-compute[71229]:     <timer name='pit' tickpolicy='delay'/>
Apr 11 15:30:23 user nova-compute[71229]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 11 15:30:23 user nova-compute[71229]:     <timer name='hpet' present='no'/>
Apr 11 15:30:23 user nova-compute[71229]:   </clock>
Apr 11 15:30:23 user nova-compute[71229]:   <on_poweroff>destroy</on_poweroff>
Apr 11 15:30:23 user nova-compute[71229]:   <on_reboot>restart</on_reboot>
Apr 11 15:30:23 user nova-compute[71229]:   <on_crash>destroy</on_crash>
Apr 11 15:30:23 user nova-compute[71229]:   <devices>
Apr 11 15:30:23 user nova-compute[71229]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 11 15:30:23 user nova-compute[71229]:     <disk type='file' device='disk'>
Apr 11 15:30:23 user nova-compute[71229]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 11 15:30:23 user nova-compute[71229]:       <source file='/opt/stack/data/nova/instances/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/disk' index='2'/>
Apr 11 15:30:23 user nova-compute[71229]:       <backingStore type='file' index='3'>
Apr 11 15:30:23 user nova-compute[71229]:         <format type='raw'/>
Apr 11 15:30:23 user nova-compute[71229]:         <source file='/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a'/>
Apr 11 15:30:23 user nova-compute[71229]:         <backingStore/>
Apr 11 15:30:23 user nova-compute[71229]:       </backingStore>
Apr 11 15:30:23 user nova-compute[71229]:       <target dev='vda' bus='virtio'/>
Apr 11 15:30:23 user nova-compute[71229]:       <alias name='virtio-disk0'/>
Apr 11 15:30:23 user nova-compute[71229]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 11 15:30:23 user nova-compute[71229]:     </disk>
Apr 11 15:30:23 user nova-compute[71229]:     <disk type='file' device='cdrom'>
Apr 11 15:30:23 user nova-compute[71229]:       <driver name='qemu' type='raw' cache='none'/>
Apr 11 15:30:23 user nova-compute[71229]:       <source file='/opt/stack/data/nova/instances/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/disk.config' index='1'/>
Apr 11 15:30:23 user nova-compute[71229]:       <backingStore/>
Apr 11 15:30:23 user nova-compute[71229]:       <target dev='hda' bus='ide'/>
Apr 11 15:30:23 user nova-compute[71229]:       <readonly/>
Apr 11 15:30:23 user nova-compute[71229]:       <alias name='ide0-0-0'/>
Apr 11 15:30:23 user nova-compute[71229]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 11 15:30:23 user nova-compute[71229]:     </disk>
Apr 11 15:30:23 user nova-compute[71229]:     <controller type='usb' index='0' model='none'>
Apr 11 15:30:23 user nova-compute[71229]:       <alias name='usb'/>
Apr 11 15:30:23 user nova-compute[71229]:     </controller>
Apr 11 15:30:23 user nova-compute[71229]:     <controller type='pci' index='0' model='pci-root'>
Apr 11 15:30:23 user nova-compute[71229]:       <alias name='pci.0'/>
Apr 11 15:30:23 user nova-compute[71229]:     </controller>
Apr 11 15:30:23 user nova-compute[71229]:     <controller type='ide' index='0'>
Apr 11 15:30:23 user nova-compute[71229]:       <alias name='ide'/>
Apr 11 15:30:23 user nova-compute[71229]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 11 15:30:23 user nova-compute[71229]:     </controller>
Apr 11 15:30:23 user nova-compute[71229]:     <interface type='ethernet'>
Apr 11 15:30:23 user nova-compute[71229]:       <mac address='fa:16:3e:05:3e:4e'/>
Apr 11 15:30:23 user nova-compute[71229]:       <target dev='tap40f1797d-27'/>
Apr 11 15:30:23 user nova-compute[71229]:       <model type='virtio'/>
Apr 11 15:30:23 user nova-compute[71229]:       <mtu size='1442'/>
Apr 11 15:30:23 user nova-compute[71229]:       <alias name='net0'/>
Apr 11 15:30:23 user nova-compute[71229]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 11 15:30:23 user nova-compute[71229]:     </interface>
Apr 11 15:30:23 user nova-compute[71229]:     <serial type='pty'>
Apr 11 15:30:23 user nova-compute[71229]:       <source path='/dev/pts/7'/>
Apr 11 15:30:23 user nova-compute[71229]:       <log file='/opt/stack/data/nova/instances/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/console.log' append='off'/>
Apr 11 15:30:23 user nova-compute[71229]:       <target type='isa-serial' port='0'>
Apr 11 15:30:23 user nova-compute[71229]:         <model name='isa-serial'/>
Apr 11 15:30:23 user nova-compute[71229]:       </target>
Apr 11 15:30:23 user nova-compute[71229]:       <alias name='serial0'/>
Apr 11 15:30:23 user nova-compute[71229]:     </serial>
Apr 11 15:30:23 user nova-compute[71229]:     <console type='pty' tty='/dev/pts/7'>
Apr 11 15:30:23 user nova-compute[71229]:       <source path='/dev/pts/7'/>
Apr 11 15:30:23 user nova-compute[71229]:       <log file='/opt/stack/data/nova/instances/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/console.log' append='off'/>
Apr 11 15:30:23 user nova-compute[71229]:       <target type='serial' port='0'/>
Apr 11 15:30:23 user nova-compute[71229]:       <alias name='serial0'/>
Apr 11 15:30:23 user nova-compute[71229]:     </console>
Apr 11 15:30:23 user nova-compute[71229]:     <input type='mouse' bus='ps2'>
Apr 11 15:30:23 user nova-compute[71229]:       <alias name='input0'/>
Apr 11 15:30:23 user nova-compute[71229]:     </input>
Apr 11 15:30:23 user nova-compute[71229]:     <input type='keyboard' bus='ps2'>
Apr 11 15:30:23 user nova-compute[71229]:       <alias name='input1'/>
Apr 11 15:30:23 user nova-compute[71229]:     </input>
Apr 11 15:30:23 user nova-compute[71229]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Apr 11 15:30:23 user nova-compute[71229]:       <listen type='address' address='0.0.0.0'/>
Apr 11 15:30:23 user nova-compute[71229]:     </graphics>
Apr 11 15:30:23 user nova-compute[71229]:     <audio id='1' type='none'/>
Apr 11 15:30:23 user nova-compute[71229]:     <video>
Apr 11 15:30:23 user nova-compute[71229]:       <model type='virtio' heads='1' primary='yes'/>
Apr 11 15:30:23 user nova-compute[71229]:       <alias name='video0'/>
Apr 11 15:30:23 user nova-compute[71229]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 11 15:30:23 user nova-compute[71229]:     </video>
Apr 11 15:30:23 user nova-compute[71229]:     <memballoon model='virtio'>
Apr 11 15:30:23 user nova-compute[71229]:       <stats period='10'/>
Apr 11 15:30:23 user nova-compute[71229]:       <alias name='balloon0'/>
Apr 11 15:30:23 user nova-compute[71229]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 11 15:30:23 user nova-compute[71229]:     </memballoon>
Apr 11 15:30:23 user nova-compute[71229]:     <rng model='virtio'>
Apr 11 15:30:23 user nova-compute[71229]:       <backend model='random'>/dev/urandom</backend>
Apr 11 15:30:23 user nova-compute[71229]:       <alias name='rng0'/>
Apr 11 15:30:23 user nova-compute[71229]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 11 15:30:23 user nova-compute[71229]:     </rng>
Apr 11 15:30:23 user nova-compute[71229]:   </devices>
Apr 11 15:30:23 user nova-compute[71229]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 11 15:30:23 user nova-compute[71229]:     <label>libvirt-1424f1ff-6c0f-4f9a-bddc-6c448a768a7a</label>
Apr 11 15:30:23 user nova-compute[71229]:     <imagelabel>libvirt-1424f1ff-6c0f-4f9a-bddc-6c448a768a7a</imagelabel>
Apr 11 15:30:23 user nova-compute[71229]:   </seclabel>
Apr 11 15:30:23 user nova-compute[71229]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 11 15:30:23 user nova-compute[71229]:     <label>+64055:+108</label>
Apr 11 15:30:23 user nova-compute[71229]:     <imagelabel>+64055:+108</imagelabel>
Apr 11 15:30:23 user nova-compute[71229]:   </seclabel>
Apr 11 15:30:23 user nova-compute[71229]: </domain>
Apr 11 15:30:23 user nova-compute[71229]:  {{(pid=71229) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 11 15:30:23 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-31d8da70-ae46-4555-bbe8-c514df73e54d tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Successfully detached device tapd218dc4e-de from instance 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a from the live domain config.
Apr 11 15:30:23 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-31d8da70-ae46-4555-bbe8-c514df73e54d tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T15:28:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-982441201',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-982441201',id=19,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQhnP1Gx1ErLuuEevJpV94XRpvcJAoAfxD6RZqXP7Kvn0H8XePF/x7sWzG5H5vtetd0gs+rS/bMxjK4Qz9b0uYhYgbQvD0DmjSlBMXC1CeKAiMrjjZNT7Keb43XJ65W+w==',key_name='tempest-keypair-1011126544',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:28:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='82dec4b679f24d1e85b1105b4849cddd',ramdisk_id='',reservation_id='r-izovbhtx',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-727930312',owner_user_name='tempest-TaggedAttachmentsTest-727930312-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:28:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f32986358bcc4148ad3f361e3944ed81',uuid=1424f1ff-6c0f-4f9a-bddc-6c448a768a7a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d218dc4e-de80-49ed-be04-59771f71dd3f", "address": "fa:16:3e:83:b6:f0", "network": {"id": "f07eb0b8-74da-402a-a601-68a72f85f931", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1723277263", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "82dec4b679f24d1e85b1105b4849cddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd218dc4e-de", "ovs_interfaceid": "d218dc4e-de80-49ed-be04-59771f71dd3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:30:23 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-31d8da70-ae46-4555-bbe8-c514df73e54d tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Converting VIF {"id": "d218dc4e-de80-49ed-be04-59771f71dd3f", "address": "fa:16:3e:83:b6:f0", "network": {"id": "f07eb0b8-74da-402a-a601-68a72f85f931", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1723277263", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "82dec4b679f24d1e85b1105b4849cddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd218dc4e-de", "ovs_interfaceid": "d218dc4e-de80-49ed-be04-59771f71dd3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:30:23 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-31d8da70-ae46-4555-bbe8-c514df73e54d tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:b6:f0,bridge_name='br-int',has_traffic_filtering=True,id=d218dc4e-de80-49ed-be04-59771f71dd3f,network=Network(f07eb0b8-74da-402a-a601-68a72f85f931),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd218dc4e-de') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:30:23 user nova-compute[71229]: DEBUG os_vif [None req-31d8da70-ae46-4555-bbe8-c514df73e54d tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:b6:f0,bridge_name='br-int',has_traffic_filtering=True,id=d218dc4e-de80-49ed-be04-59771f71dd3f,network=Network(f07eb0b8-74da-402a-a601-68a72f85f931),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd218dc4e-de') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:30:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd218dc4e-de, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:30:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:30:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:23 user nova-compute[71229]: INFO os_vif [None req-31d8da70-ae46-4555-bbe8-c514df73e54d tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:b6:f0,bridge_name='br-int',has_traffic_filtering=True,id=d218dc4e-de80-49ed-be04-59771f71dd3f,network=Network(f07eb0b8-74da-402a-a601-68a72f85f931),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd218dc4e-de')
Apr 11 15:30:23 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-31d8da70-ae46-4555-bbe8-c514df73e54d tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:30:23 user nova-compute[71229]:   <nova:package version="0.0.0"/>
Apr 11 15:30:23 user nova-compute[71229]:   <nova:name>tempest-device-tagging-server-982441201</nova:name>
Apr 11 15:30:23 user nova-compute[71229]:   <nova:creationTime>2023-04-11 15:30:23</nova:creationTime>
Apr 11 15:30:23 user nova-compute[71229]:   <nova:flavor name="m1.nano">
Apr 11 15:30:23 user nova-compute[71229]:     <nova:memory>128</nova:memory>
Apr 11 15:30:23 user nova-compute[71229]:     <nova:disk>1</nova:disk>
Apr 11 15:30:23 user nova-compute[71229]:     <nova:swap>0</nova:swap>
Apr 11 15:30:23 user nova-compute[71229]:     <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:30:23 user nova-compute[71229]:     <nova:vcpus>1</nova:vcpus>
Apr 11 15:30:23 user nova-compute[71229]:   </nova:flavor>
Apr 11 15:30:23 user nova-compute[71229]:   <nova:owner>
Apr 11 15:30:23 user nova-compute[71229]:     <nova:user uuid="f32986358bcc4148ad3f361e3944ed81">tempest-TaggedAttachmentsTest-727930312-project-member</nova:user>
Apr 11 15:30:23 user nova-compute[71229]:     <nova:project uuid="82dec4b679f24d1e85b1105b4849cddd">tempest-TaggedAttachmentsTest-727930312</nova:project>
Apr 11 15:30:23 user nova-compute[71229]:   </nova:owner>
Apr 11 15:30:23 user nova-compute[71229]:   <nova:root type="image" uuid="52fe638c-5ada-47d5-b376-233bfa808a37"/>
Apr 11 15:30:23 user nova-compute[71229]:   <nova:ports>
Apr 11 15:30:23 user nova-compute[71229]:     <nova:port uuid="40f1797d-278c-4676-8413-3b0c0f113dd9">
Apr 11 15:30:23 user nova-compute[71229]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 11 15:30:23 user nova-compute[71229]:     </nova:port>
Apr 11 15:30:23 user nova-compute[71229]:   </nova:ports>
Apr 11 15:30:23 user nova-compute[71229]: </nova:instance>
Apr 11 15:30:23 user nova-compute[71229]:  {{(pid=71229) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 11 15:30:23 user nova-compute[71229]: DEBUG nova.compute.manager [req-99a65df5-0b32-485a-9394-b1c519fa8550 req-e25559d7-5fe3-419e-88da-f85a71fd7e37 service nova] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Received event network-vif-unplugged-d218dc4e-de80-49ed-be04-59771f71dd3f {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:30:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-99a65df5-0b32-485a-9394-b1c519fa8550 req-e25559d7-5fe3-419e-88da-f85a71fd7e37 service nova] Acquiring lock "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:30:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-99a65df5-0b32-485a-9394-b1c519fa8550 req-e25559d7-5fe3-419e-88da-f85a71fd7e37 service nova] Lock "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:30:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-99a65df5-0b32-485a-9394-b1c519fa8550 req-e25559d7-5fe3-419e-88da-f85a71fd7e37 service nova] Lock "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:30:23 user nova-compute[71229]: DEBUG nova.compute.manager [req-99a65df5-0b32-485a-9394-b1c519fa8550 req-e25559d7-5fe3-419e-88da-f85a71fd7e37 service nova] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] No waiting events found dispatching network-vif-unplugged-d218dc4e-de80-49ed-be04-59771f71dd3f {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:30:23 user nova-compute[71229]: WARNING nova.compute.manager [req-99a65df5-0b32-485a-9394-b1c519fa8550 req-e25559d7-5fe3-419e-88da-f85a71fd7e37 service nova] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Received unexpected event network-vif-unplugged-d218dc4e-de80-49ed-be04-59771f71dd3f for instance with vm_state active and task_state None.
Apr 11 15:30:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-31d8da70-ae46-4555-bbe8-c514df73e54d tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Acquiring lock "refresh_cache-1424f1ff-6c0f-4f9a-bddc-6c448a768a7a" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:30:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-31d8da70-ae46-4555-bbe8-c514df73e54d tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Acquired lock "refresh_cache-1424f1ff-6c0f-4f9a-bddc-6c448a768a7a" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:30:23 user nova-compute[71229]: DEBUG nova.network.neutron [None req-31d8da70-ae46-4555-bbe8-c514df73e54d tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:30:24 user nova-compute[71229]: INFO nova.network.neutron [None req-31d8da70-ae46-4555-bbe8-c514df73e54d tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Port d218dc4e-de80-49ed-be04-59771f71dd3f from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Apr 11 15:30:24 user nova-compute[71229]: DEBUG nova.network.neutron [None req-31d8da70-ae46-4555-bbe8-c514df73e54d tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Updating instance_info_cache with network_info: [{"id": "40f1797d-278c-4676-8413-3b0c0f113dd9", "address": "fa:16:3e:05:3e:4e", "network": {"id": "921b7e62-65aa-426c-9286-8b31b88588a8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1464327252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82dec4b679f24d1e85b1105b4849cddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40f1797d-27", "ovs_interfaceid": "40f1797d-278c-4676-8413-3b0c0f113dd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:30:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-31d8da70-ae46-4555-bbe8-c514df73e54d tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Releasing lock "refresh_cache-1424f1ff-6c0f-4f9a-bddc-6c448a768a7a" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:30:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-31d8da70-ae46-4555-bbe8-c514df73e54d tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "interface-1424f1ff-6c0f-4f9a-bddc-6c448a768a7a-d218dc4e-de80-49ed-be04-59771f71dd3f" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.936s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:30:25 user nova-compute[71229]: DEBUG nova.compute.manager [req-40a027ef-602c-47ae-9be9-e129fb63b4e8 req-5add56db-f835-4c3f-bab8-d149567fd945 service nova] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Received event network-vif-plugged-d218dc4e-de80-49ed-be04-59771f71dd3f {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:30:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-40a027ef-602c-47ae-9be9-e129fb63b4e8 req-5add56db-f835-4c3f-bab8-d149567fd945 service nova] Acquiring lock "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:30:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-40a027ef-602c-47ae-9be9-e129fb63b4e8 req-5add56db-f835-4c3f-bab8-d149567fd945 service nova] Lock "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:30:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-40a027ef-602c-47ae-9be9-e129fb63b4e8 req-5add56db-f835-4c3f-bab8-d149567fd945 service nova] Lock "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:30:25 user nova-compute[71229]: DEBUG nova.compute.manager [req-40a027ef-602c-47ae-9be9-e129fb63b4e8 req-5add56db-f835-4c3f-bab8-d149567fd945 service nova] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] No waiting events found dispatching network-vif-plugged-d218dc4e-de80-49ed-be04-59771f71dd3f {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:30:25 user nova-compute[71229]: WARNING nova.compute.manager [req-40a027ef-602c-47ae-9be9-e129fb63b4e8 req-5add56db-f835-4c3f-bab8-d149567fd945 service nova] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Received unexpected event network-vif-plugged-d218dc4e-de80-49ed-be04-59771f71dd3f for instance with vm_state active and task_state None.
Apr 11 15:30:25 user nova-compute[71229]: DEBUG nova.compute.manager [req-40a027ef-602c-47ae-9be9-e129fb63b4e8 req-5add56db-f835-4c3f-bab8-d149567fd945 service nova] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Received event network-vif-deleted-d218dc4e-de80-49ed-be04-59771f71dd3f {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:30:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:29 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-20df7641-9748-488d-bd5a-f86a91ff7b9e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:30:29 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-20df7641-9748-488d-bd5a-f86a91ff7b9e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:30:29 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-20df7641-9748-488d-bd5a-f86a91ff7b9e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:30:29 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-20df7641-9748-488d-bd5a-f86a91ff7b9e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:30:29 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-20df7641-9748-488d-bd5a-f86a91ff7b9e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:30:29 user nova-compute[71229]: INFO nova.compute.manager [None req-20df7641-9748-488d-bd5a-f86a91ff7b9e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Terminating instance
Apr 11 15:30:29 user nova-compute[71229]: DEBUG nova.compute.manager [None req-20df7641-9748-488d-bd5a-f86a91ff7b9e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Start destroying the instance on the hypervisor. {{(pid=71229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 15:30:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:30 user nova-compute[71229]: DEBUG nova.compute.manager [req-269c9c4f-0344-4916-a37d-d62cbc3601e7 req-9cef155b-2c48-44cf-b6d3-3193244a2c51 service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Received event network-vif-unplugged-1ad8234a-3f96-43a0-9dea-862e6efcda73 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:30:30 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-269c9c4f-0344-4916-a37d-d62cbc3601e7 req-9cef155b-2c48-44cf-b6d3-3193244a2c51 service nova] Acquiring lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:30:30 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-269c9c4f-0344-4916-a37d-d62cbc3601e7 req-9cef155b-2c48-44cf-b6d3-3193244a2c51 service nova] Lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:30:30 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-269c9c4f-0344-4916-a37d-d62cbc3601e7 req-9cef155b-2c48-44cf-b6d3-3193244a2c51 service nova] Lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:30:30 user nova-compute[71229]: DEBUG nova.compute.manager [req-269c9c4f-0344-4916-a37d-d62cbc3601e7 req-9cef155b-2c48-44cf-b6d3-3193244a2c51 service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] No waiting events found dispatching network-vif-unplugged-1ad8234a-3f96-43a0-9dea-862e6efcda73 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:30:30 user nova-compute[71229]: DEBUG nova.compute.manager [req-269c9c4f-0344-4916-a37d-d62cbc3601e7 req-9cef155b-2c48-44cf-b6d3-3193244a2c51 service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Received event network-vif-unplugged-1ad8234a-3f96-43a0-9dea-862e6efcda73 for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 15:30:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:30 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Instance destroyed successfully.
Apr 11 15:30:30 user nova-compute[71229]: DEBUG nova.objects.instance [None req-20df7641-9748-488d-bd5a-f86a91ff7b9e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lazy-loading 'resources' on Instance uuid 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:30:30 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-20df7641-9748-488d-bd5a-f86a91ff7b9e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T15:24:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1772068587',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1772068587',id=12,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsR3rBvaQjIOxYeSz3NLQVsG9AGAuW2r0O6Mjm+I+MgG/J7ZAhRru4tm3W0cW0RBt+UkxQ8v87/p6J8fnQe0XnKTLliPQO8+NI0fNGxiZv5WBaJ+k0gvozLOf39XTzY+Q==',key_name='tempest-keypair-2006224467',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:28:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63b9b79fb98441fd9f1b5df54471f0bd',ramdisk_id='',reservation_id='r-vjwljds2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1785499036',owner_user_name='tempest-AttachVolumeShelveTestJSON-1785499036-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:28:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88d988d9ce0a41669b7c487ac07b4cfe',uuid=1e01618b-2aa4-4b56-b1a2-0d6e25e3075d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ad8234a-3f96-43a0-9dea-862e6efcda73", "address": "fa:16:3e:54:20:be", "network": {"id": "15a1a586-0100-4057-8501-5c5a282d4063", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834988552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b9b79fb98441fd9f1b5df54471f0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad8234a-3f", "ovs_interfaceid": "1ad8234a-3f96-43a0-9dea-862e6efcda73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:30:30 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-20df7641-9748-488d-bd5a-f86a91ff7b9e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Converting VIF {"id": "1ad8234a-3f96-43a0-9dea-862e6efcda73", "address": "fa:16:3e:54:20:be", "network": {"id": "15a1a586-0100-4057-8501-5c5a282d4063", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834988552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b9b79fb98441fd9f1b5df54471f0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad8234a-3f", "ovs_interfaceid": "1ad8234a-3f96-43a0-9dea-862e6efcda73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:30:30 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-20df7641-9748-488d-bd5a-f86a91ff7b9e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:20:be,bridge_name='br-int',has_traffic_filtering=True,id=1ad8234a-3f96-43a0-9dea-862e6efcda73,network=Network(15a1a586-0100-4057-8501-5c5a282d4063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad8234a-3f') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:30:30 user nova-compute[71229]: DEBUG os_vif [None req-20df7641-9748-488d-bd5a-f86a91ff7b9e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:20:be,bridge_name='br-int',has_traffic_filtering=True,id=1ad8234a-3f96-43a0-9dea-862e6efcda73,network=Network(15a1a586-0100-4057-8501-5c5a282d4063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad8234a-3f') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:30:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ad8234a-3f, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:30:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:30:30 user nova-compute[71229]: INFO os_vif [None req-20df7641-9748-488d-bd5a-f86a91ff7b9e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:20:be,bridge_name='br-int',has_traffic_filtering=True,id=1ad8234a-3f96-43a0-9dea-862e6efcda73,network=Network(15a1a586-0100-4057-8501-5c5a282d4063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad8234a-3f')
Apr 11 15:30:30 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-20df7641-9748-488d-bd5a-f86a91ff7b9e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Deleting instance files /opt/stack/data/nova/instances/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d_del
Apr 11 15:30:30 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-20df7641-9748-488d-bd5a-f86a91ff7b9e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Deletion of /opt/stack/data/nova/instances/1e01618b-2aa4-4b56-b1a2-0d6e25e3075d_del complete
Apr 11 15:30:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:30 user nova-compute[71229]: INFO nova.compute.manager [None req-20df7641-9748-488d-bd5a-f86a91ff7b9e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 11 15:30:30 user nova-compute[71229]: DEBUG oslo.service.loopingcall [None req-20df7641-9748-488d-bd5a-f86a91ff7b9e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71229) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 15:30:30 user nova-compute[71229]: DEBUG nova.compute.manager [-] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Deallocating network for instance {{(pid=71229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 15:30:30 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] deallocate_for_instance() {{(pid=71229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 15:30:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:31 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:30:31 user nova-compute[71229]: DEBUG nova.compute.manager [req-76f87090-93d6-4753-816e-605db6ad6aa1 req-fecaecd5-b404-4f28-806b-5fb3707537ed service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Received event network-vif-deleted-1ad8234a-3f96-43a0-9dea-862e6efcda73 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:30:31 user nova-compute[71229]: INFO nova.compute.manager [req-76f87090-93d6-4753-816e-605db6ad6aa1 req-fecaecd5-b404-4f28-806b-5fb3707537ed service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Neutron deleted interface 1ad8234a-3f96-43a0-9dea-862e6efcda73; detaching it from the instance and deleting it from the info cache
Apr 11 15:30:31 user nova-compute[71229]: DEBUG nova.network.neutron [req-76f87090-93d6-4753-816e-605db6ad6aa1 req-fecaecd5-b404-4f28-806b-5fb3707537ed service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:30:31 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Took 0.79 seconds to deallocate network for instance.
Apr 11 15:30:31 user nova-compute[71229]: DEBUG nova.compute.manager [req-76f87090-93d6-4753-816e-605db6ad6aa1 req-fecaecd5-b404-4f28-806b-5fb3707537ed service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Detach interface failed, port_id=1ad8234a-3f96-43a0-9dea-862e6efcda73, reason: Instance 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d could not be found. {{(pid=71229) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 15:30:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-20df7641-9748-488d-bd5a-f86a91ff7b9e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:30:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-20df7641-9748-488d-bd5a-f86a91ff7b9e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:30:31 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-20df7641-9748-488d-bd5a-f86a91ff7b9e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:30:31 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-20df7641-9748-488d-bd5a-f86a91ff7b9e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:30:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-20df7641-9748-488d-bd5a-f86a91ff7b9e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.276s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:30:31 user nova-compute[71229]: INFO nova.scheduler.client.report [None req-20df7641-9748-488d-bd5a-f86a91ff7b9e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Deleted allocations for instance 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d
Apr 11 15:30:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-20df7641-9748-488d-bd5a-f86a91ff7b9e tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.115s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:30:32 user nova-compute[71229]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681227017.107504, 39e3dfb1-bc09-474d-b8cb-f01b11923eae => Stopped> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:30:32 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] VM Stopped (Lifecycle Event)
Apr 11 15:30:32 user nova-compute[71229]: DEBUG nova.compute.manager [None req-088993e7-2a64-414f-a88c-264c5d781e0f None None] [instance: 39e3dfb1-bc09-474d-b8cb-f01b11923eae] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:30:32 user nova-compute[71229]: DEBUG nova.compute.manager [req-53fdecbd-9d45-4782-90bd-306cf6eb9d94 req-c294972d-ae7a-43a0-b1ec-c94a8e77ce95 service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Received event network-vif-plugged-1ad8234a-3f96-43a0-9dea-862e6efcda73 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:30:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-53fdecbd-9d45-4782-90bd-306cf6eb9d94 req-c294972d-ae7a-43a0-b1ec-c94a8e77ce95 service nova] Acquiring lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:30:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-53fdecbd-9d45-4782-90bd-306cf6eb9d94 req-c294972d-ae7a-43a0-b1ec-c94a8e77ce95 service nova] Lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:30:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-53fdecbd-9d45-4782-90bd-306cf6eb9d94 req-c294972d-ae7a-43a0-b1ec-c94a8e77ce95 service nova] Lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:30:32 user nova-compute[71229]: DEBUG nova.compute.manager [req-53fdecbd-9d45-4782-90bd-306cf6eb9d94 req-c294972d-ae7a-43a0-b1ec-c94a8e77ce95 service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] No waiting events found dispatching network-vif-plugged-1ad8234a-3f96-43a0-9dea-862e6efcda73 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:30:32 user nova-compute[71229]: WARNING nova.compute.manager [req-53fdecbd-9d45-4782-90bd-306cf6eb9d94 req-c294972d-ae7a-43a0-b1ec-c94a8e77ce95 service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Received unexpected event network-vif-plugged-1ad8234a-3f96-43a0-9dea-862e6efcda73 for instance with vm_state deleted and task_state None.
Apr 11 15:30:32 user nova-compute[71229]: DEBUG nova.compute.manager [req-53fdecbd-9d45-4782-90bd-306cf6eb9d94 req-c294972d-ae7a-43a0-b1ec-c94a8e77ce95 service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Received event network-vif-plugged-1ad8234a-3f96-43a0-9dea-862e6efcda73 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:30:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-53fdecbd-9d45-4782-90bd-306cf6eb9d94 req-c294972d-ae7a-43a0-b1ec-c94a8e77ce95 service nova] Acquiring lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:30:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-53fdecbd-9d45-4782-90bd-306cf6eb9d94 req-c294972d-ae7a-43a0-b1ec-c94a8e77ce95 service nova] Lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:30:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-53fdecbd-9d45-4782-90bd-306cf6eb9d94 req-c294972d-ae7a-43a0-b1ec-c94a8e77ce95 service nova] Lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:30:32 user nova-compute[71229]: DEBUG nova.compute.manager [req-53fdecbd-9d45-4782-90bd-306cf6eb9d94 req-c294972d-ae7a-43a0-b1ec-c94a8e77ce95 service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] No waiting events found dispatching network-vif-plugged-1ad8234a-3f96-43a0-9dea-862e6efcda73 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:30:32 user nova-compute[71229]: WARNING nova.compute.manager [req-53fdecbd-9d45-4782-90bd-306cf6eb9d94 req-c294972d-ae7a-43a0-b1ec-c94a8e77ce95 service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Received unexpected event network-vif-plugged-1ad8234a-3f96-43a0-9dea-862e6efcda73 for instance with vm_state deleted and task_state None.
Apr 11 15:30:32 user nova-compute[71229]: DEBUG nova.compute.manager [req-53fdecbd-9d45-4782-90bd-306cf6eb9d94 req-c294972d-ae7a-43a0-b1ec-c94a8e77ce95 service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Received event network-vif-plugged-1ad8234a-3f96-43a0-9dea-862e6efcda73 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:30:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-53fdecbd-9d45-4782-90bd-306cf6eb9d94 req-c294972d-ae7a-43a0-b1ec-c94a8e77ce95 service nova] Acquiring lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:30:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-53fdecbd-9d45-4782-90bd-306cf6eb9d94 req-c294972d-ae7a-43a0-b1ec-c94a8e77ce95 service nova] Lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:30:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-53fdecbd-9d45-4782-90bd-306cf6eb9d94 req-c294972d-ae7a-43a0-b1ec-c94a8e77ce95 service nova] Lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:30:32 user nova-compute[71229]: DEBUG nova.compute.manager [req-53fdecbd-9d45-4782-90bd-306cf6eb9d94 req-c294972d-ae7a-43a0-b1ec-c94a8e77ce95 service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] No waiting events found dispatching network-vif-plugged-1ad8234a-3f96-43a0-9dea-862e6efcda73 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:30:32 user nova-compute[71229]: WARNING nova.compute.manager [req-53fdecbd-9d45-4782-90bd-306cf6eb9d94 req-c294972d-ae7a-43a0-b1ec-c94a8e77ce95 service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Received unexpected event network-vif-plugged-1ad8234a-3f96-43a0-9dea-862e6efcda73 for instance with vm_state deleted and task_state None.
Apr 11 15:30:32 user nova-compute[71229]: DEBUG nova.compute.manager [req-53fdecbd-9d45-4782-90bd-306cf6eb9d94 req-c294972d-ae7a-43a0-b1ec-c94a8e77ce95 service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Received event network-vif-unplugged-1ad8234a-3f96-43a0-9dea-862e6efcda73 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:30:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-53fdecbd-9d45-4782-90bd-306cf6eb9d94 req-c294972d-ae7a-43a0-b1ec-c94a8e77ce95 service nova] Acquiring lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:30:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-53fdecbd-9d45-4782-90bd-306cf6eb9d94 req-c294972d-ae7a-43a0-b1ec-c94a8e77ce95 service nova] Lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:30:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-53fdecbd-9d45-4782-90bd-306cf6eb9d94 req-c294972d-ae7a-43a0-b1ec-c94a8e77ce95 service nova] Lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:30:32 user nova-compute[71229]: DEBUG nova.compute.manager [req-53fdecbd-9d45-4782-90bd-306cf6eb9d94 req-c294972d-ae7a-43a0-b1ec-c94a8e77ce95 service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] No waiting events found dispatching network-vif-unplugged-1ad8234a-3f96-43a0-9dea-862e6efcda73 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:30:32 user nova-compute[71229]: WARNING nova.compute.manager [req-53fdecbd-9d45-4782-90bd-306cf6eb9d94 req-c294972d-ae7a-43a0-b1ec-c94a8e77ce95 service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Received unexpected event network-vif-unplugged-1ad8234a-3f96-43a0-9dea-862e6efcda73 for instance with vm_state deleted and task_state None.
Apr 11 15:30:32 user nova-compute[71229]: DEBUG nova.compute.manager [req-53fdecbd-9d45-4782-90bd-306cf6eb9d94 req-c294972d-ae7a-43a0-b1ec-c94a8e77ce95 service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Received event network-vif-plugged-1ad8234a-3f96-43a0-9dea-862e6efcda73 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:30:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-53fdecbd-9d45-4782-90bd-306cf6eb9d94 req-c294972d-ae7a-43a0-b1ec-c94a8e77ce95 service nova] Acquiring lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:30:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-53fdecbd-9d45-4782-90bd-306cf6eb9d94 req-c294972d-ae7a-43a0-b1ec-c94a8e77ce95 service nova] Lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:30:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-53fdecbd-9d45-4782-90bd-306cf6eb9d94 req-c294972d-ae7a-43a0-b1ec-c94a8e77ce95 service nova] Lock "1e01618b-2aa4-4b56-b1a2-0d6e25e3075d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:30:32 user nova-compute[71229]: DEBUG nova.compute.manager [req-53fdecbd-9d45-4782-90bd-306cf6eb9d94 req-c294972d-ae7a-43a0-b1ec-c94a8e77ce95 service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] No waiting events found dispatching network-vif-plugged-1ad8234a-3f96-43a0-9dea-862e6efcda73 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:30:32 user nova-compute[71229]: WARNING nova.compute.manager [req-53fdecbd-9d45-4782-90bd-306cf6eb9d94 req-c294972d-ae7a-43a0-b1ec-c94a8e77ce95 service nova] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Received unexpected event network-vif-plugged-1ad8234a-3f96-43a0-9dea-862e6efcda73 for instance with vm_state deleted and task_state None.
Apr 11 15:30:35 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:40 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "d534d17d-ba77-4447-8a63-7d6021ad7896" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:30:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "d534d17d-ba77-4447-8a63-7d6021ad7896" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:30:41 user nova-compute[71229]: DEBUG nova.objects.instance [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lazy-loading 'flavor' on Instance uuid d534d17d-ba77-4447-8a63-7d6021ad7896 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:30:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "d534d17d-ba77-4447-8a63-7d6021ad7896" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:30:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "d534d17d-ba77-4447-8a63-7d6021ad7896" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:30:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "d534d17d-ba77-4447-8a63-7d6021ad7896" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:30:41 user nova-compute[71229]: INFO nova.compute.manager [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Attaching volume 97b66671-5188-4023-ba8c-6eaf24dae749 to /dev/vdb
Apr 11 15:30:41 user nova-compute[71229]: DEBUG os_brick.utils [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:30:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:41 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b2c2e2-7b02-49f4-b000-dc487d743447]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d55e24a97c90\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:41 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[accd506f-b511-46b3-b780-a60c9a83d1c3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:41 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee2480a-091f-45d2-9497-3e6d417fba16]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:41 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d78f46a-2aa5-400f-9e63-d76a492a1525]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Running cmd (subprocess): nvme version {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] 'nvme version' failed. Not Retrying. {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:30:41 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] nvme not present on system {{(pid=71229) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 15:30:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:30:41 user nova-compute[71229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 15:30:41 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fb4751-81f7-4b02-8b33-b430c4142c57]: (4, '') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:41 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71229) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 15:30:41 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 15:30:41 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] LIGHTOS: no hostnqn found. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 15:30:41 user nova-compute[71229]: DEBUG os_brick.utils [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d55e24a97c90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:30:41 user nova-compute[71229]: DEBUG nova.virt.block_device [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Updating existing volume attachment record: ca414fba-cb5c-4a79-b74f-5df244509041 {{(pid=71229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 15:30:45 user nova-compute[71229]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681227030.68522, 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d => Stopped> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:30:45 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] VM Stopped (Lifecycle Event)
Apr 11 15:30:45 user nova-compute[71229]: DEBUG nova.compute.manager [None req-d136872a-b645-4eec-b95b-b00ba2615f39 None None] [instance: 1e01618b-2aa4-4b56-b1a2-0d6e25e3075d] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:30:45 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:45 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 15:30:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:97b66671-5188-4023-ba8c-6eaf24dae749', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BAaPySoM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:30:45 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:30:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:30:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:30:45 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:30:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97b66671-5188-4023-ba8c-6eaf24dae749" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:30:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97b66671-5188-4023-ba8c-6eaf24dae749" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:30:45 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 15:30:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97b66671-5188-4023-ba8c-6eaf24dae749 -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97b66671-5188-4023-ba8c-6eaf24dae749 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:45 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[19473da6-0dd4-44a9-9501-f02399af16e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 15:30:45 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:30:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97b66671-5188-4023-ba8c-6eaf24dae749 -p 172.16.0.220:3260 --interface default --op new {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97b66671-5188-4023-ba8c-6eaf24dae749 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:45 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[235a3f93-df5a-4b2c-a841-b5ffb56051b5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97b66671-5188-4023-ba8c-6eaf24dae749] added\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97b66671-5188-4023-ba8c-6eaf24dae749] added
Apr 11 15:30:45 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:30:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97b66671-5188-4023-ba8c-6eaf24dae749 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97b66671-5188-4023-ba8c-6eaf24dae749 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:45 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[065db310-cbc4-4b7a-8d91-4b99fb8fc7c3]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:30:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97b66671-5188-4023-ba8c-6eaf24dae749 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97b66671-5188-4023-ba8c-6eaf24dae749 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:45 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2f3357-9268-4094-b03a-edd3f33751ff]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:30:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97b66671-5188-4023-ba8c-6eaf24dae749 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BAaPySoM {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97b66671-5188-4023-ba8c-6eaf24dae749 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BAaPySoM" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:45 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d66875-c698-4841-983e-9571154fe450]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BAaPySoM'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:30:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97b66671-5188-4023-ba8c-6eaf24dae749 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97b66671-5188-4023-ba8c-6eaf24dae749 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:45 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33406b6-5bb0-4667-9baa-50941d69e0f4]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:30:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:45 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db5b0d9-8a6d-427b-bf70-592556982c5c]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:30:45 user nova-compute[71229]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:30:45 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:30:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:30:45 user nova-compute[71229]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:30:45 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:30:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97b66671-5188-4023-ba8c-6eaf24dae749 -p 172.16.0.220:3260 --login {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:46 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97b66671-5188-4023-ba8c-6eaf24dae749 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:46 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0f99c7-0a8b-4f89-b171-56ad79d9a9e1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:97b66671-5188-4023-ba8c-6eaf24dae749, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:97b66671-5188-4023-ba8c-6eaf24dae749, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:46 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:97b66671-5188-4023-ba8c-6eaf24dae749, portal: 172.16.0.220,3260]
Apr 11 15:30:46 user nova-compute[71229]: Login to [iface: default, target: iqn.2010-10.org.openstack:97b66671-5188-4023-ba8c-6eaf24dae749, portal: 172.16.0.220,3260] successful.
Apr 11 15:30:46 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:30:46 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97b66671-5188-4023-ba8c-6eaf24dae749 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:46 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97b66671-5188-4023-ba8c-6eaf24dae749 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:46 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[31014493-beae-4be7-b5d7-222e54673fe3]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:46 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:30:46 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:46 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:46 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d2abe9-2692-40b6-9899-be2a7c3b855d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b66671-5188-4023-ba8c-6eaf24dae749 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:46 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:30:46 user nova-compute[71229]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:30:46 user nova-compute[71229]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b66671-5188-4023-ba8c-6eaf24dae749 (non-flash)
Apr 11 15:30:46 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:30:46 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:30:46 user nova-compute[71229]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:30:46 user nova-compute[71229]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b66671-5188-4023-ba8c-6eaf24dae749 (non-flash)
Apr 11 15:30:46 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:30:46 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97b66671-5188-4023-ba8c-6eaf24dae749" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:30:46 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 15:30:46 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 15:30:46 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 15:30:46 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:46 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:46 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0330f6-999e-40cc-9192-1d0e8fb2cd1e]: (4, ('- - 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:46 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: None {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:30:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:47 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:30:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:97b66671-5188-4023-ba8c-6eaf24dae749', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BAaPySoM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 15:30:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:30:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '26235636234653866', 'path': '/dev/sdd'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:30:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235636234653866', 'path': '/dev/sdd'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 15:30:47 user nova-compute[71229]: DEBUG nova.objects.instance [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lazy-loading 'flavor' on Instance uuid d534d17d-ba77-4447-8a63-7d6021ad7896 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:30:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 15:30:47 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:30:47 user nova-compute[71229]:   <source dev="/dev/sdd"/>
Apr 11 15:30:47 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 15:30:47 user nova-compute[71229]:   <serial>97b66671-5188-4023-ba8c-6eaf24dae749</serial>
Apr 11 15:30:47 user nova-compute[71229]: </disk>
Apr 11 15:30:47 user nova-compute[71229]:  {{(pid=71229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 15:30:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:30:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:30:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] No VIF found with MAC fa:16:3e:61:6a:d2, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:30:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-7a8e4ad5-90e1-4fba-a71a-4d7e0d759e91 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "d534d17d-ba77-4447-8a63-7d6021ad7896" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 5.931s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:30:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ad95a5d9-d004-48b5-9779-c1de226a757d tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "d534d17d-ba77-4447-8a63-7d6021ad7896" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:30:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ad95a5d9-d004-48b5-9779-c1de226a757d tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "d534d17d-ba77-4447-8a63-7d6021ad7896" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:30:48 user nova-compute[71229]: INFO nova.compute.manager [None req-ad95a5d9-d004-48b5-9779-c1de226a757d tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Detaching volume 97b66671-5188-4023-ba8c-6eaf24dae749
Apr 11 15:30:48 user nova-compute[71229]: INFO nova.virt.block_device [None req-ad95a5d9-d004-48b5-9779-c1de226a757d tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Attempting to driver detach volume 97b66671-5188-4023-ba8c-6eaf24dae749 from mountpoint /dev/vdb
Apr 11 15:30:48 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-ad95a5d9-d004-48b5-9779-c1de226a757d tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Attempting to detach device vdb from instance d534d17d-ba77-4447-8a63-7d6021ad7896 from the persistent domain config. {{(pid=71229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 15:30:48 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-ad95a5d9-d004-48b5-9779-c1de226a757d tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 15:30:48 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:30:48 user nova-compute[71229]:   <source dev="/dev/sdd"/>
Apr 11 15:30:48 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 15:30:48 user nova-compute[71229]:   <serial>97b66671-5188-4023-ba8c-6eaf24dae749</serial>
Apr 11 15:30:48 user nova-compute[71229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 15:30:48 user nova-compute[71229]: </disk>
Apr 11 15:30:48 user nova-compute[71229]:  {{(pid=71229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 15:30:48 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-ad95a5d9-d004-48b5-9779-c1de226a757d tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Successfully detached device vdb from instance d534d17d-ba77-4447-8a63-7d6021ad7896 from the persistent domain config.
Apr 11 15:30:48 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-ad95a5d9-d004-48b5-9779-c1de226a757d tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d534d17d-ba77-4447-8a63-7d6021ad7896 from the live domain config. {{(pid=71229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 15:30:48 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-ad95a5d9-d004-48b5-9779-c1de226a757d tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 15:30:48 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:30:48 user nova-compute[71229]:   <source dev="/dev/sdd"/>
Apr 11 15:30:48 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 15:30:48 user nova-compute[71229]:   <serial>97b66671-5188-4023-ba8c-6eaf24dae749</serial>
Apr 11 15:30:48 user nova-compute[71229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 15:30:48 user nova-compute[71229]: </disk>
Apr 11 15:30:48 user nova-compute[71229]:  {{(pid=71229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 15:30:49 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Received event <DeviceRemovedEvent: 1681227049.3714902, d534d17d-ba77-4447-8a63-7d6021ad7896 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71229) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 15:30:49 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-ad95a5d9-d004-48b5-9779-c1de226a757d tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d534d17d-ba77-4447-8a63-7d6021ad7896 {{(pid=71229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 15:30:49 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-ad95a5d9-d004-48b5-9779-c1de226a757d tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Successfully detached device vdb from instance d534d17d-ba77-4447-8a63-7d6021ad7896 from the live domain config.
Apr 11 15:30:49 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad95a5d9-d004-48b5-9779-c1de226a757d tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 15:30:49 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad95a5d9-d004-48b5-9779-c1de226a757d tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:97b66671-5188-4023-ba8c-6eaf24dae749', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BAaPySoM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:30:49 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-ad95a5d9-d004-48b5-9779-c1de226a757d tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:30:49 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-ad95a5d9-d004-48b5-9779-c1de226a757d tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:30:49 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-ad95a5d9-d004-48b5-9779-c1de226a757d tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:30:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:49 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[71fe1a6c-180a-4fa4-866b-2a82aac300ab]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97b66671-5188-4023-ba8c-6eaf24dae749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:49 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad95a5d9-d004-48b5-9779-c1de226a757d tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 15:30:49 user nova-compute[71229]: No targets found.
Apr 11 15:30:49 user nova-compute[71229]: iSNS:
Apr 11 15:30:49 user nova-compute[71229]: No targets found.
Apr 11 15:30:49 user nova-compute[71229]: STATIC:
Apr 11 15:30:49 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb
Apr 11 15:30:49 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:30:49 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:30:49 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2
Apr 11 15:30:49 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:30:49 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:30:49 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:97b66671-5188-4023-ba8c-6eaf24dae749
Apr 11 15:30:49 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:30:49 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:30:49 user nova-compute[71229]: FIRMWARE:
Apr 11 15:30:49 user nova-compute[71229]: No targets found.
Apr 11 15:30:49 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:30:49 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad95a5d9-d004-48b5-9779-c1de226a757d tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 15:30:49 user nova-compute[71229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 15:30:49 user nova-compute[71229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71229) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 15:30:49 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad95a5d9-d004-48b5-9779-c1de226a757d tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97b66671-5188-4023-ba8c-6eaf24dae749', 0)] {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 15:30:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:49 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[001095c2-2939-4862-b51e-db778310d9a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97b66671-5188-4023-ba8c-6eaf24dae749\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:49 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dfdd887-3252-4910-8083-e8b9c7df3d67]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b66671-5188-4023-ba8c-6eaf24dae749 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:49 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad95a5d9-d004-48b5-9779-c1de226a757d tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:30:49 user nova-compute[71229]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:30:49 user nova-compute[71229]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b66671-5188-4023-ba8c-6eaf24dae749 (non-flash)
Apr 11 15:30:49 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:30:49 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad95a5d9-d004-48b5-9779-c1de226a757d tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:30:49 user nova-compute[71229]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:30:49 user nova-compute[71229]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97b66671-5188-4023-ba8c-6eaf24dae749 (non-flash)
Apr 11 15:30:49 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:30:49 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad95a5d9-d004-48b5-9779-c1de226a757d tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb64306f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97b66671-5188-4023-ba8c-6eaf24dae749'): ({'sdd'}, set())}) {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 15:30:49 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-ad95a5d9-d004-48b5-9779-c1de226a757d tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Removing single pathed devices sdd {{(pid=71229) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 15:30:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:49 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfa4093-27a7-427e-9b7f-ccc2abe59fd4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:49 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[088a1423-6cd8-46fc-9a68-9a05f565976b]: (4, ('ok\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:49 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-ad95a5d9-d004-48b5-9779-c1de226a757d tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Flushing IO for device /dev/sdd {{(pid=71229) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 15:30:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:49 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d25b8d-3eca-44a7-b3c0-65993f04c10d]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:49 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-ad95a5d9-d004-48b5-9779-c1de226a757d tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71229) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 15:30:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:49 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcbd0ed9-92ec-40db-8387-03e54f6d6953]: (4, ('1', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:49 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-ad95a5d9-d004-48b5-9779-c1de226a757d tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 15:30:49 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-ad95a5d9-d004-48b5-9779-c1de226a757d tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] SCSI volumes sdd have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 15:30:49 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad95a5d9-d004-48b5-9779-c1de226a757d tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97b66671-5188-4023-ba8c-6eaf24dae749')] {{(pid=71229) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 15:30:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97b66671-5188-4023-ba8c-6eaf24dae749 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97b66671-5188-4023-ba8c-6eaf24dae749 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:49 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fedd5a-31b3-4fdb-a788-3fb4083fa638]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:49 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad95a5d9-d004-48b5-9779-c1de226a757d tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:30:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97b66671-5188-4023-ba8c-6eaf24dae749 -p 172.16.0.220:3260 --logout {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97b66671-5188-4023-ba8c-6eaf24dae749 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:49 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[998723ae-faf6-4bc5-82b2-df975b086d95]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:97b66671-5188-4023-ba8c-6eaf24dae749, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:97b66671-5188-4023-ba8c-6eaf24dae749, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:49 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad95a5d9-d004-48b5-9779-c1de226a757d tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:97b66671-5188-4023-ba8c-6eaf24dae749, portal: 172.16.0.220,3260]
Apr 11 15:30:49 user nova-compute[71229]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:97b66671-5188-4023-ba8c-6eaf24dae749, portal: 172.16.0.220,3260] successful.
Apr 11 15:30:49 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:30:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97b66671-5188-4023-ba8c-6eaf24dae749 -p 172.16.0.220:3260 --op delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97b66671-5188-4023-ba8c-6eaf24dae749 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:49 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e27e70-ad15-4502-9561-f3e21e02dd19]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:30:49 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad95a5d9-d004-48b5-9779-c1de226a757d tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:30:49 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-ad95a5d9-d004-48b5-9779-c1de226a757d tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:30:49 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad95a5d9-d004-48b5-9779-c1de226a757d tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] <== disconnect_volume: return (311ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:30:49 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad95a5d9-d004-48b5-9779-c1de226a757d tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 15:30:50 user nova-compute[71229]: DEBUG nova.objects.instance [None req-ad95a5d9-d004-48b5-9779-c1de226a757d tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lazy-loading 'flavor' on Instance uuid d534d17d-ba77-4447-8a63-7d6021ad7896 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:30:50 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ad95a5d9-d004-48b5-9779-c1de226a757d tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "d534d17d-ba77-4447-8a63-7d6021ad7896" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.633s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:30:50 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:51 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:55 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:30:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:30:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:30:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:30:55 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 15:30:55 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:56 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:30:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d534d17d-ba77-4447-8a63-7d6021ad7896/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d534d17d-ba77-4447-8a63-7d6021ad7896/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d534d17d-ba77-4447-8a63-7d6021ad7896/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:30:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d534d17d-ba77-4447-8a63-7d6021ad7896/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4555892-7abb-4a3c-a4ae-a27ad4902708/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4555892-7abb-4a3c-a4ae-a27ad4902708/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4555892-7abb-4a3c-a4ae-a27ad4902708/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4555892-7abb-4a3c-a4ae-a27ad4902708/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:30:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:30:57 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:30:58 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:30:58 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:30:58 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8168MB free_disk=26.162086486816406GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 15:30:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:30:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:30:58 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Applying migration context for instance 6a805345-374c-4326-9e8f-39bfc7947a35 as it has an incoming, in-progress migration 61539203-b1fe-440c-9138-018e0db6e179. Migration status is finished {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 11 15:30:58 user nova-compute[71229]: INFO nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Updating resource usage from migration 61539203-b1fe-440c-9138-018e0db6e179
Apr 11 15:30:58 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance de1a45fd-27be-4438-80a4-2f3a100643c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:30:58 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance b0d90fd2-6a95-43c4-8756-e82071d99154 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:30:58 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance e4555892-7abb-4a3c-a4ae-a27ad4902708 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:30:58 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance d534d17d-ba77-4447-8a63-7d6021ad7896 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:30:58 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:30:58 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 7c4329ae-07cb-4f28-9fd6-29b398517d2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:30:58 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Migration 61539203-b1fe-440c-9138-018e0db6e179 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 11 15:30:58 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 6a805345-374c-4326-9e8f-39bfc7947a35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:30:58 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 15:30:58 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=1600MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 15:30:58 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:30:58 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:30:58 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 15:30:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.390s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:30:59 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:30:59 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:30:59 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:30:59 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:30:59 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 15:30:59 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:31:00 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:31:00 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:31:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:01 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:31:01 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 15:31:01 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Didn't find any instances for network info cache update. {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 15:31:01 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:31:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:31:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 15:31:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 15:31:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 15:31:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:09 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:10 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-09dbd3b1-7e98-4410-807a-f14ae0087764 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Acquiring lock "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:31:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-09dbd3b1-7e98-4410-807a-f14ae0087764 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:31:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-09dbd3b1-7e98-4410-807a-f14ae0087764 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Acquiring lock "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:31:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-09dbd3b1-7e98-4410-807a-f14ae0087764 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:31:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-09dbd3b1-7e98-4410-807a-f14ae0087764 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:31:13 user nova-compute[71229]: INFO nova.compute.manager [None req-09dbd3b1-7e98-4410-807a-f14ae0087764 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Terminating instance
Apr 11 15:31:13 user nova-compute[71229]: DEBUG nova.compute.manager [None req-09dbd3b1-7e98-4410-807a-f14ae0087764 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Start destroying the instance on the hypervisor. {{(pid=71229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 15:31:13 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:13 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:13 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:13 user nova-compute[71229]: DEBUG nova.compute.manager [req-29bbd806-9920-46c6-992a-52a51615d2e9 req-c9fb219b-234f-4051-972c-445c69212283 service nova] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Received event network-vif-unplugged-40f1797d-278c-4676-8413-3b0c0f113dd9 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:31:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-29bbd806-9920-46c6-992a-52a51615d2e9 req-c9fb219b-234f-4051-972c-445c69212283 service nova] Acquiring lock "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:31:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-29bbd806-9920-46c6-992a-52a51615d2e9 req-c9fb219b-234f-4051-972c-445c69212283 service nova] Lock "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:31:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-29bbd806-9920-46c6-992a-52a51615d2e9 req-c9fb219b-234f-4051-972c-445c69212283 service nova] Lock "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:31:13 user nova-compute[71229]: DEBUG nova.compute.manager [req-29bbd806-9920-46c6-992a-52a51615d2e9 req-c9fb219b-234f-4051-972c-445c69212283 service nova] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] No waiting events found dispatching network-vif-unplugged-40f1797d-278c-4676-8413-3b0c0f113dd9 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:31:13 user nova-compute[71229]: DEBUG nova.compute.manager [req-29bbd806-9920-46c6-992a-52a51615d2e9 req-c9fb219b-234f-4051-972c-445c69212283 service nova] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Received event network-vif-unplugged-40f1797d-278c-4676-8413-3b0c0f113dd9 for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 15:31:14 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Instance destroyed successfully.
Apr 11 15:31:14 user nova-compute[71229]: DEBUG nova.objects.instance [None req-09dbd3b1-7e98-4410-807a-f14ae0087764 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lazy-loading 'resources' on Instance uuid 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:31:14 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-09dbd3b1-7e98-4410-807a-f14ae0087764 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T15:28:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-982441201',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-982441201',id=19,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQhnP1Gx1ErLuuEevJpV94XRpvcJAoAfxD6RZqXP7Kvn0H8XePF/x7sWzG5H5vtetd0gs+rS/bMxjK4Qz9b0uYhYgbQvD0DmjSlBMXC1CeKAiMrjjZNT7Keb43XJ65W+w==',key_name='tempest-keypair-1011126544',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:28:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='82dec4b679f24d1e85b1105b4849cddd',ramdisk_id='',reservation_id='r-izovbhtx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-727930312',owner_user_name='tempest-TaggedAttachmentsTest-727930312-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:28:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f32986358bcc4148ad3f361e3944ed81',uuid=1424f1ff-6c0f-4f9a-bddc-6c448a768a7a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "40f1797d-278c-4676-8413-3b0c0f113dd9", "address": "fa:16:3e:05:3e:4e", "network": {"id": "921b7e62-65aa-426c-9286-8b31b88588a8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1464327252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82dec4b679f24d1e85b1105b4849cddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40f1797d-27", "ovs_interfaceid": "40f1797d-278c-4676-8413-3b0c0f113dd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:31:14 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-09dbd3b1-7e98-4410-807a-f14ae0087764 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Converting VIF {"id": "40f1797d-278c-4676-8413-3b0c0f113dd9", "address": "fa:16:3e:05:3e:4e", "network": {"id": "921b7e62-65aa-426c-9286-8b31b88588a8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1464327252-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82dec4b679f24d1e85b1105b4849cddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40f1797d-27", "ovs_interfaceid": "40f1797d-278c-4676-8413-3b0c0f113dd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:31:14 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-09dbd3b1-7e98-4410-807a-f14ae0087764 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:3e:4e,bridge_name='br-int',has_traffic_filtering=True,id=40f1797d-278c-4676-8413-3b0c0f113dd9,network=Network(921b7e62-65aa-426c-9286-8b31b88588a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40f1797d-27') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:31:14 user nova-compute[71229]: DEBUG os_vif [None req-09dbd3b1-7e98-4410-807a-f14ae0087764 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:3e:4e,bridge_name='br-int',has_traffic_filtering=True,id=40f1797d-278c-4676-8413-3b0c0f113dd9,network=Network(921b7e62-65aa-426c-9286-8b31b88588a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40f1797d-27') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:31:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap40f1797d-27, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:31:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:31:14 user nova-compute[71229]: INFO os_vif [None req-09dbd3b1-7e98-4410-807a-f14ae0087764 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:3e:4e,bridge_name='br-int',has_traffic_filtering=True,id=40f1797d-278c-4676-8413-3b0c0f113dd9,network=Network(921b7e62-65aa-426c-9286-8b31b88588a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40f1797d-27')
Apr 11 15:31:14 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-09dbd3b1-7e98-4410-807a-f14ae0087764 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Deleting instance files /opt/stack/data/nova/instances/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a_del
Apr 11 15:31:14 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-09dbd3b1-7e98-4410-807a-f14ae0087764 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Deletion of /opt/stack/data/nova/instances/1424f1ff-6c0f-4f9a-bddc-6c448a768a7a_del complete
Apr 11 15:31:14 user nova-compute[71229]: INFO nova.compute.manager [None req-09dbd3b1-7e98-4410-807a-f14ae0087764 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 11 15:31:14 user nova-compute[71229]: DEBUG oslo.service.loopingcall [None req-09dbd3b1-7e98-4410-807a-f14ae0087764 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71229) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 15:31:14 user nova-compute[71229]: DEBUG nova.compute.manager [-] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Deallocating network for instance {{(pid=71229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 15:31:14 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] deallocate_for_instance() {{(pid=71229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 15:31:15 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:31:15 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Took 1.38 seconds to deallocate network for instance.
Apr 11 15:31:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-09dbd3b1-7e98-4410-807a-f14ae0087764 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:31:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-09dbd3b1-7e98-4410-807a-f14ae0087764 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:31:15 user nova-compute[71229]: DEBUG nova.compute.manager [req-d05737fe-cede-4711-9fd0-5ce3f651f9c2 req-d957adad-cb94-4390-8a1d-f0035c96414d service nova] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Received event network-vif-deleted-40f1797d-278c-4676-8413-3b0c0f113dd9 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:31:15 user nova-compute[71229]: DEBUG nova.compute.manager [req-920e4c32-4d72-4756-a68a-e64abd2040dc req-6f67f7a8-7106-4d9f-814d-c9b3bd59bdd2 service nova] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Received event network-vif-plugged-40f1797d-278c-4676-8413-3b0c0f113dd9 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:31:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-920e4c32-4d72-4756-a68a-e64abd2040dc req-6f67f7a8-7106-4d9f-814d-c9b3bd59bdd2 service nova] Acquiring lock "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:31:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-920e4c32-4d72-4756-a68a-e64abd2040dc req-6f67f7a8-7106-4d9f-814d-c9b3bd59bdd2 service nova] Lock "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:31:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-920e4c32-4d72-4756-a68a-e64abd2040dc req-6f67f7a8-7106-4d9f-814d-c9b3bd59bdd2 service nova] Lock "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:31:15 user nova-compute[71229]: DEBUG nova.compute.manager [req-920e4c32-4d72-4756-a68a-e64abd2040dc req-6f67f7a8-7106-4d9f-814d-c9b3bd59bdd2 service nova] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] No waiting events found dispatching network-vif-plugged-40f1797d-278c-4676-8413-3b0c0f113dd9 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:31:15 user nova-compute[71229]: WARNING nova.compute.manager [req-920e4c32-4d72-4756-a68a-e64abd2040dc req-6f67f7a8-7106-4d9f-814d-c9b3bd59bdd2 service nova] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Received unexpected event network-vif-plugged-40f1797d-278c-4676-8413-3b0c0f113dd9 for instance with vm_state deleted and task_state None.
Apr 11 15:31:16 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-09dbd3b1-7e98-4410-807a-f14ae0087764 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:31:16 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-09dbd3b1-7e98-4410-807a-f14ae0087764 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:31:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-09dbd3b1-7e98-4410-807a-f14ae0087764 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.279s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:31:16 user nova-compute[71229]: INFO nova.scheduler.client.report [None req-09dbd3b1-7e98-4410-807a-f14ae0087764 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Deleted allocations for instance 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a
Apr 11 15:31:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-09dbd3b1-7e98-4410-807a-f14ae0087764 tempest-TaggedAttachmentsTest-727930312 tempest-TaggedAttachmentsTest-727930312-project-member] Lock "1424f1ff-6c0f-4f9a-bddc-6c448a768a7a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.706s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:31:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:18 user nova-compute[71229]: DEBUG nova.compute.manager [None req-c064bc88-d768-44cd-8046-4a3e7a777df5 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:31:18 user nova-compute[71229]: INFO nova.compute.manager [None req-c064bc88-d768-44cd-8046-4a3e7a777df5 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] instance snapshotting
Apr 11 15:31:18 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-c064bc88-d768-44cd-8046-4a3e7a777df5 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Beginning live snapshot process
Apr 11 15:31:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-c064bc88-d768-44cd-8046-4a3e7a777df5 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b/disk --force-share --output=json -f qcow2 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:19 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-c064bc88-d768-44cd-8046-4a3e7a777df5 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b/disk --force-share --output=json -f qcow2" returned: 0 in 0.137s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:19 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-c064bc88-d768-44cd-8046-4a3e7a777df5 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b/disk --force-share --output=json -f qcow2 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:19 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-c064bc88-d768-44cd-8046-4a3e7a777df5 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b/disk --force-share --output=json -f qcow2" returned: 0 in 0.139s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:19 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-c064bc88-d768-44cd-8046-4a3e7a777df5 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:19 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:19 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-c064bc88-d768-44cd-8046-4a3e7a777df5 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.137s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:19 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-c064bc88-d768-44cd-8046-4a3e7a777df5 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmprqei9m7b/646ff944f81745268a146c6c5e30698d.delta 1073741824 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:19 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-c064bc88-d768-44cd-8046-4a3e7a777df5 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmprqei9m7b/646ff944f81745268a146c6c5e30698d.delta 1073741824" returned: 0 in 0.051s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:19 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-c064bc88-d768-44cd-8046-4a3e7a777df5 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 11 15:31:20 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-c064bc88-d768-44cd-8046-4a3e7a777df5 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71229) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 15:31:20 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-c064bc88-d768-44cd-8046-4a3e7a777df5 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71229) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 15:31:20 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-c064bc88-d768-44cd-8046-4a3e7a777df5 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 11 15:31:20 user nova-compute[71229]: DEBUG nova.privsep.utils [None req-c064bc88-d768-44cd-8046-4a3e7a777df5 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71229) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 15:31:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-c064bc88-d768-44cd-8046-4a3e7a777df5 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmprqei9m7b/646ff944f81745268a146c6c5e30698d.delta /opt/stack/data/nova/instances/snapshots/tmprqei9m7b/646ff944f81745268a146c6c5e30698d {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:21 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-c064bc88-d768-44cd-8046-4a3e7a777df5 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmprqei9m7b/646ff944f81745268a146c6c5e30698d.delta /opt/stack/data/nova/instances/snapshots/tmprqei9m7b/646ff944f81745268a146c6c5e30698d" returned: 0 in 0.535s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:21 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-c064bc88-d768-44cd-8046-4a3e7a777df5 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Snapshot extracted, beginning image upload
Apr 11 15:31:21 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:24 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-c064bc88-d768-44cd-8046-4a3e7a777df5 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Snapshot image upload complete
Apr 11 15:31:24 user nova-compute[71229]: INFO nova.compute.manager [None req-c064bc88-d768-44cd-8046-4a3e7a777df5 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Took 5.42 seconds to snapshot the instance on the hypervisor.
Apr 11 15:31:24 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ffc25fc1-e59f-42c8-a371-b4b12e17fd59" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:31:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ffc25fc1-e59f-42c8-a371-b4b12e17fd59" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:31:25 user nova-compute[71229]: DEBUG nova.compute.manager [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Starting instance... {{(pid=71229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 15:31:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:31:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:31:25 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 15:31:25 user nova-compute[71229]: INFO nova.compute.claims [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Claim successful on node user
Apr 11 15:31:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:25 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:31:25 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:31:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.362s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:31:25 user nova-compute[71229]: DEBUG nova.compute.manager [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Start building networks asynchronously for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 15:31:26 user nova-compute[71229]: DEBUG nova.compute.manager [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Allocating IP information in the background. {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 15:31:26 user nova-compute[71229]: DEBUG nova.network.neutron [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] allocate_for_instance() {{(pid=71229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 15:31:26 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 15:31:26 user nova-compute[71229]: DEBUG nova.compute.manager [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Start building block device mappings for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 15:31:26 user nova-compute[71229]: DEBUG nova.policy [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '88d988d9ce0a41669b7c487ac07b4cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b9b79fb98441fd9f1b5df54471f0bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71229) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 15:31:26 user nova-compute[71229]: DEBUG nova.compute.manager [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Start spawning the instance on the hypervisor. {{(pid=71229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 15:31:26 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Creating instance directory {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 15:31:26 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Creating image(s)
Apr 11 15:31:26 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "/opt/stack/data/nova/instances/ffc25fc1-e59f-42c8-a371-b4b12e17fd59/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:31:26 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "/opt/stack/data/nova/instances/ffc25fc1-e59f-42c8-a371-b4b12e17fd59/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:31:26 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "/opt/stack/data/nova/instances/ffc25fc1-e59f-42c8-a371-b4b12e17fd59/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:31:26 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:26 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.147s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:26 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:31:26 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:31:26 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:26 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.142s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:26 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/ffc25fc1-e59f-42c8-a371-b4b12e17fd59/disk 1073741824 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:26 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/ffc25fc1-e59f-42c8-a371-b4b12e17fd59/disk 1073741824" returned: 0 in 0.050s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:26 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:31:26 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:26 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.151s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:26 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ffc25fc1-e59f-42c8-a371-b4b12e17fd59/disk. size=1073741824 {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 15:31:26 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc25fc1-e59f-42c8-a371-b4b12e17fd59/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:26 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc25fc1-e59f-42c8-a371-b4b12e17fd59/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:26 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Cannot resize image /opt/stack/data/nova/instances/ffc25fc1-e59f-42c8-a371-b4b12e17fd59/disk to a smaller size. {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 15:31:26 user nova-compute[71229]: DEBUG nova.objects.instance [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lazy-loading 'migration_context' on Instance uuid ffc25fc1-e59f-42c8-a371-b4b12e17fd59 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:31:26 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Created local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 15:31:26 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Ensure instance console log exists: /opt/stack/data/nova/instances/ffc25fc1-e59f-42c8-a371-b4b12e17fd59/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 15:31:26 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:31:26 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:31:26 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:31:26 user nova-compute[71229]: DEBUG nova.network.neutron [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Successfully created port: 3ae0cd28-c459-47b7-be17-133b69773f9c {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 15:31:27 user nova-compute[71229]: DEBUG nova.network.neutron [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Successfully updated port: 3ae0cd28-c459-47b7-be17-133b69773f9c {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:31:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "refresh_cache-ffc25fc1-e59f-42c8-a371-b4b12e17fd59" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:31:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquired lock "refresh_cache-ffc25fc1-e59f-42c8-a371-b4b12e17fd59" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:31:27 user nova-compute[71229]: DEBUG nova.network.neutron [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:31:27 user nova-compute[71229]: DEBUG nova.compute.manager [req-23b29f8b-9e03-4e9c-982f-f09f393f46fb req-cf57247b-1e28-4904-b470-6bf3a19bdf32 service nova] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Received event network-changed-3ae0cd28-c459-47b7-be17-133b69773f9c {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:31:27 user nova-compute[71229]: DEBUG nova.compute.manager [req-23b29f8b-9e03-4e9c-982f-f09f393f46fb req-cf57247b-1e28-4904-b470-6bf3a19bdf32 service nova] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Refreshing instance network info cache due to event network-changed-3ae0cd28-c459-47b7-be17-133b69773f9c. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:31:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-23b29f8b-9e03-4e9c-982f-f09f393f46fb req-cf57247b-1e28-4904-b470-6bf3a19bdf32 service nova] Acquiring lock "refresh_cache-ffc25fc1-e59f-42c8-a371-b4b12e17fd59" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:31:27 user nova-compute[71229]: DEBUG nova.network.neutron [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:31:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:28 user nova-compute[71229]: DEBUG nova.network.neutron [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Updating instance_info_cache with network_info: [{"id": "3ae0cd28-c459-47b7-be17-133b69773f9c", "address": "fa:16:3e:b9:69:19", "network": {"id": "15a1a586-0100-4057-8501-5c5a282d4063", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834988552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b9b79fb98441fd9f1b5df54471f0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae0cd28-c4", "ovs_interfaceid": "3ae0cd28-c459-47b7-be17-133b69773f9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:31:28 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Releasing lock "refresh_cache-ffc25fc1-e59f-42c8-a371-b4b12e17fd59" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:31:28 user nova-compute[71229]: DEBUG nova.compute.manager [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Instance network_info: |[{"id": "3ae0cd28-c459-47b7-be17-133b69773f9c", "address": "fa:16:3e:b9:69:19", "network": {"id": "15a1a586-0100-4057-8501-5c5a282d4063", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834988552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b9b79fb98441fd9f1b5df54471f0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae0cd28-c4", "ovs_interfaceid": "3ae0cd28-c459-47b7-be17-133b69773f9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 15:31:28 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-23b29f8b-9e03-4e9c-982f-f09f393f46fb req-cf57247b-1e28-4904-b470-6bf3a19bdf32 service nova] Acquired lock "refresh_cache-ffc25fc1-e59f-42c8-a371-b4b12e17fd59" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:31:28 user nova-compute[71229]: DEBUG nova.network.neutron [req-23b29f8b-9e03-4e9c-982f-f09f393f46fb req-cf57247b-1e28-4904-b470-6bf3a19bdf32 service nova] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Refreshing network info cache for port 3ae0cd28-c459-47b7-be17-133b69773f9c {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:31:28 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Start _get_guest_xml network_info=[{"id": "3ae0cd28-c459-47b7-be17-133b69773f9c", "address": "fa:16:3e:b9:69:19", "network": {"id": "15a1a586-0100-4057-8501-5c5a282d4063", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834988552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b9b79fb98441fd9f1b5df54471f0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae0cd28-c4", "ovs_interfaceid": "3ae0cd28-c459-47b7-be17-133b69773f9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '52fe638c-5ada-47d5-b376-233bfa808a37'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:31:28 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:31:28 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:31:28 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:31:28 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:31:28 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:31:28 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:31:28 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:31:28 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:31:28 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:31:28 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:31:28 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:31:28 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:31:28 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:31:28 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:31:28 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:31:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1714025063',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1714025063',id=21,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYrUwvaqlHN87/1coexF5rSHRlGXUa9nMDtkuMig5cppT2KcjZ1/LzgWVf5StAo8KnqLK68JMRfWhU47MCnTdmCe53lfYleLEedLL3gnNiTy7iFFgo0q1LydREc5eKJzQ==',key_name='tempest-keypair-1917410281',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63b9b79fb98441fd9f1b5df54471f0bd',ramdisk_id='',reservation_id='r-kzb2xrpd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1785499036',owner_user_name='tempest-AttachVolumeShelveTestJSON-1785499036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:31:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88d988d9ce0a41669b7c487ac07b4cfe',uuid=ffc25fc1-e59f-42c8-a371-b4b12e17fd59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ae0cd28-c459-47b7-be17-133b69773f9c", "address": "fa:16:3e:b9:69:19", "network": {"id": "15a1a586-0100-4057-8501-5c5a282d4063", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834988552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b9b79fb98441fd9f1b5df54471f0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae0cd28-c4", "ovs_interfaceid": "3ae0cd28-c459-47b7-be17-133b69773f9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:31:28 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Converting VIF {"id": "3ae0cd28-c459-47b7-be17-133b69773f9c", "address": "fa:16:3e:b9:69:19", "network": {"id": "15a1a586-0100-4057-8501-5c5a282d4063", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834988552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b9b79fb98441fd9f1b5df54471f0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae0cd28-c4", "ovs_interfaceid": "3ae0cd28-c459-47b7-be17-133b69773f9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:31:28 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:69:19,bridge_name='br-int',has_traffic_filtering=True,id=3ae0cd28-c459-47b7-be17-133b69773f9c,network=Network(15a1a586-0100-4057-8501-5c5a282d4063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ae0cd28-c4') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:31:28 user nova-compute[71229]: DEBUG nova.objects.instance [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lazy-loading 'pci_devices' on Instance uuid ffc25fc1-e59f-42c8-a371-b4b12e17fd59 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:31:28 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:31:28 user nova-compute[71229]:   <uuid>ffc25fc1-e59f-42c8-a371-b4b12e17fd59</uuid>
Apr 11 15:31:28 user nova-compute[71229]:   <name>instance-00000015</name>
Apr 11 15:31:28 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:31:28 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:31:28 user nova-compute[71229]:   <metadata>
Apr 11 15:31:28 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:31:28 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:31:28 user nova-compute[71229]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1714025063</nova:name>
Apr 11 15:31:28 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:31:28</nova:creationTime>
Apr 11 15:31:28 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:31:28 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:31:28 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:31:28 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:31:28 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:31:28 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:31:28 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:31:28 user nova-compute[71229]:       <nova:owner>
Apr 11 15:31:28 user nova-compute[71229]:         <nova:user uuid="88d988d9ce0a41669b7c487ac07b4cfe">tempest-AttachVolumeShelveTestJSON-1785499036-project-member</nova:user>
Apr 11 15:31:28 user nova-compute[71229]:         <nova:project uuid="63b9b79fb98441fd9f1b5df54471f0bd">tempest-AttachVolumeShelveTestJSON-1785499036</nova:project>
Apr 11 15:31:28 user nova-compute[71229]:       </nova:owner>
Apr 11 15:31:28 user nova-compute[71229]:       <nova:root type="image" uuid="52fe638c-5ada-47d5-b376-233bfa808a37"/>
Apr 11 15:31:28 user nova-compute[71229]:       <nova:ports>
Apr 11 15:31:28 user nova-compute[71229]:         <nova:port uuid="3ae0cd28-c459-47b7-be17-133b69773f9c">
Apr 11 15:31:28 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 11 15:31:28 user nova-compute[71229]:         </nova:port>
Apr 11 15:31:28 user nova-compute[71229]:       </nova:ports>
Apr 11 15:31:28 user nova-compute[71229]:     </nova:instance>
Apr 11 15:31:28 user nova-compute[71229]:   </metadata>
Apr 11 15:31:28 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:31:28 user nova-compute[71229]:     <system>
Apr 11 15:31:28 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:31:28 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:31:28 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:31:28 user nova-compute[71229]:       <entry name="serial">ffc25fc1-e59f-42c8-a371-b4b12e17fd59</entry>
Apr 11 15:31:28 user nova-compute[71229]:       <entry name="uuid">ffc25fc1-e59f-42c8-a371-b4b12e17fd59</entry>
Apr 11 15:31:28 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:31:28 user nova-compute[71229]:     </system>
Apr 11 15:31:28 user nova-compute[71229]:   </sysinfo>
Apr 11 15:31:28 user nova-compute[71229]:   <os>
Apr 11 15:31:28 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:31:28 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 15:31:28 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:31:28 user nova-compute[71229]:   </os>
Apr 11 15:31:28 user nova-compute[71229]:   <features>
Apr 11 15:31:28 user nova-compute[71229]:     <acpi/>
Apr 11 15:31:28 user nova-compute[71229]:     <apic/>
Apr 11 15:31:28 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:31:28 user nova-compute[71229]:   </features>
Apr 11 15:31:28 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:31:28 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:31:28 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:31:28 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:31:28 user nova-compute[71229]:   </clock>
Apr 11 15:31:28 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:31:28 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:31:28 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:31:28 user nova-compute[71229]:   </cpu>
Apr 11 15:31:28 user nova-compute[71229]:   <devices>
Apr 11 15:31:28 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 15:31:28 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 15:31:28 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/ffc25fc1-e59f-42c8-a371-b4b12e17fd59/disk"/>
Apr 11 15:31:28 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:31:28 user nova-compute[71229]:     </disk>
Apr 11 15:31:28 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:31:28 user nova-compute[71229]:       <mac address="fa:16:3e:b9:69:19"/>
Apr 11 15:31:28 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:31:28 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:31:28 user nova-compute[71229]:       <target dev="tap3ae0cd28-c4"/>
Apr 11 15:31:28 user nova-compute[71229]:     </interface>
Apr 11 15:31:28 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:31:28 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/ffc25fc1-e59f-42c8-a371-b4b12e17fd59/console.log" append="off"/>
Apr 11 15:31:28 user nova-compute[71229]:     </serial>
Apr 11 15:31:28 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:31:28 user nova-compute[71229]:     <video>
Apr 11 15:31:28 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:31:28 user nova-compute[71229]:     </video>
Apr 11 15:31:28 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:31:28 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:31:28 user nova-compute[71229]:     </rng>
Apr 11 15:31:28 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:31:28 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:31:28 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:31:28 user nova-compute[71229]:     </memballoon>
Apr 11 15:31:28 user nova-compute[71229]:   </devices>
Apr 11 15:31:28 user nova-compute[71229]: </domain>
Apr 11 15:31:28 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:31:28 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:31:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1714025063',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1714025063',id=21,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYrUwvaqlHN87/1coexF5rSHRlGXUa9nMDtkuMig5cppT2KcjZ1/LzgWVf5StAo8KnqLK68JMRfWhU47MCnTdmCe53lfYleLEedLL3gnNiTy7iFFgo0q1LydREc5eKJzQ==',key_name='tempest-keypair-1917410281',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63b9b79fb98441fd9f1b5df54471f0bd',ramdisk_id='',reservation_id='r-kzb2xrpd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1785499036',owner_user_name='tempest-AttachVolumeShelveTestJSON-1785499036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:31:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88d988d9ce0a41669b7c487ac07b4cfe',uuid=ffc25fc1-e59f-42c8-a371-b4b12e17fd59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ae0cd28-c459-47b7-be17-133b69773f9c", "address": "fa:16:3e:b9:69:19", "network": {"id": "15a1a586-0100-4057-8501-5c5a282d4063", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834988552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b9b79fb98441fd9f1b5df54471f0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae0cd28-c4", "ovs_interfaceid": "3ae0cd28-c459-47b7-be17-133b69773f9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:31:28 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Converting VIF {"id": "3ae0cd28-c459-47b7-be17-133b69773f9c", "address": "fa:16:3e:b9:69:19", "network": {"id": "15a1a586-0100-4057-8501-5c5a282d4063", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834988552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b9b79fb98441fd9f1b5df54471f0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae0cd28-c4", "ovs_interfaceid": "3ae0cd28-c459-47b7-be17-133b69773f9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:31:28 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:69:19,bridge_name='br-int',has_traffic_filtering=True,id=3ae0cd28-c459-47b7-be17-133b69773f9c,network=Network(15a1a586-0100-4057-8501-5c5a282d4063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ae0cd28-c4') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:31:28 user nova-compute[71229]: DEBUG os_vif [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:69:19,bridge_name='br-int',has_traffic_filtering=True,id=3ae0cd28-c459-47b7-be17-133b69773f9c,network=Network(15a1a586-0100-4057-8501-5c5a282d4063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ae0cd28-c4') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:31:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:31:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:31:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ae0cd28-c4, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:31:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3ae0cd28-c4, col_values=(('external_ids', {'iface-id': '3ae0cd28-c459-47b7-be17-133b69773f9c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:69:19', 'vm-uuid': 'ffc25fc1-e59f-42c8-a371-b4b12e17fd59'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:31:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:31:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:28 user nova-compute[71229]: INFO os_vif [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:69:19,bridge_name='br-int',has_traffic_filtering=True,id=3ae0cd28-c459-47b7-be17-133b69773f9c,network=Network(15a1a586-0100-4057-8501-5c5a282d4063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ae0cd28-c4')
Apr 11 15:31:28 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:31:28 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] No VIF found with MAC fa:16:3e:b9:69:19, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:31:28 user nova-compute[71229]: DEBUG nova.network.neutron [req-23b29f8b-9e03-4e9c-982f-f09f393f46fb req-cf57247b-1e28-4904-b470-6bf3a19bdf32 service nova] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Updated VIF entry in instance network info cache for port 3ae0cd28-c459-47b7-be17-133b69773f9c. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:31:28 user nova-compute[71229]: DEBUG nova.network.neutron [req-23b29f8b-9e03-4e9c-982f-f09f393f46fb req-cf57247b-1e28-4904-b470-6bf3a19bdf32 service nova] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Updating instance_info_cache with network_info: [{"id": "3ae0cd28-c459-47b7-be17-133b69773f9c", "address": "fa:16:3e:b9:69:19", "network": {"id": "15a1a586-0100-4057-8501-5c5a282d4063", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834988552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b9b79fb98441fd9f1b5df54471f0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae0cd28-c4", "ovs_interfaceid": "3ae0cd28-c459-47b7-be17-133b69773f9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:31:28 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-23b29f8b-9e03-4e9c-982f-f09f393f46fb req-cf57247b-1e28-4904-b470-6bf3a19bdf32 service nova] Releasing lock "refresh_cache-ffc25fc1-e59f-42c8-a371-b4b12e17fd59" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:31:29 user nova-compute[71229]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681227074.2864401, 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a => Stopped> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:31:29 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] VM Stopped (Lifecycle Event)
Apr 11 15:31:29 user nova-compute[71229]: DEBUG nova.compute.manager [None req-dc4ecd40-ebeb-4f08-b769-4d502ac715f4 None None] [instance: 1424f1ff-6c0f-4f9a-bddc-6c448a768a7a] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:31:29 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:29 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:29 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:30 user nova-compute[71229]: DEBUG nova.compute.manager [req-47e59145-e7c6-43eb-ae1b-83f60884677b req-fe36e992-4c34-4589-a001-b813758301eb service nova] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Received event network-vif-plugged-3ae0cd28-c459-47b7-be17-133b69773f9c {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:31:30 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-47e59145-e7c6-43eb-ae1b-83f60884677b req-fe36e992-4c34-4589-a001-b813758301eb service nova] Acquiring lock "ffc25fc1-e59f-42c8-a371-b4b12e17fd59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:31:30 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-47e59145-e7c6-43eb-ae1b-83f60884677b req-fe36e992-4c34-4589-a001-b813758301eb service nova] Lock "ffc25fc1-e59f-42c8-a371-b4b12e17fd59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:31:30 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-47e59145-e7c6-43eb-ae1b-83f60884677b req-fe36e992-4c34-4589-a001-b813758301eb service nova] Lock "ffc25fc1-e59f-42c8-a371-b4b12e17fd59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:31:30 user nova-compute[71229]: DEBUG nova.compute.manager [req-47e59145-e7c6-43eb-ae1b-83f60884677b req-fe36e992-4c34-4589-a001-b813758301eb service nova] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] No waiting events found dispatching network-vif-plugged-3ae0cd28-c459-47b7-be17-133b69773f9c {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:31:30 user nova-compute[71229]: WARNING nova.compute.manager [req-47e59145-e7c6-43eb-ae1b-83f60884677b req-fe36e992-4c34-4589-a001-b813758301eb service nova] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Received unexpected event network-vif-plugged-3ae0cd28-c459-47b7-be17-133b69773f9c for instance with vm_state building and task_state spawning.
Apr 11 15:31:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:31 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227091.9946702, ffc25fc1-e59f-42c8-a371-b4b12e17fd59 => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:31:31 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] VM Resumed (Lifecycle Event)
Apr 11 15:31:31 user nova-compute[71229]: DEBUG nova.compute.manager [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 15:31:31 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Guest created on hypervisor {{(pid=71229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 15:31:32 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Instance spawned successfully.
Apr 11 15:31:32 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 15:31:32 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:31:32 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:31:32 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Found default for hw_cdrom_bus of ide {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:31:32 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Found default for hw_disk_bus of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:31:32 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Found default for hw_input_bus of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:31:32 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Found default for hw_pointer_model of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:31:32 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Found default for hw_video_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:31:32 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Found default for hw_vif_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:31:32 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:31:32 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227091.9960265, ffc25fc1-e59f-42c8-a371-b4b12e17fd59 => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:31:32 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] VM Started (Lifecycle Event)
Apr 11 15:31:32 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:31:32 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:31:32 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:31:32 user nova-compute[71229]: INFO nova.compute.manager [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Took 5.95 seconds to spawn the instance on the hypervisor.
Apr 11 15:31:32 user nova-compute[71229]: DEBUG nova.compute.manager [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:31:32 user nova-compute[71229]: DEBUG nova.compute.manager [req-a45569cd-3d9b-40e7-8bbb-7b6c3db3ede1 req-175b69c9-1aab-4b15-bbf7-fb71ad230c9f service nova] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Received event network-vif-plugged-3ae0cd28-c459-47b7-be17-133b69773f9c {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:31:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a45569cd-3d9b-40e7-8bbb-7b6c3db3ede1 req-175b69c9-1aab-4b15-bbf7-fb71ad230c9f service nova] Acquiring lock "ffc25fc1-e59f-42c8-a371-b4b12e17fd59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:31:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a45569cd-3d9b-40e7-8bbb-7b6c3db3ede1 req-175b69c9-1aab-4b15-bbf7-fb71ad230c9f service nova] Lock "ffc25fc1-e59f-42c8-a371-b4b12e17fd59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:31:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a45569cd-3d9b-40e7-8bbb-7b6c3db3ede1 req-175b69c9-1aab-4b15-bbf7-fb71ad230c9f service nova] Lock "ffc25fc1-e59f-42c8-a371-b4b12e17fd59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:31:32 user nova-compute[71229]: DEBUG nova.compute.manager [req-a45569cd-3d9b-40e7-8bbb-7b6c3db3ede1 req-175b69c9-1aab-4b15-bbf7-fb71ad230c9f service nova] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] No waiting events found dispatching network-vif-plugged-3ae0cd28-c459-47b7-be17-133b69773f9c {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:31:32 user nova-compute[71229]: WARNING nova.compute.manager [req-a45569cd-3d9b-40e7-8bbb-7b6c3db3ede1 req-175b69c9-1aab-4b15-bbf7-fb71ad230c9f service nova] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Received unexpected event network-vif-plugged-3ae0cd28-c459-47b7-be17-133b69773f9c for instance with vm_state building and task_state spawning.
Apr 11 15:31:32 user nova-compute[71229]: INFO nova.compute.manager [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Took 6.77 seconds to build instance.
Apr 11 15:31:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-9414ba71-b0ea-41d1-812c-f913870d089a tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ffc25fc1-e59f-42c8-a371-b4b12e17fd59" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.867s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:31:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "85658a44-9ff2-4553-b9fd-686bf35fd6ec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:31:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "85658a44-9ff2-4553-b9fd-686bf35fd6ec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:31:32 user nova-compute[71229]: DEBUG nova.compute.manager [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Starting instance... {{(pid=71229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 15:31:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:31:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:31:32 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 15:31:32 user nova-compute[71229]: INFO nova.compute.claims [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Claim successful on node user
Apr 11 15:31:33 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:31:33 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:31:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.362s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:31:33 user nova-compute[71229]: DEBUG nova.compute.manager [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Start building networks asynchronously for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 15:31:33 user nova-compute[71229]: DEBUG nova.compute.manager [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Allocating IP information in the background. {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 15:31:33 user nova-compute[71229]: DEBUG nova.network.neutron [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] allocate_for_instance() {{(pid=71229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 15:31:33 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 15:31:33 user nova-compute[71229]: DEBUG nova.compute.manager [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Start building block device mappings for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 15:31:33 user nova-compute[71229]: DEBUG nova.policy [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '402ec212c8a64a559f82c166070a92ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f7abe5e3144c7ab354ffaba1748616', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71229) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 15:31:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:33 user nova-compute[71229]: DEBUG nova.compute.manager [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Start spawning the instance on the hypervisor. {{(pid=71229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 15:31:33 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Creating instance directory {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 15:31:33 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Creating image(s)
Apr 11 15:31:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "/opt/stack/data/nova/instances/85658a44-9ff2-4553-b9fd-686bf35fd6ec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:31:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "/opt/stack/data/nova/instances/85658a44-9ff2-4553-b9fd-686bf35fd6ec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:31:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "/opt/stack/data/nova/instances/85658a44-9ff2-4553-b9fd-686bf35fd6ec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:31:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.145s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:31:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:31:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.138s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/85658a44-9ff2-4553-b9fd-686bf35fd6ec/disk 1073741824 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/85658a44-9ff2-4553-b9fd-686bf35fd6ec/disk 1073741824" returned: 0 in 0.056s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:31:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.136s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:33 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Checking if we can resize image /opt/stack/data/nova/instances/85658a44-9ff2-4553-b9fd-686bf35fd6ec/disk. size=1073741824 {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 15:31:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85658a44-9ff2-4553-b9fd-686bf35fd6ec/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85658a44-9ff2-4553-b9fd-686bf35fd6ec/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:33 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Cannot resize image /opt/stack/data/nova/instances/85658a44-9ff2-4553-b9fd-686bf35fd6ec/disk to a smaller size. {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 15:31:33 user nova-compute[71229]: DEBUG nova.objects.instance [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lazy-loading 'migration_context' on Instance uuid 85658a44-9ff2-4553-b9fd-686bf35fd6ec {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:31:33 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Created local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 15:31:33 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Ensure instance console log exists: /opt/stack/data/nova/instances/85658a44-9ff2-4553-b9fd-686bf35fd6ec/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 15:31:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:31:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:31:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:31:34 user nova-compute[71229]: DEBUG nova.network.neutron [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Successfully created port: c6826c01-eadd-49db-a842-accd25f7534a {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 15:31:34 user nova-compute[71229]: DEBUG nova.network.neutron [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Successfully updated port: c6826c01-eadd-49db-a842-accd25f7534a {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:31:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "refresh_cache-85658a44-9ff2-4553-b9fd-686bf35fd6ec" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:31:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquired lock "refresh_cache-85658a44-9ff2-4553-b9fd-686bf35fd6ec" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:31:34 user nova-compute[71229]: DEBUG nova.network.neutron [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:31:34 user nova-compute[71229]: DEBUG nova.compute.manager [req-cf3e5d76-8c1e-4881-afcf-b0858bafd89c req-2cd5a019-6707-4223-b9ee-7dc3e8d7453b service nova] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Received event network-changed-c6826c01-eadd-49db-a842-accd25f7534a {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:31:34 user nova-compute[71229]: DEBUG nova.compute.manager [req-cf3e5d76-8c1e-4881-afcf-b0858bafd89c req-2cd5a019-6707-4223-b9ee-7dc3e8d7453b service nova] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Refreshing instance network info cache due to event network-changed-c6826c01-eadd-49db-a842-accd25f7534a. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:31:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-cf3e5d76-8c1e-4881-afcf-b0858bafd89c req-2cd5a019-6707-4223-b9ee-7dc3e8d7453b service nova] Acquiring lock "refresh_cache-85658a44-9ff2-4553-b9fd-686bf35fd6ec" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:31:34 user nova-compute[71229]: DEBUG nova.network.neutron [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:31:35 user nova-compute[71229]: DEBUG nova.network.neutron [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Updating instance_info_cache with network_info: [{"id": "c6826c01-eadd-49db-a842-accd25f7534a", "address": "fa:16:3e:0d:20:92", "network": {"id": "8dd93667-4f8b-4d89-b7be-056f5f39bffe", "bridge": "br-int", "label": "tempest-TestStampPattern-1555823894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0f7abe5e3144c7ab354ffaba1748616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6826c01-ea", "ovs_interfaceid": "c6826c01-eadd-49db-a842-accd25f7534a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:31:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Releasing lock "refresh_cache-85658a44-9ff2-4553-b9fd-686bf35fd6ec" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:31:35 user nova-compute[71229]: DEBUG nova.compute.manager [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Instance network_info: |[{"id": "c6826c01-eadd-49db-a842-accd25f7534a", "address": "fa:16:3e:0d:20:92", "network": {"id": "8dd93667-4f8b-4d89-b7be-056f5f39bffe", "bridge": "br-int", "label": "tempest-TestStampPattern-1555823894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0f7abe5e3144c7ab354ffaba1748616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6826c01-ea", "ovs_interfaceid": "c6826c01-eadd-49db-a842-accd25f7534a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 15:31:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-cf3e5d76-8c1e-4881-afcf-b0858bafd89c req-2cd5a019-6707-4223-b9ee-7dc3e8d7453b service nova] Acquired lock "refresh_cache-85658a44-9ff2-4553-b9fd-686bf35fd6ec" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:31:35 user nova-compute[71229]: DEBUG nova.network.neutron [req-cf3e5d76-8c1e-4881-afcf-b0858bafd89c req-2cd5a019-6707-4223-b9ee-7dc3e8d7453b service nova] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Refreshing network info cache for port c6826c01-eadd-49db-a842-accd25f7534a {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:31:35 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Start _get_guest_xml network_info=[{"id": "c6826c01-eadd-49db-a842-accd25f7534a", "address": "fa:16:3e:0d:20:92", "network": {"id": "8dd93667-4f8b-4d89-b7be-056f5f39bffe", "bridge": "br-int", "label": "tempest-TestStampPattern-1555823894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0f7abe5e3144c7ab354ffaba1748616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6826c01-ea", "ovs_interfaceid": "c6826c01-eadd-49db-a842-accd25f7534a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '52fe638c-5ada-47d5-b376-233bfa808a37'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:31:35 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:31:35 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:31:35 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:31:35 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:31:35 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:31:35 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:31:35 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:31:35 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:31:35 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:31:35 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:31:35 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:31:35 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:31:35 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:31:35 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:31:35 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:31:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1021680630',display_name='tempest-TestStampPattern-server-1021680630',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1021680630',id=22,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3FSQFz663lRbqzNxmPBbu9uJ3msIEfoeqvzCwilWtgPX+8lEdFmI1HaDVmQnOzGM0qsSCbXPgFMVYIHe6QVLQ+qXsBEhvf3WHKTsTkVBdGgOn/xo5dIBdvrA6jCgt/VA==',key_name='tempest-TestStampPattern-416277054',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0f7abe5e3144c7ab354ffaba1748616',ramdisk_id='',reservation_id='r-p3qyc5ea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-344874523',owner_user_name='tempest-TestStampPattern-344874523-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:31:33Z,user_data=None,user_id='402ec212c8a64a559f82c166070a92ef',uuid=85658a44-9ff2-4553-b9fd-686bf35fd6ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6826c01-eadd-49db-a842-accd25f7534a", "address": "fa:16:3e:0d:20:92", "network": {"id": "8dd93667-4f8b-4d89-b7be-056f5f39bffe", "bridge": "br-int", "label": "tempest-TestStampPattern-1555823894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0f7abe5e3144c7ab354ffaba1748616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6826c01-ea", "ovs_interfaceid": "c6826c01-eadd-49db-a842-accd25f7534a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:31:35 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Converting VIF {"id": "c6826c01-eadd-49db-a842-accd25f7534a", "address": "fa:16:3e:0d:20:92", "network": {"id": "8dd93667-4f8b-4d89-b7be-056f5f39bffe", "bridge": "br-int", "label": "tempest-TestStampPattern-1555823894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0f7abe5e3144c7ab354ffaba1748616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6826c01-ea", "ovs_interfaceid": "c6826c01-eadd-49db-a842-accd25f7534a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:31:35 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:20:92,bridge_name='br-int',has_traffic_filtering=True,id=c6826c01-eadd-49db-a842-accd25f7534a,network=Network(8dd93667-4f8b-4d89-b7be-056f5f39bffe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6826c01-ea') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:31:35 user nova-compute[71229]: DEBUG nova.objects.instance [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lazy-loading 'pci_devices' on Instance uuid 85658a44-9ff2-4553-b9fd-686bf35fd6ec {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:31:35 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:31:35 user nova-compute[71229]:   <uuid>85658a44-9ff2-4553-b9fd-686bf35fd6ec</uuid>
Apr 11 15:31:35 user nova-compute[71229]:   <name>instance-00000016</name>
Apr 11 15:31:35 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:31:35 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:31:35 user nova-compute[71229]:   <metadata>
Apr 11 15:31:35 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:31:35 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:31:35 user nova-compute[71229]:       <nova:name>tempest-TestStampPattern-server-1021680630</nova:name>
Apr 11 15:31:35 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:31:35</nova:creationTime>
Apr 11 15:31:35 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:31:35 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:31:35 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:31:35 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:31:35 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:31:35 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:31:35 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:31:35 user nova-compute[71229]:       <nova:owner>
Apr 11 15:31:35 user nova-compute[71229]:         <nova:user uuid="402ec212c8a64a559f82c166070a92ef">tempest-TestStampPattern-344874523-project-member</nova:user>
Apr 11 15:31:35 user nova-compute[71229]:         <nova:project uuid="f0f7abe5e3144c7ab354ffaba1748616">tempest-TestStampPattern-344874523</nova:project>
Apr 11 15:31:35 user nova-compute[71229]:       </nova:owner>
Apr 11 15:31:35 user nova-compute[71229]:       <nova:root type="image" uuid="52fe638c-5ada-47d5-b376-233bfa808a37"/>
Apr 11 15:31:35 user nova-compute[71229]:       <nova:ports>
Apr 11 15:31:35 user nova-compute[71229]:         <nova:port uuid="c6826c01-eadd-49db-a842-accd25f7534a">
Apr 11 15:31:35 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 11 15:31:35 user nova-compute[71229]:         </nova:port>
Apr 11 15:31:35 user nova-compute[71229]:       </nova:ports>
Apr 11 15:31:35 user nova-compute[71229]:     </nova:instance>
Apr 11 15:31:35 user nova-compute[71229]:   </metadata>
Apr 11 15:31:35 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:31:35 user nova-compute[71229]:     <system>
Apr 11 15:31:35 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:31:35 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:31:35 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:31:35 user nova-compute[71229]:       <entry name="serial">85658a44-9ff2-4553-b9fd-686bf35fd6ec</entry>
Apr 11 15:31:35 user nova-compute[71229]:       <entry name="uuid">85658a44-9ff2-4553-b9fd-686bf35fd6ec</entry>
Apr 11 15:31:35 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:31:35 user nova-compute[71229]:     </system>
Apr 11 15:31:35 user nova-compute[71229]:   </sysinfo>
Apr 11 15:31:35 user nova-compute[71229]:   <os>
Apr 11 15:31:35 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:31:35 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 15:31:35 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:31:35 user nova-compute[71229]:   </os>
Apr 11 15:31:35 user nova-compute[71229]:   <features>
Apr 11 15:31:35 user nova-compute[71229]:     <acpi/>
Apr 11 15:31:35 user nova-compute[71229]:     <apic/>
Apr 11 15:31:35 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:31:35 user nova-compute[71229]:   </features>
Apr 11 15:31:35 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:31:35 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:31:35 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:31:35 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:31:35 user nova-compute[71229]:   </clock>
Apr 11 15:31:35 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:31:35 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:31:35 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:31:35 user nova-compute[71229]:   </cpu>
Apr 11 15:31:35 user nova-compute[71229]:   <devices>
Apr 11 15:31:35 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 15:31:35 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 15:31:35 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/85658a44-9ff2-4553-b9fd-686bf35fd6ec/disk"/>
Apr 11 15:31:35 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:31:35 user nova-compute[71229]:     </disk>
Apr 11 15:31:35 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:31:35 user nova-compute[71229]:       <mac address="fa:16:3e:0d:20:92"/>
Apr 11 15:31:35 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:31:35 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:31:35 user nova-compute[71229]:       <target dev="tapc6826c01-ea"/>
Apr 11 15:31:35 user nova-compute[71229]:     </interface>
Apr 11 15:31:35 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:31:35 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/85658a44-9ff2-4553-b9fd-686bf35fd6ec/console.log" append="off"/>
Apr 11 15:31:35 user nova-compute[71229]:     </serial>
Apr 11 15:31:35 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:31:35 user nova-compute[71229]:     <video>
Apr 11 15:31:35 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:31:35 user nova-compute[71229]:     </video>
Apr 11 15:31:35 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:31:35 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:31:35 user nova-compute[71229]:     </rng>
Apr 11 15:31:35 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:31:35 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:31:35 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:31:35 user nova-compute[71229]:     </memballoon>
Apr 11 15:31:35 user nova-compute[71229]:   </devices>
Apr 11 15:31:35 user nova-compute[71229]: </domain>
Apr 11 15:31:35 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:31:35 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:31:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1021680630',display_name='tempest-TestStampPattern-server-1021680630',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1021680630',id=22,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3FSQFz663lRbqzNxmPBbu9uJ3msIEfoeqvzCwilWtgPX+8lEdFmI1HaDVmQnOzGM0qsSCbXPgFMVYIHe6QVLQ+qXsBEhvf3WHKTsTkVBdGgOn/xo5dIBdvrA6jCgt/VA==',key_name='tempest-TestStampPattern-416277054',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0f7abe5e3144c7ab354ffaba1748616',ramdisk_id='',reservation_id='r-p3qyc5ea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-344874523',owner_user_name='tempest-TestStampPattern-344874523-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:31:33Z,user_data=None,user_id='402ec212c8a64a559f82c166070a92ef',uuid=85658a44-9ff2-4553-b9fd-686bf35fd6ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6826c01-eadd-49db-a842-accd25f7534a", "address": "fa:16:3e:0d:20:92", "network": {"id": "8dd93667-4f8b-4d89-b7be-056f5f39bffe", "bridge": "br-int", "label": "tempest-TestStampPattern-1555823894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0f7abe5e3144c7ab354ffaba1748616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6826c01-ea", "ovs_interfaceid": "c6826c01-eadd-49db-a842-accd25f7534a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:31:35 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Converting VIF {"id": "c6826c01-eadd-49db-a842-accd25f7534a", "address": "fa:16:3e:0d:20:92", "network": {"id": "8dd93667-4f8b-4d89-b7be-056f5f39bffe", "bridge": "br-int", "label": "tempest-TestStampPattern-1555823894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0f7abe5e3144c7ab354ffaba1748616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6826c01-ea", "ovs_interfaceid": "c6826c01-eadd-49db-a842-accd25f7534a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:31:35 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:20:92,bridge_name='br-int',has_traffic_filtering=True,id=c6826c01-eadd-49db-a842-accd25f7534a,network=Network(8dd93667-4f8b-4d89-b7be-056f5f39bffe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6826c01-ea') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:31:35 user nova-compute[71229]: DEBUG os_vif [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:20:92,bridge_name='br-int',has_traffic_filtering=True,id=c6826c01-eadd-49db-a842-accd25f7534a,network=Network(8dd93667-4f8b-4d89-b7be-056f5f39bffe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6826c01-ea') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:31:35 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:35 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:31:35 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:31:35 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:35 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc6826c01-ea, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:31:35 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc6826c01-ea, col_values=(('external_ids', {'iface-id': 'c6826c01-eadd-49db-a842-accd25f7534a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:20:92', 'vm-uuid': '85658a44-9ff2-4553-b9fd-686bf35fd6ec'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:31:35 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:35 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:31:35 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:35 user nova-compute[71229]: INFO os_vif [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:20:92,bridge_name='br-int',has_traffic_filtering=True,id=c6826c01-eadd-49db-a842-accd25f7534a,network=Network(8dd93667-4f8b-4d89-b7be-056f5f39bffe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6826c01-ea')
Apr 11 15:31:35 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:31:35 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] No VIF found with MAC fa:16:3e:0d:20:92, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:31:35 user nova-compute[71229]: DEBUG nova.network.neutron [req-cf3e5d76-8c1e-4881-afcf-b0858bafd89c req-2cd5a019-6707-4223-b9ee-7dc3e8d7453b service nova] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Updated VIF entry in instance network info cache for port c6826c01-eadd-49db-a842-accd25f7534a. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:31:35 user nova-compute[71229]: DEBUG nova.network.neutron [req-cf3e5d76-8c1e-4881-afcf-b0858bafd89c req-2cd5a019-6707-4223-b9ee-7dc3e8d7453b service nova] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Updating instance_info_cache with network_info: [{"id": "c6826c01-eadd-49db-a842-accd25f7534a", "address": "fa:16:3e:0d:20:92", "network": {"id": "8dd93667-4f8b-4d89-b7be-056f5f39bffe", "bridge": "br-int", "label": "tempest-TestStampPattern-1555823894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0f7abe5e3144c7ab354ffaba1748616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6826c01-ea", "ovs_interfaceid": "c6826c01-eadd-49db-a842-accd25f7534a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:31:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-cf3e5d76-8c1e-4881-afcf-b0858bafd89c req-2cd5a019-6707-4223-b9ee-7dc3e8d7453b service nova] Releasing lock "refresh_cache-85658a44-9ff2-4553-b9fd-686bf35fd6ec" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:31:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:37 user nova-compute[71229]: DEBUG nova.compute.manager [req-93b1e75f-fdb5-4dce-b085-e6de18afa18a req-e0ccf3c8-6e2c-41e3-b22d-5409734d82cd service nova] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Received event network-vif-plugged-c6826c01-eadd-49db-a842-accd25f7534a {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:31:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-93b1e75f-fdb5-4dce-b085-e6de18afa18a req-e0ccf3c8-6e2c-41e3-b22d-5409734d82cd service nova] Acquiring lock "85658a44-9ff2-4553-b9fd-686bf35fd6ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:31:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-93b1e75f-fdb5-4dce-b085-e6de18afa18a req-e0ccf3c8-6e2c-41e3-b22d-5409734d82cd service nova] Lock "85658a44-9ff2-4553-b9fd-686bf35fd6ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:31:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-93b1e75f-fdb5-4dce-b085-e6de18afa18a req-e0ccf3c8-6e2c-41e3-b22d-5409734d82cd service nova] Lock "85658a44-9ff2-4553-b9fd-686bf35fd6ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:31:37 user nova-compute[71229]: DEBUG nova.compute.manager [req-93b1e75f-fdb5-4dce-b085-e6de18afa18a req-e0ccf3c8-6e2c-41e3-b22d-5409734d82cd service nova] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] No waiting events found dispatching network-vif-plugged-c6826c01-eadd-49db-a842-accd25f7534a {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:31:37 user nova-compute[71229]: WARNING nova.compute.manager [req-93b1e75f-fdb5-4dce-b085-e6de18afa18a req-e0ccf3c8-6e2c-41e3-b22d-5409734d82cd service nova] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Received unexpected event network-vif-plugged-c6826c01-eadd-49db-a842-accd25f7534a for instance with vm_state building and task_state spawning.
Apr 11 15:31:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:39 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227099.1024983, 85658a44-9ff2-4553-b9fd-686bf35fd6ec => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:31:39 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] VM Resumed (Lifecycle Event)
Apr 11 15:31:39 user nova-compute[71229]: DEBUG nova.compute.manager [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 15:31:39 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Guest created on hypervisor {{(pid=71229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 15:31:39 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Instance spawned successfully.
Apr 11 15:31:39 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 15:31:39 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:31:39 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:31:39 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Found default for hw_cdrom_bus of ide {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:31:39 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Found default for hw_disk_bus of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:31:39 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Found default for hw_input_bus of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:31:39 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Found default for hw_pointer_model of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:31:39 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Found default for hw_video_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:31:39 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Found default for hw_vif_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:31:39 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:31:39 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227099.1027906, 85658a44-9ff2-4553-b9fd-686bf35fd6ec => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:31:39 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] VM Started (Lifecycle Event)
Apr 11 15:31:39 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:31:39 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:31:39 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:31:39 user nova-compute[71229]: INFO nova.compute.manager [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Took 5.91 seconds to spawn the instance on the hypervisor.
Apr 11 15:31:39 user nova-compute[71229]: DEBUG nova.compute.manager [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:31:39 user nova-compute[71229]: INFO nova.compute.manager [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Took 6.63 seconds to build instance.
Apr 11 15:31:39 user nova-compute[71229]: DEBUG nova.compute.manager [req-64a8335b-e332-4fc0-b97d-70cad9b25640 req-3a884793-15c0-4298-9167-5555484166f4 service nova] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Received event network-vif-plugged-c6826c01-eadd-49db-a842-accd25f7534a {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:31:39 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-64a8335b-e332-4fc0-b97d-70cad9b25640 req-3a884793-15c0-4298-9167-5555484166f4 service nova] Acquiring lock "85658a44-9ff2-4553-b9fd-686bf35fd6ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:31:39 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-64a8335b-e332-4fc0-b97d-70cad9b25640 req-3a884793-15c0-4298-9167-5555484166f4 service nova] Lock "85658a44-9ff2-4553-b9fd-686bf35fd6ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:31:39 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-64a8335b-e332-4fc0-b97d-70cad9b25640 req-3a884793-15c0-4298-9167-5555484166f4 service nova] Lock "85658a44-9ff2-4553-b9fd-686bf35fd6ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:31:39 user nova-compute[71229]: DEBUG nova.compute.manager [req-64a8335b-e332-4fc0-b97d-70cad9b25640 req-3a884793-15c0-4298-9167-5555484166f4 service nova] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] No waiting events found dispatching network-vif-plugged-c6826c01-eadd-49db-a842-accd25f7534a {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:31:39 user nova-compute[71229]: WARNING nova.compute.manager [req-64a8335b-e332-4fc0-b97d-70cad9b25640 req-3a884793-15c0-4298-9167-5555484166f4 service nova] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Received unexpected event network-vif-plugged-c6826c01-eadd-49db-a842-accd25f7534a for instance with vm_state active and task_state None.
Apr 11 15:31:39 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d0ca844c-d618-448d-8115-50ed0820b8b9 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "85658a44-9ff2-4553-b9fd-686bf35fd6ec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.752s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:31:40 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "d534d17d-ba77-4447-8a63-7d6021ad7896" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:31:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "d534d17d-ba77-4447-8a63-7d6021ad7896" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:31:40 user nova-compute[71229]: DEBUG nova.objects.instance [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lazy-loading 'flavor' on Instance uuid d534d17d-ba77-4447-8a63-7d6021ad7896 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:31:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "d534d17d-ba77-4447-8a63-7d6021ad7896" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:31:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "d534d17d-ba77-4447-8a63-7d6021ad7896" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:31:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "d534d17d-ba77-4447-8a63-7d6021ad7896" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:31:40 user nova-compute[71229]: INFO nova.compute.manager [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Attaching volume 2ae53f4f-5bc4-4664-9ff6-3388782704ad to /dev/vdb
Apr 11 15:31:41 user nova-compute[71229]: DEBUG os_brick.utils [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:31:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:41 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[41dfb76c-5c69-4171-b8cb-eb88e8243444]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d55e24a97c90\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:31:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.026s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:41 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e447f9-2d7d-4639-a4b9-cb57e979eec2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:31:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:41 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[153165ba-25c1-43a2-b812-d30acffb6830]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:31:41 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c95ceb3-3a1b-48f7-9cf4-362e58676828]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:31:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Running cmd (subprocess): nvme version {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] 'nvme version' failed. Not Retrying. {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:31:41 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] nvme not present on system {{(pid=71229) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 15:31:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:31:41 user nova-compute[71229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 15:31:41 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3eb96be-faa3-4453-929a-74aa8736e2a5]: (4, '') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:31:41 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71229) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 15:31:41 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 15:31:41 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] LIGHTOS: no hostnqn found. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 15:31:41 user nova-compute[71229]: DEBUG os_brick.utils [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d55e24a97c90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:31:41 user nova-compute[71229]: DEBUG nova.virt.block_device [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Updating existing volume attachment record: ddf2f121-f3d5-4a4f-a829-6ed2176fff26 {{(pid=71229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 15:31:41 user nova-compute[71229]: DEBUG nova.network.neutron [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Port d8c64197-b034-4f38-821d-ba030f1fca6b binding to destination host user is already ACTIVE {{(pid=71229) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 11 15:31:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "refresh_cache-6a805345-374c-4326-9e8f-39bfc7947a35" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:31:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquired lock "refresh_cache-6a805345-374c-4326-9e8f-39bfc7947a35" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:31:41 user nova-compute[71229]: DEBUG nova.network.neutron [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:31:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:42 user nova-compute[71229]: DEBUG nova.network.neutron [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Updating instance_info_cache with network_info: [{"id": "d8c64197-b034-4f38-821d-ba030f1fca6b", "address": "fa:16:3e:0f:f8:cb", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c64197-b0", "ovs_interfaceid": "d8c64197-b034-4f38-821d-ba030f1fca6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:31:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Releasing lock "refresh_cache-6a805345-374c-4326-9e8f-39bfc7947a35" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:31:42 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Creating tmpfile /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/tmpue_fyct9 to verify with other compute node that the instance is on the same shared storage. {{(pid=71229) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9595}}
Apr 11 15:31:42 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:42 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:42 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:42 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:42 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Instance destroyed successfully.
Apr 11 15:31:42 user nova-compute[71229]: DEBUG nova.objects.instance [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lazy-loading 'resources' on Instance uuid 6a805345-374c-4326-9e8f-39bfc7947a35 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:31:42 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T15:21:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1386574519',display_name='tempest-ServerActionsTestJSON-server-252985182',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1386574519',id=3,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfAJGQ+GOa8zW+jlKgD9Kz6/k6iEv9pZIOIjICzcstJ92AAS94+47mc3fRsqyx5FaTMV9P4lTsW4Fy7tKIAtMpRx0Sl7sa6ttQnPbPhlcYqfbdWbTqmmKi6+BuZpqSknA==',key_name='tempest-keypair-1137963694',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:30:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bb7660e8f76b471487136806ee9eec62',ramdisk_id='',reservation_id='r-hmn5p3xn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1659503440',owner_user_name='tempest-ServerActionsTestJSON-1659503440-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:30:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10720df0ac4f4e62a0a5c9883d600add',uuid=6a805345-374c-4326-9e8f-39bfc7947a35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "d8c64197-b034-4f38-821d-ba030f1fca6b", "address": "fa:16:3e:0f:f8:cb", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c64197-b0", "ovs_interfaceid": "d8c64197-b034-4f38-821d-ba030f1fca6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:31:42 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Converting VIF {"id": "d8c64197-b034-4f38-821d-ba030f1fca6b", "address": "fa:16:3e:0f:f8:cb", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c64197-b0", "ovs_interfaceid": "d8c64197-b034-4f38-821d-ba030f1fca6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:31:42 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:f8:cb,bridge_name='br-int',has_traffic_filtering=True,id=d8c64197-b034-4f38-821d-ba030f1fca6b,network=Network(1bd215e8-0459-4dd2-893b-096b6e31ac08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c64197-b0') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:31:42 user nova-compute[71229]: DEBUG os_vif [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:f8:cb,bridge_name='br-int',has_traffic_filtering=True,id=d8c64197-b034-4f38-821d-ba030f1fca6b,network=Network(1bd215e8-0459-4dd2-893b-096b6e31ac08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c64197-b0') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:31:42 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:42 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd8c64197-b0, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:31:42 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:31:42 user nova-compute[71229]: INFO os_vif [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:f8:cb,bridge_name='br-int',has_traffic_filtering=True,id=d8c64197-b034-4f38-821d-ba030f1fca6b,network=Network(1bd215e8-0459-4dd2-893b-096b6e31ac08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c64197-b0')
Apr 11 15:31:42 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 15:31:42 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XapmTvFn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:31:42 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:31:42 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:31:42 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:31:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:42 user nova-compute[71229]: DEBUG nova.compute.manager [req-78bac180-347c-4d69-a2ce-1efe8d282050 req-2759cb5b-8685-472f-8595-d4f77299b36e service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Received event network-vif-unplugged-d8c64197-b034-4f38-821d-ba030f1fca6b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:31:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-78bac180-347c-4d69-a2ce-1efe8d282050 req-2759cb5b-8685-472f-8595-d4f77299b36e service nova] Acquiring lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:31:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-78bac180-347c-4d69-a2ce-1efe8d282050 req-2759cb5b-8685-472f-8595-d4f77299b36e service nova] Lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:31:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-78bac180-347c-4d69-a2ce-1efe8d282050 req-2759cb5b-8685-472f-8595-d4f77299b36e service nova] Lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:31:42 user nova-compute[71229]: DEBUG nova.compute.manager [req-78bac180-347c-4d69-a2ce-1efe8d282050 req-2759cb5b-8685-472f-8595-d4f77299b36e service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] No waiting events found dispatching network-vif-unplugged-d8c64197-b034-4f38-821d-ba030f1fca6b {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:31:42 user nova-compute[71229]: WARNING nova.compute.manager [req-78bac180-347c-4d69-a2ce-1efe8d282050 req-2759cb5b-8685-472f-8595-d4f77299b36e service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Received unexpected event network-vif-unplugged-d8c64197-b034-4f38-821d-ba030f1fca6b for instance with vm_state resized and task_state resize_reverting.
Apr 11 15:31:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:42 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a4f75b-046b-4490-831c-314fe72e23e1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:31:42 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 15:31:42 user nova-compute[71229]: No targets found.
Apr 11 15:31:42 user nova-compute[71229]: iSNS:
Apr 11 15:31:42 user nova-compute[71229]: No targets found.
Apr 11 15:31:42 user nova-compute[71229]: STATIC:
Apr 11 15:31:42 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb
Apr 11 15:31:42 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:31:42 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:31:42 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2
Apr 11 15:31:42 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:31:42 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:31:42 user nova-compute[71229]: FIRMWARE:
Apr 11 15:31:42 user nova-compute[71229]: No targets found.
Apr 11 15:31:42 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:31:42 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 15:31:42 user nova-compute[71229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 15:31:42 user nova-compute[71229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71229) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 15:31:42 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2', 0)] {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 15:31:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:43 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[018ae678-809f-4ecb-83fc-ec8f3621f8f4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:31:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:43 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d959399b-7af5-4dd6-81b7-2e57a10f8042]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:31:43 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:31:43 user nova-compute[71229]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:31:43 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:31:43 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:31:43 user nova-compute[71229]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:31:43 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:31:43 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb69dcd120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2'): ({'sdc'}, set())}) {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 15:31:43 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Removing single pathed devices sdc {{(pid=71229) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 15:31:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:43 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a2cf65-064d-4043-aa77-5d685b5f93bb]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:31:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:43 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a06c98-45ad-46ff-86cc-3a255be204f7]: (4, ('ok\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:31:43 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Flushing IO for device /dev/sdc {{(pid=71229) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 15:31:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:43 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1ba710-8c7f-40b7-9411-ef8879af1da8]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:31:43 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71229) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 15:31:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:43 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e210525-957a-4ec6-88ce-88dbfdd723bc]: (4, ('1', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:31:43 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 15:31:43 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] SCSI volumes sdc have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 15:31:43 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2')] {{(pid=71229) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 15:31:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:43 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c432c1dd-6a0f-4b45-bfb3-44e8b0168146]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:31:43 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:31:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --logout {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:43 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3224df4-e084-4670-8ab8-db61100f4074]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:31:43 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2, portal: 172.16.0.220,3260]
Apr 11 15:31:43 user nova-compute[71229]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2, portal: 172.16.0.220,3260] successful.
Apr 11 15:31:43 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:31:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --op delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:43 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ef41a7-a1f1-4a09-94ca-96d3885f462b]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:31:43 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:31:43 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:31:43 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] <== disconnect_volume: return (345ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:31:43 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 15:31:44 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:31:44 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:31:44 user nova-compute[71229]: DEBUG nova.objects.instance [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lazy-loading 'migration_context' on Instance uuid 6a805345-374c-4326-9e8f-39bfc7947a35 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:31:44 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:31:44 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:31:44 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.407s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:31:45 user nova-compute[71229]: INFO nova.compute.manager [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Swapping old allocation on dict_keys(['116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de']) held by migration 61539203-b1fe-440c-9138-018e0db6e179 for instance
Apr 11 15:31:45 user nova-compute[71229]: DEBUG nova.compute.manager [req-5e6322d3-9b5b-4e45-8580-2d5454ad1c75 req-2cc14b69-435b-496f-b30a-f6638d408e11 service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Received event network-vif-plugged-d8c64197-b034-4f38-821d-ba030f1fca6b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-5e6322d3-9b5b-4e45-8580-2d5454ad1c75 req-2cc14b69-435b-496f-b30a-f6638d408e11 service nova] Acquiring lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-5e6322d3-9b5b-4e45-8580-2d5454ad1c75 req-2cc14b69-435b-496f-b30a-f6638d408e11 service nova] Lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-5e6322d3-9b5b-4e45-8580-2d5454ad1c75 req-2cc14b69-435b-496f-b30a-f6638d408e11 service nova] Lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG nova.compute.manager [req-5e6322d3-9b5b-4e45-8580-2d5454ad1c75 req-2cc14b69-435b-496f-b30a-f6638d408e11 service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] No waiting events found dispatching network-vif-plugged-d8c64197-b034-4f38-821d-ba030f1fca6b {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:31:45 user nova-compute[71229]: WARNING nova.compute.manager [req-5e6322d3-9b5b-4e45-8580-2d5454ad1c75 req-2cc14b69-435b-496f-b30a-f6638d408e11 service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Received unexpected event network-vif-plugged-d8c64197-b034-4f38-821d-ba030f1fca6b for instance with vm_state resized and task_state resize_reverting.
Apr 11 15:31:45 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Overwriting current allocation {'allocations': {'116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de': {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}, 'generation': 28}}, 'project_id': 'bb7660e8f76b471487136806ee9eec62', 'user_id': '10720df0ac4f4e62a0a5c9883d600add', 'consumer_generation': 1} on consumer 6a805345-374c-4326-9e8f-39bfc7947a35 {{(pid=71229) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "refresh_cache-6a805345-374c-4326-9e8f-39bfc7947a35" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquired lock "refresh_cache-6a805345-374c-4326-9e8f-39bfc7947a35" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG nova.network.neutron [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2ae53f4f-5bc4-4664-9ff6-3388782704ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jmgDAkYf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:31:45 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:31:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:31:45 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:31:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ae53f4f-5bc4-4664-9ff6-3388782704ad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ae53f4f-5bc4-4664-9ff6-3388782704ad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:31:45 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 15:31:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ae53f4f-5bc4-4664-9ff6-3388782704ad -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ae53f4f-5bc4-4664-9ff6-3388782704ad -p 172.16.0.220:3260" returned: 21 in 0.042s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b659ae-e89b-4b2a-8551-ca214a7b6e41]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 15:31:45 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ae53f4f-5bc4-4664-9ff6-3388782704ad -p 172.16.0.220:3260 --interface default --op new {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG nova.network.neutron [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Updating instance_info_cache with network_info: [{"id": "d8c64197-b034-4f38-821d-ba030f1fca6b", "address": "fa:16:3e:0f:f8:cb", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c64197-b0", "ovs_interfaceid": "d8c64197-b034-4f38-821d-ba030f1fca6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ae53f4f-5bc4-4664-9ff6-3388782704ad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd2e83f-ec3d-4f0b-bb28-5431a1ac6909]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ae53f4f-5bc4-4664-9ff6-3388782704ad] added\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ae53f4f-5bc4-4664-9ff6-3388782704ad] added
Apr 11 15:31:45 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ae53f4f-5bc4-4664-9ff6-3388782704ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Releasing lock "refresh_cache-6a805345-374c-4326-9e8f-39bfc7947a35" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG os_brick.utils [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ae53f4f-5bc4-4664-9ff6-3388782704ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2283dd6-343f-42ff-8aa7-ad52aac7cc53]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ae53f4f-5bc4-4664-9ff6-3388782704ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c64342-9570-4860-a390-03cb9ee5390c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d55e24a97c90\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ae53f4f-5bc4-4664-9ff6-3388782704ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bac94b-4ae9-4cef-b20f-f4f98ffda36b]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ae53f4f-5bc4-4664-9ff6-3388782704ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jmgDAkYf {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c51997c-cfc4-469c-abc9-42baf3047886]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ae53f4f-5bc4-4664-9ff6-3388782704ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jmgDAkYf" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e45b6d-0bc8-41e0-a67e-f597dc7398db]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jmgDAkYf'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ae53f4f-5bc4-4664-9ff6-3388782704ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75a0d1d-2a5a-4631-a73a-32a054b295ac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2081e5a1-5091-408b-8005-91f145769faf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Running cmd (subprocess): nvme version {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 'nvme version' failed. Not Retrying. {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ae53f4f-5bc4-4664-9ff6-3388782704ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6714776b-f247-4ca7-91fa-347c135a5f62]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] nvme not present on system {{(pid=71229) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:31:45 user nova-compute[71229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 15:31:45 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af1d616-4f16-43b4-95e1-35cace14863e]: (4, '') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71229) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] LIGHTOS: no hostnqn found. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG os_brick.utils [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d55e24a97c90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a589da9f-af8b-41cc-a962-f16d4b682dae]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:31:45 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:31:45 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ae53f4f-5bc4-4664-9ff6-3388782704ad -p 172.16.0.220:3260 --login {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ae53f4f-5bc4-4664-9ff6-3388782704ad -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2ceeb4-4393-4cc8-8c7c-74657d9aa2d2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ae53f4f-5bc4-4664-9ff6-3388782704ad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2ae53f4f-5bc4-4664-9ff6-3388782704ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ae53f4f-5bc4-4664-9ff6-3388782704ad, portal: 172.16.0.220,3260]
Apr 11 15:31:45 user nova-compute[71229]: Login to [iface: default, target: iqn.2010-10.org.openstack:2ae53f4f-5bc4-4664-9ff6-3388782704ad, portal: 172.16.0.220,3260] successful.
Apr 11 15:31:45 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ae53f4f-5bc4-4664-9ff6-3388782704ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ae53f4f-5bc4-4664-9ff6-3388782704ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcc5d37-80e1-40f2-9aad-c07a8841f690]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b1a190-77e6-47bb-8238-7d883b16459a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae53f4f-5bc4-4664-9ff6-3388782704ad (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:31:45 user nova-compute[71229]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae53f4f-5bc4-4664-9ff6-3388782704ad (non-flash)
Apr 11 15:31:45 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:31:45 user nova-compute[71229]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae53f4f-5bc4-4664-9ff6-3388782704ad (non-flash)
Apr 11 15:31:45 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ae53f4f-5bc4-4664-9ff6-3388782704ad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 15:31:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:46 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:46 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9548ad98-0ad0-4f6e-b77f-87ec3bd5730b]: (4, ('- - 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:31:46 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:31:46 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2ae53f4f-5bc4-4664-9ff6-3388782704ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jmgDAkYf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 15:31:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:31:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '26132613062336565', 'path': '/dev/sdc'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:31:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26132613062336565', 'path': '/dev/sdc'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 15:31:47 user nova-compute[71229]: DEBUG nova.objects.instance [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lazy-loading 'flavor' on Instance uuid d534d17d-ba77-4447-8a63-7d6021ad7896 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:31:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 15:31:47 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:31:47 user nova-compute[71229]:   <source dev="/dev/sdc"/>
Apr 11 15:31:47 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 15:31:47 user nova-compute[71229]:   <serial>2ae53f4f-5bc4-4664-9ff6-3388782704ad</serial>
Apr 11 15:31:47 user nova-compute[71229]: </disk>
Apr 11 15:31:47 user nova-compute[71229]:  {{(pid=71229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 15:31:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:31:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:31:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] No VIF found with MAC fa:16:3e:61:6a:d2, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:31:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-01817ca3-82d2-4d4c-9344-d593b078c31f tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "d534d17d-ba77-4447-8a63-7d6021ad7896" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.676s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:31:47 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:31:47 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Cleaning up deleted instances {{(pid=71229) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 15:31:47 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] There are 0 instances to clean {{(pid=71229) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 15:31:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-0789e8b2-12af-47de-ae0d-b53f19505947 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "d534d17d-ba77-4447-8a63-7d6021ad7896" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:31:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-0789e8b2-12af-47de-ae0d-b53f19505947 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "d534d17d-ba77-4447-8a63-7d6021ad7896" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:31:49 user nova-compute[71229]: INFO nova.compute.manager [None req-0789e8b2-12af-47de-ae0d-b53f19505947 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Detaching volume 2ae53f4f-5bc4-4664-9ff6-3388782704ad
Apr 11 15:31:49 user nova-compute[71229]: INFO nova.virt.block_device [None req-0789e8b2-12af-47de-ae0d-b53f19505947 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Attempting to driver detach volume 2ae53f4f-5bc4-4664-9ff6-3388782704ad from mountpoint /dev/vdb
Apr 11 15:31:49 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-0789e8b2-12af-47de-ae0d-b53f19505947 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Attempting to detach device vdb from instance d534d17d-ba77-4447-8a63-7d6021ad7896 from the persistent domain config. {{(pid=71229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 15:31:49 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-0789e8b2-12af-47de-ae0d-b53f19505947 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 15:31:49 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:31:49 user nova-compute[71229]:   <source dev="/dev/sdc"/>
Apr 11 15:31:49 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 15:31:49 user nova-compute[71229]:   <serial>2ae53f4f-5bc4-4664-9ff6-3388782704ad</serial>
Apr 11 15:31:49 user nova-compute[71229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 15:31:49 user nova-compute[71229]: </disk>
Apr 11 15:31:49 user nova-compute[71229]:  {{(pid=71229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 15:31:49 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-0789e8b2-12af-47de-ae0d-b53f19505947 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Successfully detached device vdb from instance d534d17d-ba77-4447-8a63-7d6021ad7896 from the persistent domain config.
Apr 11 15:31:49 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-0789e8b2-12af-47de-ae0d-b53f19505947 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d534d17d-ba77-4447-8a63-7d6021ad7896 from the live domain config. {{(pid=71229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 15:31:49 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-0789e8b2-12af-47de-ae0d-b53f19505947 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 15:31:49 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:31:49 user nova-compute[71229]:   <source dev="/dev/sdc"/>
Apr 11 15:31:49 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 15:31:49 user nova-compute[71229]:   <serial>2ae53f4f-5bc4-4664-9ff6-3388782704ad</serial>
Apr 11 15:31:49 user nova-compute[71229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 15:31:49 user nova-compute[71229]: </disk>
Apr 11 15:31:49 user nova-compute[71229]:  {{(pid=71229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 15:31:49 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Received event <DeviceRemovedEvent: 1681227109.7391784, d534d17d-ba77-4447-8a63-7d6021ad7896 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71229) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 15:31:49 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-0789e8b2-12af-47de-ae0d-b53f19505947 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d534d17d-ba77-4447-8a63-7d6021ad7896 {{(pid=71229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 15:31:49 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-0789e8b2-12af-47de-ae0d-b53f19505947 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Successfully detached device vdb from instance d534d17d-ba77-4447-8a63-7d6021ad7896 from the live domain config.
Apr 11 15:31:49 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0789e8b2-12af-47de-ae0d-b53f19505947 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 15:31:49 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0789e8b2-12af-47de-ae0d-b53f19505947 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:2ae53f4f-5bc4-4664-9ff6-3388782704ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jmgDAkYf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:31:49 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-0789e8b2-12af-47de-ae0d-b53f19505947 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:31:49 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-0789e8b2-12af-47de-ae0d-b53f19505947 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:31:49 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-0789e8b2-12af-47de-ae0d-b53f19505947 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:31:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:49 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef60b2b2-3a3a-4629-959a-d06ab1190686]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ae53f4f-5bc4-4664-9ff6-3388782704ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:31:49 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0789e8b2-12af-47de-ae0d-b53f19505947 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 15:31:49 user nova-compute[71229]: No targets found.
Apr 11 15:31:49 user nova-compute[71229]: iSNS:
Apr 11 15:31:49 user nova-compute[71229]: No targets found.
Apr 11 15:31:49 user nova-compute[71229]: STATIC:
Apr 11 15:31:49 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb
Apr 11 15:31:49 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:31:49 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:31:49 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:2ae53f4f-5bc4-4664-9ff6-3388782704ad
Apr 11 15:31:49 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:31:49 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:31:49 user nova-compute[71229]: FIRMWARE:
Apr 11 15:31:49 user nova-compute[71229]: No targets found.
Apr 11 15:31:49 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:31:49 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0789e8b2-12af-47de-ae0d-b53f19505947 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 15:31:49 user nova-compute[71229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 15:31:49 user nova-compute[71229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71229) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 15:31:49 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0789e8b2-12af-47de-ae0d-b53f19505947 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ae53f4f-5bc4-4664-9ff6-3388782704ad', 0)] {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 15:31:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:49 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5067342c-d175-4c2d-8cfb-cd5b53e03511]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ae53f4f-5bc4-4664-9ff6-3388782704ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:31:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:49 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2fc421-3050-4532-af2f-220840038f06]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae53f4f-5bc4-4664-9ff6-3388782704ad (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:31:49 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0789e8b2-12af-47de-ae0d-b53f19505947 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:31:49 user nova-compute[71229]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae53f4f-5bc4-4664-9ff6-3388782704ad (non-flash)
Apr 11 15:31:49 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:31:49 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0789e8b2-12af-47de-ae0d-b53f19505947 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:31:49 user nova-compute[71229]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae53f4f-5bc4-4664-9ff6-3388782704ad (non-flash)
Apr 11 15:31:49 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:31:49 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0789e8b2-12af-47de-ae0d-b53f19505947 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb641c88b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ae53f4f-5bc4-4664-9ff6-3388782704ad'): ({'sdc'}, set())}) {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 15:31:49 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-0789e8b2-12af-47de-ae0d-b53f19505947 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Removing single pathed devices sdc {{(pid=71229) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 15:31:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:49 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a297f5c5-8f8a-4c02-a26d-cff4a1b78a30]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:31:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:49 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf769850-4270-4155-9c21-27759396abb9]: (4, ('ok\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:31:49 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-0789e8b2-12af-47de-ae0d-b53f19505947 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Flushing IO for device /dev/sdc {{(pid=71229) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 15:31:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:49 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[636836a8-5ba5-4cb2-9c42-4b44b35fec32]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:31:49 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-0789e8b2-12af-47de-ae0d-b53f19505947 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71229) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 15:31:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:49 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d71d318-019a-4d4b-8dab-e3dcf2c7a6d2]: (4, ('1', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:31:49 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-0789e8b2-12af-47de-ae0d-b53f19505947 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 15:31:49 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-0789e8b2-12af-47de-ae0d-b53f19505947 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] SCSI volumes sdc have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 15:31:49 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0789e8b2-12af-47de-ae0d-b53f19505947 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ae53f4f-5bc4-4664-9ff6-3388782704ad')] {{(pid=71229) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 15:31:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ae53f4f-5bc4-4664-9ff6-3388782704ad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ae53f4f-5bc4-4664-9ff6-3388782704ad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:49 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb79406-7a5a-4b43-976d-1e685eedbd05]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:31:49 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0789e8b2-12af-47de-ae0d-b53f19505947 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:31:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ae53f4f-5bc4-4664-9ff6-3388782704ad -p 172.16.0.220:3260 --logout {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ae53f4f-5bc4-4664-9ff6-3388782704ad -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[788f1581-44ec-449b-b164-0f531af0357b]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:2ae53f4f-5bc4-4664-9ff6-3388782704ad, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:2ae53f4f-5bc4-4664-9ff6-3388782704ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0789e8b2-12af-47de-ae0d-b53f19505947 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:2ae53f4f-5bc4-4664-9ff6-3388782704ad, portal: 172.16.0.220,3260]
Apr 11 15:31:50 user nova-compute[71229]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:2ae53f4f-5bc4-4664-9ff6-3388782704ad, portal: 172.16.0.220,3260] successful.
Apr 11 15:31:50 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ae53f4f-5bc4-4664-9ff6-3388782704ad -p 172.16.0.220:3260 --op delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ae53f4f-5bc4-4664-9ff6-3388782704ad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7bdb46-2db3-4bef-b14f-578e4636f82f]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0789e8b2-12af-47de-ae0d-b53f19505947 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-0789e8b2-12af-47de-ae0d-b53f19505947 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-0789e8b2-12af-47de-ae0d-b53f19505947 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] <== disconnect_volume: return (320ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0789e8b2-12af-47de-ae0d-b53f19505947 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Starting finish_revert_migration {{(pid=71229) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11792}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Start _get_guest_xml network_info=[{"id": "d8c64197-b034-4f38-821d-ba030f1fca6b", "address": "fa:16:3e:0f:f8:cb", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c64197-b0", "ovs_interfaceid": "d8c64197-b034-4f38-821d-ba030f1fca6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '52fe638c-5ada-47d5-b376-233bfa808a37'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XapmTvFn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '6a805345-374c-4326-9e8f-39bfc7947a35', 'attached_at': '2023-04-11T15:31:50.000000', 'detached_at': '', 'volume_id': 'e168e446-1ecb-4f58-bc6c-0f488fa989a2', 'serial': 'e168e446-1ecb-4f58-bc6c-0f488fa989a2'}, 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '44572442-a3a8-45e2-a501-386dc1d9916f', 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:31:50 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:31:50 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:31:50 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG nova.objects.instance [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6a805345-374c-4326-9e8f-39bfc7947a35 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XapmTvFn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:31:50 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:31:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:31:50 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:31:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:31:50 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 15:31:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc04a9fc-1513-4225-901f-3760b07511fe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 15:31:50 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --interface default --op new {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e331b98e-a182-4cfc-960c-0f53431432fe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2] added\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2] added
Apr 11 15:31:50 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24f3320-4fad-4c7d-aa3f-c1405ee35a08]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78e3999-ca4c-40e5-b8bd-3ca518c7cf80]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XapmTvFn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XapmTvFn" returned: 0 in 0.026s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5afeae2-ab5f-4f8b-9d07-0e811a2bec34]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XapmTvFn'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e321233-9fef-4d49-9160-e84b35672df3]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[00760706-d987-40b8-939d-b7cda786cad8]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:31:50 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:31:50 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --login {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a95e6ed-24b2-4e8e-8020-693a09e841c6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2, portal: 172.16.0.220,3260]
Apr 11 15:31:50 user nova-compute[71229]: Login to [iface: default, target: iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2, portal: 172.16.0.220,3260] successful.
Apr 11 15:31:50 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e55a0f3-172e-4ac9-ad7e-1c45e31466c3]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48649aa-aa84-4f63-b248-6c250b5f9ec4]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:31:50 user nova-compute[71229]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:31:50 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:31:50 user nova-compute[71229]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:31:50 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4c5021-151d-4360-b4eb-0f66bd47e396]: (4, ('- - 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XapmTvFn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG nova.objects.instance [None req-0789e8b2-12af-47de-ae0d-b53f19505947 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lazy-loading 'flavor' on Instance uuid d534d17d-ba77-4447-8a63-7d6021ad7896 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:31:50 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-0789e8b2-12af-47de-ae0d-b53f19505947 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "d534d17d-ba77-4447-8a63-7d6021ad7896" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.725s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:31:51 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:31:51 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23532643732633938', 'path': '/dev/sdc'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:31:51 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532643732633938', 'path': '/dev/sdc'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 15:31:51 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T15:21:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1386574519',display_name='tempest-ServerActionsTestJSON-server-252985182',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1386574519',id=3,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfAJGQ+GOa8zW+jlKgD9Kz6/k6iEv9pZIOIjICzcstJ92AAS94+47mc3fRsqyx5FaTMV9P4lTsW4Fy7tKIAtMpRx0Sl7sa6ttQnPbPhlcYqfbdWbTqmmKi6+BuZpqSknA==',key_name='tempest-keypair-1137963694',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:30:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bb7660e8f76b471487136806ee9eec62',ramdisk_id='',reservation_id='r-hmn5p3xn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1659503440',owner_user_name='tempest-ServerActionsTestJSON-1659503440-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:31:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10720df0ac4f4e62a0a5c9883d600add',uuid=6a805345-374c-4326-9e8f-39bfc7947a35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "d8c64197-b034-4f38-821d-ba030f1fca6b", "address": "fa:16:3e:0f:f8:cb", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c64197-b0", "ovs_interfaceid": "d8c64197-b034-4f38-821d-ba030f1fca6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:31:51 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Converting VIF {"id": "d8c64197-b034-4f38-821d-ba030f1fca6b", "address": "fa:16:3e:0f:f8:cb", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c64197-b0", "ovs_interfaceid": "d8c64197-b034-4f38-821d-ba030f1fca6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:31:51 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:f8:cb,bridge_name='br-int',has_traffic_filtering=True,id=d8c64197-b034-4f38-821d-ba030f1fca6b,network=Network(1bd215e8-0459-4dd2-893b-096b6e31ac08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c64197-b0') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:31:51 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:31:51 user nova-compute[71229]:   <uuid>6a805345-374c-4326-9e8f-39bfc7947a35</uuid>
Apr 11 15:31:51 user nova-compute[71229]:   <name>instance-00000003</name>
Apr 11 15:31:51 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:31:51 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:31:51 user nova-compute[71229]:   <metadata>
Apr 11 15:31:51 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:31:51 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:31:51 user nova-compute[71229]:       <nova:name>tempest-ServerActionsTestJSON-server-252985182</nova:name>
Apr 11 15:31:51 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:31:50</nova:creationTime>
Apr 11 15:31:51 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:31:51 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:31:51 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:31:51 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:31:51 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:31:51 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:31:51 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:31:51 user nova-compute[71229]:       <nova:owner>
Apr 11 15:31:51 user nova-compute[71229]:         <nova:user uuid="10720df0ac4f4e62a0a5c9883d600add">tempest-ServerActionsTestJSON-1659503440-project-member</nova:user>
Apr 11 15:31:51 user nova-compute[71229]:         <nova:project uuid="bb7660e8f76b471487136806ee9eec62">tempest-ServerActionsTestJSON-1659503440</nova:project>
Apr 11 15:31:51 user nova-compute[71229]:       </nova:owner>
Apr 11 15:31:51 user nova-compute[71229]:       <nova:root type="image" uuid="52fe638c-5ada-47d5-b376-233bfa808a37"/>
Apr 11 15:31:51 user nova-compute[71229]:       <nova:ports>
Apr 11 15:31:51 user nova-compute[71229]:         <nova:port uuid="d8c64197-b034-4f38-821d-ba030f1fca6b">
Apr 11 15:31:51 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 11 15:31:51 user nova-compute[71229]:         </nova:port>
Apr 11 15:31:51 user nova-compute[71229]:       </nova:ports>
Apr 11 15:31:51 user nova-compute[71229]:     </nova:instance>
Apr 11 15:31:51 user nova-compute[71229]:   </metadata>
Apr 11 15:31:51 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:31:51 user nova-compute[71229]:     <system>
Apr 11 15:31:51 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:31:51 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:31:51 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:31:51 user nova-compute[71229]:       <entry name="serial">6a805345-374c-4326-9e8f-39bfc7947a35</entry>
Apr 11 15:31:51 user nova-compute[71229]:       <entry name="uuid">6a805345-374c-4326-9e8f-39bfc7947a35</entry>
Apr 11 15:31:51 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:31:51 user nova-compute[71229]:     </system>
Apr 11 15:31:51 user nova-compute[71229]:   </sysinfo>
Apr 11 15:31:51 user nova-compute[71229]:   <os>
Apr 11 15:31:51 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:31:51 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 15:31:51 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:31:51 user nova-compute[71229]:   </os>
Apr 11 15:31:51 user nova-compute[71229]:   <features>
Apr 11 15:31:51 user nova-compute[71229]:     <acpi/>
Apr 11 15:31:51 user nova-compute[71229]:     <apic/>
Apr 11 15:31:51 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:31:51 user nova-compute[71229]:   </features>
Apr 11 15:31:51 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:31:51 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:31:51 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:31:51 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:31:51 user nova-compute[71229]:   </clock>
Apr 11 15:31:51 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:31:51 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:31:51 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:31:51 user nova-compute[71229]:   </cpu>
Apr 11 15:31:51 user nova-compute[71229]:   <devices>
Apr 11 15:31:51 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 15:31:51 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 15:31:51 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk"/>
Apr 11 15:31:51 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:31:51 user nova-compute[71229]:     </disk>
Apr 11 15:31:51 user nova-compute[71229]:     <disk type="block" device="disk">
Apr 11 15:31:51 user nova-compute[71229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:31:51 user nova-compute[71229]:       <source dev="/dev/sdc"/>
Apr 11 15:31:51 user nova-compute[71229]:       <target dev="vdb" bus="virtio"/>
Apr 11 15:31:51 user nova-compute[71229]:       <serial>e168e446-1ecb-4f58-bc6c-0f488fa989a2</serial>
Apr 11 15:31:51 user nova-compute[71229]:     </disk>
Apr 11 15:31:51 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:31:51 user nova-compute[71229]:       <mac address="fa:16:3e:0f:f8:cb"/>
Apr 11 15:31:51 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:31:51 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:31:51 user nova-compute[71229]:       <target dev="tapd8c64197-b0"/>
Apr 11 15:31:51 user nova-compute[71229]:     </interface>
Apr 11 15:31:51 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:31:51 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/console.log" append="off"/>
Apr 11 15:31:51 user nova-compute[71229]:     </serial>
Apr 11 15:31:51 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:31:51 user nova-compute[71229]:     <video>
Apr 11 15:31:51 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:31:51 user nova-compute[71229]:     </video>
Apr 11 15:31:51 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:31:51 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:31:51 user nova-compute[71229]:     </rng>
Apr 11 15:31:51 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:31:51 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:31:51 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:31:51 user nova-compute[71229]:     </memballoon>
Apr 11 15:31:51 user nova-compute[71229]:   </devices>
Apr 11 15:31:51 user nova-compute[71229]: </domain>
Apr 11 15:31:51 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:31:51 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T15:21:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1386574519',display_name='tempest-ServerActionsTestJSON-server-252985182',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1386574519',id=3,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfAJGQ+GOa8zW+jlKgD9Kz6/k6iEv9pZIOIjICzcstJ92AAS94+47mc3fRsqyx5FaTMV9P4lTsW4Fy7tKIAtMpRx0Sl7sa6ttQnPbPhlcYqfbdWbTqmmKi6+BuZpqSknA==',key_name='tempest-keypair-1137963694',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:30:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bb7660e8f76b471487136806ee9eec62',ramdisk_id='',reservation_id='r-hmn5p3xn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1659503440',owner_user_name='tempest-ServerActionsTestJSON-1659503440-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:31:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10720df0ac4f4e62a0a5c9883d600add',uuid=6a805345-374c-4326-9e8f-39bfc7947a35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "d8c64197-b034-4f38-821d-ba030f1fca6b", "address": "fa:16:3e:0f:f8:cb", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c64197-b0", "ovs_interfaceid": "d8c64197-b034-4f38-821d-ba030f1fca6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:31:51 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Converting VIF {"id": "d8c64197-b034-4f38-821d-ba030f1fca6b", "address": "fa:16:3e:0f:f8:cb", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c64197-b0", "ovs_interfaceid": "d8c64197-b034-4f38-821d-ba030f1fca6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:31:51 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:f8:cb,bridge_name='br-int',has_traffic_filtering=True,id=d8c64197-b034-4f38-821d-ba030f1fca6b,network=Network(1bd215e8-0459-4dd2-893b-096b6e31ac08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c64197-b0') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:31:51 user nova-compute[71229]: DEBUG os_vif [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:f8:cb,bridge_name='br-int',has_traffic_filtering=True,id=d8c64197-b034-4f38-821d-ba030f1fca6b,network=Network(1bd215e8-0459-4dd2-893b-096b6e31ac08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c64197-b0') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:31:51 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:51 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:31:51 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:31:51 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:51 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd8c64197-b0, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:31:51 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd8c64197-b0, col_values=(('external_ids', {'iface-id': 'd8c64197-b034-4f38-821d-ba030f1fca6b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:f8:cb', 'vm-uuid': '6a805345-374c-4326-9e8f-39bfc7947a35'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:31:51 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:31:51 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:51 user nova-compute[71229]: INFO os_vif [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:f8:cb,bridge_name='br-int',has_traffic_filtering=True,id=d8c64197-b034-4f38-821d-ba030f1fca6b,network=Network(1bd215e8-0459-4dd2-893b-096b6e31ac08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c64197-b0')
Apr 11 15:31:52 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:31:53 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:53 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:53 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:53 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:53 user nova-compute[71229]: DEBUG nova.compute.manager [req-c9e62e4d-846e-4a00-9448-326324e9ff1c req-af48035e-e04f-4e41-884a-0827be9e8b54 service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Received event network-vif-plugged-d8c64197-b034-4f38-821d-ba030f1fca6b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:31:53 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c9e62e4d-846e-4a00-9448-326324e9ff1c req-af48035e-e04f-4e41-884a-0827be9e8b54 service nova] Acquiring lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:31:53 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c9e62e4d-846e-4a00-9448-326324e9ff1c req-af48035e-e04f-4e41-884a-0827be9e8b54 service nova] Lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:31:53 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c9e62e4d-846e-4a00-9448-326324e9ff1c req-af48035e-e04f-4e41-884a-0827be9e8b54 service nova] Lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:31:53 user nova-compute[71229]: DEBUG nova.compute.manager [req-c9e62e4d-846e-4a00-9448-326324e9ff1c req-af48035e-e04f-4e41-884a-0827be9e8b54 service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] No waiting events found dispatching network-vif-plugged-d8c64197-b034-4f38-821d-ba030f1fca6b {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:31:53 user nova-compute[71229]: WARNING nova.compute.manager [req-c9e62e4d-846e-4a00-9448-326324e9ff1c req-af48035e-e04f-4e41-884a-0827be9e8b54 service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Received unexpected event network-vif-plugged-d8c64197-b034-4f38-821d-ba030f1fca6b for instance with vm_state resized and task_state resize_reverting.
Apr 11 15:31:53 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:53 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:53 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:55 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Removed pending event for 6a805345-374c-4326-9e8f-39bfc7947a35 due to event {{(pid=71229) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 15:31:55 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227115.4953978, 6a805345-374c-4326-9e8f-39bfc7947a35 => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:31:55 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] VM Resumed (Lifecycle Event)
Apr 11 15:31:55 user nova-compute[71229]: DEBUG nova.compute.manager [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 15:31:55 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Instance running successfully.
Apr 11 15:31:55 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] finish_revert_migration finished successfully. {{(pid=71229) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11836}}
Apr 11 15:31:55 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:31:55 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:31:55 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 11 15:31:55 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227115.4964883, 6a805345-374c-4326-9e8f-39bfc7947a35 => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:31:55 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] VM Started (Lifecycle Event)
Apr 11 15:31:55 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:31:55 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:31:55 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 11 15:31:55 user nova-compute[71229]: DEBUG nova.compute.manager [req-203d21e9-3f8d-473a-bb53-6fd0ef2c147e req-6fc115db-e274-40ab-ad29-b1be52b29cb8 service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Received event network-vif-plugged-d8c64197-b034-4f38-821d-ba030f1fca6b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:31:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-203d21e9-3f8d-473a-bb53-6fd0ef2c147e req-6fc115db-e274-40ab-ad29-b1be52b29cb8 service nova] Acquiring lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:31:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-203d21e9-3f8d-473a-bb53-6fd0ef2c147e req-6fc115db-e274-40ab-ad29-b1be52b29cb8 service nova] Lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:31:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-203d21e9-3f8d-473a-bb53-6fd0ef2c147e req-6fc115db-e274-40ab-ad29-b1be52b29cb8 service nova] Lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:31:55 user nova-compute[71229]: DEBUG nova.compute.manager [req-203d21e9-3f8d-473a-bb53-6fd0ef2c147e req-6fc115db-e274-40ab-ad29-b1be52b29cb8 service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] No waiting events found dispatching network-vif-plugged-d8c64197-b034-4f38-821d-ba030f1fca6b {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:31:55 user nova-compute[71229]: WARNING nova.compute.manager [req-203d21e9-3f8d-473a-bb53-6fd0ef2c147e req-6fc115db-e274-40ab-ad29-b1be52b29cb8 service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Received unexpected event network-vif-plugged-d8c64197-b034-4f38-821d-ba030f1fca6b for instance with vm_state resized and task_state resize_reverting.
Apr 11 15:31:55 user nova-compute[71229]: INFO nova.compute.manager [None req-bc1cf62d-dcef-4d06-998a-c39d5a8a30ef tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Updating instance to original state: 'active'
Apr 11 15:31:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:31:57 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:31:57 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 15:31:57 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:31:57 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:31:57 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:31:57 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:31:57 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 15:31:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:58 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:31:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85658a44-9ff2-4553-b9fd-686bf35fd6ec/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85658a44-9ff2-4553-b9fd-686bf35fd6ec/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85658a44-9ff2-4553-b9fd-686bf35fd6ec/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85658a44-9ff2-4553-b9fd-686bf35fd6ec/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc25fc1-e59f-42c8-a371-b4b12e17fd59/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc25fc1-e59f-42c8-a371-b4b12e17fd59/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc25fc1-e59f-42c8-a371-b4b12e17fd59/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc25fc1-e59f-42c8-a371-b4b12e17fd59/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d534d17d-ba77-4447-8a63-7d6021ad7896/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d534d17d-ba77-4447-8a63-7d6021ad7896/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d534d17d-ba77-4447-8a63-7d6021ad7896/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d534d17d-ba77-4447-8a63-7d6021ad7896/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4555892-7abb-4a3c-a4ae-a27ad4902708/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4555892-7abb-4a3c-a4ae-a27ad4902708/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4555892-7abb-4a3c-a4ae-a27ad4902708/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4555892-7abb-4a3c-a4ae-a27ad4902708/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:31:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:31:59 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:32:00 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:32:00 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:32:00 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8154MB free_disk=26.112930297851562GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 15:32:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:32:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:32:00 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance de1a45fd-27be-4438-80a4-2f3a100643c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:32:00 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance b0d90fd2-6a95-43c4-8756-e82071d99154 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:32:00 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance e4555892-7abb-4a3c-a4ae-a27ad4902708 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:32:00 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance d534d17d-ba77-4447-8a63-7d6021ad7896 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:32:00 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 7c4329ae-07cb-4f28-9fd6-29b398517d2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:32:00 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 6a805345-374c-4326-9e8f-39bfc7947a35 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:32:00 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance ffc25fc1-e59f-42c8-a371-b4b12e17fd59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:32:00 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 85658a44-9ff2-4553-b9fd-686bf35fd6ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:32:00 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 15:32:00 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 15:32:00 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:32:00 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:32:00 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 15:32:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.441s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:32:00 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:32:00 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71229) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 15:32:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:32:01 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:32:01 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:32:01 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:32:01 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:32:01 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:32:02 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:32:03 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:32:03 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 15:32:03 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Rebuilding the list of instances to heal {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 15:32:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "refresh_cache-de1a45fd-27be-4438-80a4-2f3a100643c9" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:32:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquired lock "refresh_cache-de1a45fd-27be-4438-80a4-2f3a100643c9" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:32:03 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Forcefully refreshing network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 15:32:03 user nova-compute[71229]: DEBUG nova.objects.instance [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lazy-loading 'info_cache' on Instance uuid de1a45fd-27be-4438-80a4-2f3a100643c9 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:32:04 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Updating instance_info_cache with network_info: [{"id": "197ae974-459a-49ab-9d70-89bfaa073f50", "address": "fa:16:3e:03:bb:91", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ae974-45", "ovs_interfaceid": "197ae974-459a-49ab-9d70-89bfaa073f50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:32:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Releasing lock "refresh_cache-de1a45fd-27be-4438-80a4-2f3a100643c9" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:32:04 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Updated the network info_cache for instance {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 15:32:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:32:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:32:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:32:09 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:32:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:32:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:32:12 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:32:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:32:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:32:19 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:32:21 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:32:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:32:26 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "d09cda86-eca1-4c42-8654-758eb6cd30e0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:32:26 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "d09cda86-eca1-4c42-8654-758eb6cd30e0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:32:26 user nova-compute[71229]: DEBUG nova.compute.manager [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Starting instance... {{(pid=71229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 15:32:26 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:32:26 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:32:26 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 15:32:26 user nova-compute[71229]: INFO nova.compute.claims [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Claim successful on node user
Apr 11 15:32:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:32:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:32:27 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:32:27 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:32:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.451s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:32:27 user nova-compute[71229]: DEBUG nova.compute.manager [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Start building networks asynchronously for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 15:32:27 user nova-compute[71229]: DEBUG nova.compute.manager [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Allocating IP information in the background. {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 15:32:27 user nova-compute[71229]: DEBUG nova.network.neutron [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] allocate_for_instance() {{(pid=71229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 15:32:27 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 15:32:27 user nova-compute[71229]: DEBUG nova.compute.manager [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Start building block device mappings for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 15:32:27 user nova-compute[71229]: INFO nova.virt.block_device [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Booting with volume-backed-image 52fe638c-5ada-47d5-b376-233bfa808a37 at /dev/vda
Apr 11 15:32:27 user nova-compute[71229]: DEBUG nova.policy [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1d60ce27bfad4d7c9b976e834df35ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc05e9bf5ab426982ccb3092ad596e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71229) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 15:32:28 user nova-compute[71229]: DEBUG nova.network.neutron [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Successfully created port: 27d62f09-c938-4a71-be1e-6dc1d6a47382 {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 15:32:29 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:32:29 user nova-compute[71229]: DEBUG nova.network.neutron [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Successfully updated port: 27d62f09-c938-4a71-be1e-6dc1d6a47382 {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:32:29 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "refresh_cache-d09cda86-eca1-4c42-8654-758eb6cd30e0" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:32:29 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquired lock "refresh_cache-d09cda86-eca1-4c42-8654-758eb6cd30e0" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:32:29 user nova-compute[71229]: DEBUG nova.network.neutron [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:32:29 user nova-compute[71229]: DEBUG nova.compute.manager [req-617c3f3a-90b1-4e9f-b828-e1304b0c4bc1 req-8c62a1da-cc1f-4b71-8a14-fa9cec244021 service nova] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Received event network-changed-27d62f09-c938-4a71-be1e-6dc1d6a47382 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:32:29 user nova-compute[71229]: DEBUG nova.compute.manager [req-617c3f3a-90b1-4e9f-b828-e1304b0c4bc1 req-8c62a1da-cc1f-4b71-8a14-fa9cec244021 service nova] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Refreshing instance network info cache due to event network-changed-27d62f09-c938-4a71-be1e-6dc1d6a47382. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:32:29 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-617c3f3a-90b1-4e9f-b828-e1304b0c4bc1 req-8c62a1da-cc1f-4b71-8a14-fa9cec244021 service nova] Acquiring lock "refresh_cache-d09cda86-eca1-4c42-8654-758eb6cd30e0" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:32:29 user nova-compute[71229]: DEBUG nova.network.neutron [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:32:30 user nova-compute[71229]: DEBUG nova.network.neutron [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Updating instance_info_cache with network_info: [{"id": "27d62f09-c938-4a71-be1e-6dc1d6a47382", "address": "fa:16:3e:53:ab:3d", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d62f09-c9", "ovs_interfaceid": "27d62f09-c938-4a71-be1e-6dc1d6a47382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:32:30 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Releasing lock "refresh_cache-d09cda86-eca1-4c42-8654-758eb6cd30e0" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:32:30 user nova-compute[71229]: DEBUG nova.compute.manager [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Instance network_info: |[{"id": "27d62f09-c938-4a71-be1e-6dc1d6a47382", "address": "fa:16:3e:53:ab:3d", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d62f09-c9", "ovs_interfaceid": "27d62f09-c938-4a71-be1e-6dc1d6a47382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 15:32:30 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-617c3f3a-90b1-4e9f-b828-e1304b0c4bc1 req-8c62a1da-cc1f-4b71-8a14-fa9cec244021 service nova] Acquired lock "refresh_cache-d09cda86-eca1-4c42-8654-758eb6cd30e0" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:32:30 user nova-compute[71229]: DEBUG nova.network.neutron [req-617c3f3a-90b1-4e9f-b828-e1304b0c4bc1 req-8c62a1da-cc1f-4b71-8a14-fa9cec244021 service nova] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Refreshing network info cache for port 27d62f09-c938-4a71-be1e-6dc1d6a47382 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:32:30 user nova-compute[71229]: DEBUG nova.network.neutron [req-617c3f3a-90b1-4e9f-b828-e1304b0c4bc1 req-8c62a1da-cc1f-4b71-8a14-fa9cec244021 service nova] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Updated VIF entry in instance network info cache for port 27d62f09-c938-4a71-be1e-6dc1d6a47382. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:32:30 user nova-compute[71229]: DEBUG nova.network.neutron [req-617c3f3a-90b1-4e9f-b828-e1304b0c4bc1 req-8c62a1da-cc1f-4b71-8a14-fa9cec244021 service nova] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Updating instance_info_cache with network_info: [{"id": "27d62f09-c938-4a71-be1e-6dc1d6a47382", "address": "fa:16:3e:53:ab:3d", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d62f09-c9", "ovs_interfaceid": "27d62f09-c938-4a71-be1e-6dc1d6a47382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:32:30 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-617c3f3a-90b1-4e9f-b828-e1304b0c4bc1 req-8c62a1da-cc1f-4b71-8a14-fa9cec244021 service nova] Releasing lock "refresh_cache-d09cda86-eca1-4c42-8654-758eb6cd30e0" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:32:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:32:32 user nova-compute[71229]: DEBUG os_brick.utils [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:32:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:33 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c350f3-b17c-4a43-8661-f3f19ebbf0a2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d55e24a97c90\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:33 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[db53716b-2442-4342-b8bc-8e4d14f074a6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:33 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a788259-ea62-4073-852e-704dc6573442]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:33 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3eefb7f-407a-41bf-a4c1-f998e0fdc6bd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Running cmd (subprocess): nvme version {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] 'nvme version' failed. Not Retrying. {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:32:33 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] nvme not present on system {{(pid=71229) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 15:32:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:32:33 user nova-compute[71229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 15:32:33 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab466b4-4c22-4e60-a220-d70dc605f886]: (4, '') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:33 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71229) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 15:32:33 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 15:32:33 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] LIGHTOS: no hostnqn found. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 15:32:33 user nova-compute[71229]: DEBUG os_brick.utils [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d55e24a97c90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:32:33 user nova-compute[71229]: DEBUG nova.virt.block_device [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Updating existing volume attachment record: 92c4e9b8-14a3-413a-9e09-06b54b585ceb {{(pid=71229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 15:32:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG nova.compute.manager [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Start spawning the instance on the hypervisor. {{(pid=71229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Creating instance directory {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 15:32:37 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Creating image(s)
Apr 11 15:32:37 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Did not create local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Ensure instance console log exists: /opt/stack/data/nova/instances/d09cda86-eca1-4c42-8654-758eb6cd30e0/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Start _get_guest_xml network_info=[{"id": "27d62f09-c938-4a71-be1e-6dc1d6a47382", "address": "fa:16:3e:53:ab:3d", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d62f09-c9", "ovs_interfaceid": "27d62f09-c938-4a71-be1e-6dc1d6a47382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kDmHLYlZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd09cda86-eca1-4c42-8654-758eb6cd30e0', 'attached_at': '', 'detached_at': '', 'volume_id': 'd9ef701f-85e1-4a0a-84e9-73468c0792c4', 'serial': 'd9ef701f-85e1-4a0a-84e9-73468c0792c4'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '92c4e9b8-14a3-413a-9e09-06b54b585ceb', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:32:37 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:32:37 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:32:37 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kDmHLYlZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:32:37 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:32:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:32:37 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:32:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:32:37 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 15:32:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad68fc9c-8598-4759-aa3f-81d8426f3394]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 15:32:37 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 -p 172.16.0.220:3260 --interface default --op new {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d4627e-d420-4071-931d-107c4381fc53]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4] added\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4] added
Apr 11 15:32:37 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.040s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a39f36-acee-4079-843b-976690ed7924]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ce1f6d-4f78-445f-9088-85fb8d8a7f23]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kDmHLYlZ {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kDmHLYlZ" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c032b061-3c24-40b2-bb86-5ef386e25866]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kDmHLYlZ'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6736b5d-155e-4200-8b8c-9a4f899d15e6]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b021cb-989e-42f5-aec8-5c896e07794a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:32:37 user nova-compute[71229]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:32:37 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:32:37 user nova-compute[71229]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:32:37 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 -p 172.16.0.220:3260 --login {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[660f5b2d-ad74-4083-a78d-187f97fcd5b2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4, portal: 172.16.0.220,3260]
Apr 11 15:32:37 user nova-compute[71229]: Login to [iface: default, target: iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4, portal: 172.16.0.220,3260] successful.
Apr 11 15:32:37 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0041cc6a-1efe-45aa-97d7-dc94fcd4aa20]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70b88f3-fe3a-4a84-8578-4b1d697ff7ad]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:32:37 user nova-compute[71229]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:32:37 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:32:37 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:32:37 user nova-compute[71229]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:32:37 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:32:37 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af952b6-e0c2-4cca-aeee-cbf484082d70]: (4, ('- - 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:37 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: None {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:32:38 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:32:38 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kDmHLYlZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 15:32:38 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:32:38 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23766393266616531', 'path': '/dev/sdd'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:32:38 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766393266616531', 'path': '/dev/sdd'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 15:32:38 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:32:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-315252386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-315252386',id=23,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ddc05e9bf5ab426982ccb3092ad596e4',ramdisk_id='',reservation_id='r-x2r0o2x4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1907753459',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:32:27Z,user_data=None,user_id='1d60ce27bfad4d7c9b976e834df35ad4',uuid=d09cda86-eca1-4c42-8654-758eb6cd30e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27d62f09-c938-4a71-be1e-6dc1d6a47382", "address": "fa:16:3e:53:ab:3d", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d62f09-c9", "ovs_interfaceid": "27d62f09-c938-4a71-be1e-6dc1d6a47382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:32:38 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Converting VIF {"id": "27d62f09-c938-4a71-be1e-6dc1d6a47382", "address": "fa:16:3e:53:ab:3d", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d62f09-c9", "ovs_interfaceid": "27d62f09-c938-4a71-be1e-6dc1d6a47382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:32:38 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:ab:3d,bridge_name='br-int',has_traffic_filtering=True,id=27d62f09-c938-4a71-be1e-6dc1d6a47382,network=Network(1cf4cec3-ff08-4320-89e4-aa7e8cf75eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27d62f09-c9') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:32:38 user nova-compute[71229]: DEBUG nova.objects.instance [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lazy-loading 'pci_devices' on Instance uuid d09cda86-eca1-4c42-8654-758eb6cd30e0 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:32:38 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:32:38 user nova-compute[71229]:   <uuid>d09cda86-eca1-4c42-8654-758eb6cd30e0</uuid>
Apr 11 15:32:38 user nova-compute[71229]:   <name>instance-00000017</name>
Apr 11 15:32:38 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:32:38 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:32:38 user nova-compute[71229]:   <metadata>
Apr 11 15:32:38 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:32:38 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:32:38 user nova-compute[71229]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-315252386</nova:name>
Apr 11 15:32:38 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:32:37</nova:creationTime>
Apr 11 15:32:38 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:32:38 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:32:38 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:32:38 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:32:38 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:32:38 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:32:38 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:32:38 user nova-compute[71229]:       <nova:owner>
Apr 11 15:32:38 user nova-compute[71229]:         <nova:user uuid="1d60ce27bfad4d7c9b976e834df35ad4">tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member</nova:user>
Apr 11 15:32:38 user nova-compute[71229]:         <nova:project uuid="ddc05e9bf5ab426982ccb3092ad596e4">tempest-ServerBootFromVolumeStableRescueTest-1907753459</nova:project>
Apr 11 15:32:38 user nova-compute[71229]:       </nova:owner>
Apr 11 15:32:38 user nova-compute[71229]:       <nova:root type="image" uuid="52fe638c-5ada-47d5-b376-233bfa808a37"/>
Apr 11 15:32:38 user nova-compute[71229]:       <nova:ports>
Apr 11 15:32:38 user nova-compute[71229]:         <nova:port uuid="27d62f09-c938-4a71-be1e-6dc1d6a47382">
Apr 11 15:32:38 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 11 15:32:38 user nova-compute[71229]:         </nova:port>
Apr 11 15:32:38 user nova-compute[71229]:       </nova:ports>
Apr 11 15:32:38 user nova-compute[71229]:     </nova:instance>
Apr 11 15:32:38 user nova-compute[71229]:   </metadata>
Apr 11 15:32:38 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:32:38 user nova-compute[71229]:     <system>
Apr 11 15:32:38 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:32:38 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:32:38 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:32:38 user nova-compute[71229]:       <entry name="serial">d09cda86-eca1-4c42-8654-758eb6cd30e0</entry>
Apr 11 15:32:38 user nova-compute[71229]:       <entry name="uuid">d09cda86-eca1-4c42-8654-758eb6cd30e0</entry>
Apr 11 15:32:38 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:32:38 user nova-compute[71229]:     </system>
Apr 11 15:32:38 user nova-compute[71229]:   </sysinfo>
Apr 11 15:32:38 user nova-compute[71229]:   <os>
Apr 11 15:32:38 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:32:38 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 15:32:38 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:32:38 user nova-compute[71229]:   </os>
Apr 11 15:32:38 user nova-compute[71229]:   <features>
Apr 11 15:32:38 user nova-compute[71229]:     <acpi/>
Apr 11 15:32:38 user nova-compute[71229]:     <apic/>
Apr 11 15:32:38 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:32:38 user nova-compute[71229]:   </features>
Apr 11 15:32:38 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:32:38 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:32:38 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:32:38 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:32:38 user nova-compute[71229]:   </clock>
Apr 11 15:32:38 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:32:38 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:32:38 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:32:38 user nova-compute[71229]:   </cpu>
Apr 11 15:32:38 user nova-compute[71229]:   <devices>
Apr 11 15:32:38 user nova-compute[71229]:     <disk type="block" device="disk">
Apr 11 15:32:38 user nova-compute[71229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:32:38 user nova-compute[71229]:       <source dev="/dev/sdd"/>
Apr 11 15:32:38 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:32:38 user nova-compute[71229]:       <serial>d9ef701f-85e1-4a0a-84e9-73468c0792c4</serial>
Apr 11 15:32:38 user nova-compute[71229]:     </disk>
Apr 11 15:32:38 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:32:38 user nova-compute[71229]:       <mac address="fa:16:3e:53:ab:3d"/>
Apr 11 15:32:38 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:32:38 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:32:38 user nova-compute[71229]:       <target dev="tap27d62f09-c9"/>
Apr 11 15:32:38 user nova-compute[71229]:     </interface>
Apr 11 15:32:38 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:32:38 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/d09cda86-eca1-4c42-8654-758eb6cd30e0/console.log" append="off"/>
Apr 11 15:32:38 user nova-compute[71229]:     </serial>
Apr 11 15:32:38 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:32:38 user nova-compute[71229]:     <video>
Apr 11 15:32:38 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:32:38 user nova-compute[71229]:     </video>
Apr 11 15:32:38 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:32:38 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:32:38 user nova-compute[71229]:     </rng>
Apr 11 15:32:38 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:32:38 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:32:38 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:32:38 user nova-compute[71229]:     </memballoon>
Apr 11 15:32:38 user nova-compute[71229]:   </devices>
Apr 11 15:32:38 user nova-compute[71229]: </domain>
Apr 11 15:32:38 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:32:38 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:32:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-315252386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-315252386',id=23,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ddc05e9bf5ab426982ccb3092ad596e4',ramdisk_id='',reservation_id='r-x2r0o2x4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1907753459',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:32:27Z,user_data=None,user_id='1d60ce27bfad4d7c9b976e834df35ad4',uuid=d09cda86-eca1-4c42-8654-758eb6cd30e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27d62f09-c938-4a71-be1e-6dc1d6a47382", "address": "fa:16:3e:53:ab:3d", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d62f09-c9", "ovs_interfaceid": "27d62f09-c938-4a71-be1e-6dc1d6a47382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:32:38 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Converting VIF {"id": "27d62f09-c938-4a71-be1e-6dc1d6a47382", "address": "fa:16:3e:53:ab:3d", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d62f09-c9", "ovs_interfaceid": "27d62f09-c938-4a71-be1e-6dc1d6a47382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:32:38 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:ab:3d,bridge_name='br-int',has_traffic_filtering=True,id=27d62f09-c938-4a71-be1e-6dc1d6a47382,network=Network(1cf4cec3-ff08-4320-89e4-aa7e8cf75eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27d62f09-c9') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:32:38 user nova-compute[71229]: DEBUG os_vif [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:ab:3d,bridge_name='br-int',has_traffic_filtering=True,id=27d62f09-c938-4a71-be1e-6dc1d6a47382,network=Network(1cf4cec3-ff08-4320-89e4-aa7e8cf75eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27d62f09-c9') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:32:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:32:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:32:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:32:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:32:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27d62f09-c9, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:32:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap27d62f09-c9, col_values=(('external_ids', {'iface-id': '27d62f09-c938-4a71-be1e-6dc1d6a47382', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:ab:3d', 'vm-uuid': 'd09cda86-eca1-4c42-8654-758eb6cd30e0'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:32:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:32:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:32:38 user nova-compute[71229]: INFO os_vif [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:ab:3d,bridge_name='br-int',has_traffic_filtering=True,id=27d62f09-c938-4a71-be1e-6dc1d6a47382,network=Network(1cf4cec3-ff08-4320-89e4-aa7e8cf75eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27d62f09-c9')
Apr 11 15:32:38 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:32:38 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] No VIF found with MAC fa:16:3e:53:ab:3d, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:32:40 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:32:40 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:32:40 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:32:40 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:32:40 user nova-compute[71229]: DEBUG nova.compute.manager [req-70a93161-efc3-4cdf-9c41-6062251e8b28 req-c8c62aee-f3c4-4e83-8879-6b4194a783b8 service nova] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Received event network-vif-plugged-27d62f09-c938-4a71-be1e-6dc1d6a47382 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:32:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-70a93161-efc3-4cdf-9c41-6062251e8b28 req-c8c62aee-f3c4-4e83-8879-6b4194a783b8 service nova] Acquiring lock "d09cda86-eca1-4c42-8654-758eb6cd30e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:32:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-70a93161-efc3-4cdf-9c41-6062251e8b28 req-c8c62aee-f3c4-4e83-8879-6b4194a783b8 service nova] Lock "d09cda86-eca1-4c42-8654-758eb6cd30e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:32:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-70a93161-efc3-4cdf-9c41-6062251e8b28 req-c8c62aee-f3c4-4e83-8879-6b4194a783b8 service nova] Lock "d09cda86-eca1-4c42-8654-758eb6cd30e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:32:40 user nova-compute[71229]: DEBUG nova.compute.manager [req-70a93161-efc3-4cdf-9c41-6062251e8b28 req-c8c62aee-f3c4-4e83-8879-6b4194a783b8 service nova] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] No waiting events found dispatching network-vif-plugged-27d62f09-c938-4a71-be1e-6dc1d6a47382 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:32:40 user nova-compute[71229]: WARNING nova.compute.manager [req-70a93161-efc3-4cdf-9c41-6062251e8b28 req-c8c62aee-f3c4-4e83-8879-6b4194a783b8 service nova] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Received unexpected event network-vif-plugged-27d62f09-c938-4a71-be1e-6dc1d6a47382 for instance with vm_state building and task_state spawning.
Apr 11 15:32:40 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:32:40 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:32:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "d534d17d-ba77-4447-8a63-7d6021ad7896" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:32:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "d534d17d-ba77-4447-8a63-7d6021ad7896" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:32:41 user nova-compute[71229]: DEBUG nova.objects.instance [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lazy-loading 'flavor' on Instance uuid d534d17d-ba77-4447-8a63-7d6021ad7896 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:32:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "d534d17d-ba77-4447-8a63-7d6021ad7896" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:32:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "d534d17d-ba77-4447-8a63-7d6021ad7896" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:32:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "d534d17d-ba77-4447-8a63-7d6021ad7896" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:32:41 user nova-compute[71229]: INFO nova.compute.manager [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Attaching volume 03f9a930-7552-492c-b996-4c3b05c42706 to /dev/vdb
Apr 11 15:32:41 user nova-compute[71229]: DEBUG os_brick.utils [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:32:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:41 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e28bedd-3d9b-4e86-afb6-23672ec2db64]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d55e24a97c90\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:41 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a24a34-4736-4c15-aee1-3be3171595d3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:41 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff20ab03-9cb8-40a9-8753-6c0304df5382]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:41 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad857280-9b1f-431a-bd3c-36219ba37fb8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Running cmd (subprocess): nvme version {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] 'nvme version' failed. Not Retrying. {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:32:41 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] nvme not present on system {{(pid=71229) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 15:32:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:32:41 user nova-compute[71229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 15:32:41 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[089b454c-896d-4cd2-aa1f-15bb4542d594]: (4, '') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:41 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71229) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 15:32:41 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 15:32:41 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] LIGHTOS: no hostnqn found. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 15:32:41 user nova-compute[71229]: DEBUG os_brick.utils [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d55e24a97c90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:32:41 user nova-compute[71229]: DEBUG nova.virt.block_device [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Updating existing volume attachment record: 102159e4-41be-401c-b029-85fcf183656b {{(pid=71229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 15:32:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:32:42 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227162.2585065, d09cda86-eca1-4c42-8654-758eb6cd30e0 => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:32:42 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] VM Resumed (Lifecycle Event)
Apr 11 15:32:42 user nova-compute[71229]: DEBUG nova.compute.manager [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 15:32:42 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Guest created on hypervisor {{(pid=71229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 15:32:42 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Instance spawned successfully.
Apr 11 15:32:42 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 15:32:42 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:32:42 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:32:42 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Found default for hw_cdrom_bus of ide {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:32:42 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Found default for hw_disk_bus of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:32:42 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Found default for hw_input_bus of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:32:42 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Found default for hw_pointer_model of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:32:42 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Found default for hw_video_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:32:42 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Found default for hw_vif_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:32:42 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:32:42 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227162.2606583, d09cda86-eca1-4c42-8654-758eb6cd30e0 => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:32:42 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] VM Started (Lifecycle Event)
Apr 11 15:32:42 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:32:42 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:32:42 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:32:42 user nova-compute[71229]: DEBUG nova.compute.manager [req-91501704-a544-499b-8495-b1ca6be3ecc4 req-665b6559-b758-46a7-9a7d-dad2c7d60042 service nova] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Received event network-vif-plugged-27d62f09-c938-4a71-be1e-6dc1d6a47382 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:32:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-91501704-a544-499b-8495-b1ca6be3ecc4 req-665b6559-b758-46a7-9a7d-dad2c7d60042 service nova] Acquiring lock "d09cda86-eca1-4c42-8654-758eb6cd30e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:32:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-91501704-a544-499b-8495-b1ca6be3ecc4 req-665b6559-b758-46a7-9a7d-dad2c7d60042 service nova] Lock "d09cda86-eca1-4c42-8654-758eb6cd30e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:32:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-91501704-a544-499b-8495-b1ca6be3ecc4 req-665b6559-b758-46a7-9a7d-dad2c7d60042 service nova] Lock "d09cda86-eca1-4c42-8654-758eb6cd30e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:32:42 user nova-compute[71229]: DEBUG nova.compute.manager [req-91501704-a544-499b-8495-b1ca6be3ecc4 req-665b6559-b758-46a7-9a7d-dad2c7d60042 service nova] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] No waiting events found dispatching network-vif-plugged-27d62f09-c938-4a71-be1e-6dc1d6a47382 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:32:42 user nova-compute[71229]: WARNING nova.compute.manager [req-91501704-a544-499b-8495-b1ca6be3ecc4 req-665b6559-b758-46a7-9a7d-dad2c7d60042 service nova] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Received unexpected event network-vif-plugged-27d62f09-c938-4a71-be1e-6dc1d6a47382 for instance with vm_state building and task_state spawning.
Apr 11 15:32:42 user nova-compute[71229]: INFO nova.compute.manager [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Took 5.09 seconds to spawn the instance on the hypervisor.
Apr 11 15:32:42 user nova-compute[71229]: DEBUG nova.compute.manager [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:32:42 user nova-compute[71229]: INFO nova.compute.manager [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Took 15.91 seconds to build instance.
Apr 11 15:32:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b6ba263f-9e20-448e-9552-1eb4866b03f9 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "d09cda86-eca1-4c42-8654-758eb6cd30e0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.005s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:32:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Acquiring lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:32:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:32:42 user nova-compute[71229]: DEBUG nova.compute.manager [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Starting instance... {{(pid=71229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 15:32:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:32:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:32:43 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 15:32:43 user nova-compute[71229]: INFO nova.compute.claims [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Claim successful on node user
Apr 11 15:32:43 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:32:43 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:32:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.409s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:32:43 user nova-compute[71229]: DEBUG nova.compute.manager [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Start building networks asynchronously for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 15:32:43 user nova-compute[71229]: DEBUG nova.compute.manager [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Allocating IP information in the background. {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 15:32:43 user nova-compute[71229]: DEBUG nova.network.neutron [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] allocate_for_instance() {{(pid=71229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 15:32:43 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 15:32:43 user nova-compute[71229]: DEBUG nova.compute.manager [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Start building block device mappings for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 15:32:43 user nova-compute[71229]: INFO nova.virt.block_device [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Booting with volume 08362a1c-0e13-45ed-84c9-e9bcb01bf532 at /dev/vda
Apr 11 15:32:43 user nova-compute[71229]: DEBUG os_brick.utils [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:32:43 user nova-compute[71229]: DEBUG nova.policy [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '645eeb4fbb2a46d09fd18eaf7de500d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df6e56783b84282be0ca425358015dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71229) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 15:32:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:43 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f1805a-4140-44ef-a94c-143efd2851e6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d55e24a97c90\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:43 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:32:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:43 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d90502-06c6-4fc3-af86-b838306fddd5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:43 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab38137f-94aa-493d-854f-6baec6c742d4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:43 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a901e3-f07b-459b-a70a-b79c39ae33b2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Running cmd (subprocess): nvme version {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] 'nvme version' failed. Not Retrying. {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:32:43 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] nvme not present on system {{(pid=71229) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 15:32:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:32:43 user nova-compute[71229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 15:32:43 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3d5d81-6ab0-4d60-aa29-06eed185abc7]: (4, '') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:43 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71229) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 15:32:43 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 15:32:43 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] LIGHTOS: no hostnqn found. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 15:32:43 user nova-compute[71229]: DEBUG os_brick.utils [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d55e24a97c90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:32:43 user nova-compute[71229]: DEBUG nova.virt.block_device [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Updating existing volume attachment record: ecf7a55e-55ed-473d-8cf8-13efd779112a {{(pid=71229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 15:32:44 user nova-compute[71229]: DEBUG nova.network.neutron [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Successfully created port: 7485c140-3c08-4191-9929-3c41cb6fd725 {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 15:32:45 user nova-compute[71229]: DEBUG nova.network.neutron [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Successfully created port: 44becdbc-fa86-4dbe-ac1a-e0e01648513b {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 15:32:45 user nova-compute[71229]: DEBUG nova.network.neutron [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Successfully created port: bf63f34a-3145-4251-a036-a35bd08ef45f {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 15:32:45 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 15:32:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:03f9a930-7552-492c-b996-4c3b05c42706', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IyOWuYTn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:32:45 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:32:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:32:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:32:45 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:32:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03f9a930-7552-492c-b996-4c3b05c42706" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:32:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03f9a930-7552-492c-b996-4c3b05c42706" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:32:45 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 15:32:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f9a930-7552-492c-b996-4c3b05c42706 -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f9a930-7552-492c-b996-4c3b05c42706 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:45 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33df72a-9bde-487b-9c8c-93464e6ed78f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 15:32:45 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:32:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f9a930-7552-492c-b996-4c3b05c42706 -p 172.16.0.220:3260 --interface default --op new {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f9a930-7552-492c-b996-4c3b05c42706 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:45 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[221ac0b3-48d6-4dc6-bbd3-8e9b4f7d76b3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03f9a930-7552-492c-b996-4c3b05c42706] added\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03f9a930-7552-492c-b996-4c3b05c42706] added
Apr 11 15:32:45 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:32:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f9a930-7552-492c-b996-4c3b05c42706 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f9a930-7552-492c-b996-4c3b05c42706 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:45 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3d5872-2d88-4d1d-b93b-1efb24de2d3e]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:32:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f9a930-7552-492c-b996-4c3b05c42706 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f9a930-7552-492c-b996-4c3b05c42706 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:45 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2836e193-b359-4924-87c8-61ca261e2fae]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:32:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f9a930-7552-492c-b996-4c3b05c42706 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IyOWuYTn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:46 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f9a930-7552-492c-b996-4c3b05c42706 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IyOWuYTn" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:46 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d15764-d3bc-4aed-8a58-65135a3e24c5]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:46 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IyOWuYTn'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:32:46 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f9a930-7552-492c-b996-4c3b05c42706 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:46 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f9a930-7552-492c-b996-4c3b05c42706 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:46 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5de1e5-a91c-40f1-9cbb-67d42de10d35]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:46 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:32:46 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:46 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:46 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9630bf-baca-4e4e-862f-f8a948f1c3ec]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:46 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:32:46 user nova-compute[71229]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:32:46 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:32:46 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:32:46 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:32:46 user nova-compute[71229]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:32:46 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:32:46 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:32:46 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f9a930-7552-492c-b996-4c3b05c42706 -p 172.16.0.220:3260 --login {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:46 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f9a930-7552-492c-b996-4c3b05c42706 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:46 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d241b5-4274-4b65-9c1e-89a3ddef6135]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:03f9a930-7552-492c-b996-4c3b05c42706, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:03f9a930-7552-492c-b996-4c3b05c42706, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:46 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:03f9a930-7552-492c-b996-4c3b05c42706, portal: 172.16.0.220,3260]
Apr 11 15:32:46 user nova-compute[71229]: Login to [iface: default, target: iqn.2010-10.org.openstack:03f9a930-7552-492c-b996-4c3b05c42706, portal: 172.16.0.220,3260] successful.
Apr 11 15:32:46 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:32:46 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f9a930-7552-492c-b996-4c3b05c42706 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:46 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f9a930-7552-492c-b996-4c3b05c42706 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:46 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e71834a-a542-4b44-93b9-4bbf77b70f25]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:46 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:32:46 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:46 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:46 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f738fc98-59f4-4990-ad4b-ef8d7275144b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f9a930-7552-492c-b996-4c3b05c42706 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:46 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:32:46 user nova-compute[71229]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:32:46 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:32:46 user nova-compute[71229]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f9a930-7552-492c-b996-4c3b05c42706 (non-flash)
Apr 11 15:32:46 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:32:46 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:32:46 user nova-compute[71229]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:32:46 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:32:46 user nova-compute[71229]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f9a930-7552-492c-b996-4c3b05c42706 (non-flash)
Apr 11 15:32:46 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:32:46 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03f9a930-7552-492c-b996-4c3b05c42706" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:32:46 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 15:32:46 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 15:32:46 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 15:32:46 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:46 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:46 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6620bc9-33c1-4f1c-b20a-f8e7fe1986d1]: (4, ('- - 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:46 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:32:46 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:03f9a930-7552-492c-b996-4c3b05c42706', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IyOWuYTn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 15:32:46 user nova-compute[71229]: DEBUG nova.network.neutron [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Successfully created port: e5066fdb-ea6f-4df5-b185-56f1a0dbe539 {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 15:32:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:32:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:32:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] <== connect_volume: return (1388ms) {'type': 'block', 'scsi_wwn': '23432363533316339', 'path': '/dev/sde'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:32:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23432363533316339', 'path': '/dev/sde'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 15:32:47 user nova-compute[71229]: DEBUG nova.objects.instance [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lazy-loading 'flavor' on Instance uuid d534d17d-ba77-4447-8a63-7d6021ad7896 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:32:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 15:32:47 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:32:47 user nova-compute[71229]:   <source dev="/dev/sde"/>
Apr 11 15:32:47 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 15:32:47 user nova-compute[71229]:   <serial>03f9a930-7552-492c-b996-4c3b05c42706</serial>
Apr 11 15:32:47 user nova-compute[71229]: </disk>
Apr 11 15:32:47 user nova-compute[71229]:  {{(pid=71229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 15:32:47 user nova-compute[71229]: DEBUG nova.network.neutron [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Successfully created port: b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 15:32:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:32:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:32:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] No VIF found with MAC fa:16:3e:61:6a:d2, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:32:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-493318c3-5526-43c2-bff5-4b997a8657ad tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "d534d17d-ba77-4447-8a63-7d6021ad7896" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.562s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:32:48 user nova-compute[71229]: DEBUG nova.network.neutron [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Successfully updated port: 7485c140-3c08-4191-9929-3c41cb6fd725 {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:32:48 user nova-compute[71229]: DEBUG nova.compute.manager [req-fbaec3fc-c259-4e26-af7d-818b29068f89 req-af7995d6-767c-4cdb-a757-d2711278c630 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received event network-changed-7485c140-3c08-4191-9929-3c41cb6fd725 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:32:48 user nova-compute[71229]: DEBUG nova.compute.manager [req-fbaec3fc-c259-4e26-af7d-818b29068f89 req-af7995d6-767c-4cdb-a757-d2711278c630 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Refreshing instance network info cache due to event network-changed-7485c140-3c08-4191-9929-3c41cb6fd725. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:32:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-fbaec3fc-c259-4e26-af7d-818b29068f89 req-af7995d6-767c-4cdb-a757-d2711278c630 service nova] Acquiring lock "refresh_cache-fa6dc9c1-6786-4c17-a23e-f71c21ac08a7" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:32:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-fbaec3fc-c259-4e26-af7d-818b29068f89 req-af7995d6-767c-4cdb-a757-d2711278c630 service nova] Acquired lock "refresh_cache-fa6dc9c1-6786-4c17-a23e-f71c21ac08a7" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:32:48 user nova-compute[71229]: DEBUG nova.network.neutron [req-fbaec3fc-c259-4e26-af7d-818b29068f89 req-af7995d6-767c-4cdb-a757-d2711278c630 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Refreshing network info cache for port 7485c140-3c08-4191-9929-3c41cb6fd725 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:32:48 user nova-compute[71229]: DEBUG nova.network.neutron [req-fbaec3fc-c259-4e26-af7d-818b29068f89 req-af7995d6-767c-4cdb-a757-d2711278c630 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:32:48 user nova-compute[71229]: INFO nova.virt.block_device [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Booting with volume 19a0b36e-cc56-4f19-904a-03c416d6a452 at /dev/vdb
Apr 11 15:32:48 user nova-compute[71229]: DEBUG os_brick.utils [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:32:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce9cce0-1991-45c9-ba5c-442d2772d62c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d55e24a97c90\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d80fab-d7a1-46bb-b6d8-ffc347c8db8d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2485edc8-7438-4ce4-8a69-cfc36a833fe1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f40754-68da-4eda-9908-08139a351881]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Running cmd (subprocess): nvme version {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] 'nvme version' failed. Not Retrying. {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:32:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] nvme not present on system {{(pid=71229) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 15:32:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:48 user nova-compute[71229]: DEBUG nova.network.neutron [req-fbaec3fc-c259-4e26-af7d-818b29068f89 req-af7995d6-767c-4cdb-a757-d2711278c630 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:32:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:32:48 user nova-compute[71229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 15:32:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6618f332-63b2-408c-9f63-12b6f8db6007]: (4, '') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71229) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 15:32:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 15:32:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] LIGHTOS: no hostnqn found. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 15:32:48 user nova-compute[71229]: DEBUG os_brick.utils [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d55e24a97c90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:32:48 user nova-compute[71229]: DEBUG nova.virt.block_device [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Updating existing volume attachment record: ce4ea7cf-fbc8-42ba-a3b7-0e094eda28a9 {{(pid=71229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 15:32:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-fbaec3fc-c259-4e26-af7d-818b29068f89 req-af7995d6-767c-4cdb-a757-d2711278c630 service nova] Releasing lock "refresh_cache-fa6dc9c1-6786-4c17-a23e-f71c21ac08a7" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:32:48 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:32:48 user nova-compute[71229]: DEBUG nova.network.neutron [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Successfully updated port: b7d90fa1-965a-4cc7-bc48-64a43041af23 {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:32:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-270db701-b5bd-4916-859f-b6272194f217 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "d534d17d-ba77-4447-8a63-7d6021ad7896" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:32:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-270db701-b5bd-4916-859f-b6272194f217 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "d534d17d-ba77-4447-8a63-7d6021ad7896" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:32:49 user nova-compute[71229]: INFO nova.compute.manager [None req-270db701-b5bd-4916-859f-b6272194f217 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Detaching volume 03f9a930-7552-492c-b996-4c3b05c42706
Apr 11 15:32:49 user nova-compute[71229]: DEBUG nova.network.neutron [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Successfully updated port: fafe4f73-4fc5-401b-a2bf-542bea23915f {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:32:49 user nova-compute[71229]: INFO nova.virt.block_device [None req-270db701-b5bd-4916-859f-b6272194f217 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Attempting to driver detach volume 03f9a930-7552-492c-b996-4c3b05c42706 from mountpoint /dev/vdb
Apr 11 15:32:49 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-270db701-b5bd-4916-859f-b6272194f217 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Attempting to detach device vdb from instance d534d17d-ba77-4447-8a63-7d6021ad7896 from the persistent domain config. {{(pid=71229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 15:32:49 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-270db701-b5bd-4916-859f-b6272194f217 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 15:32:49 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:32:49 user nova-compute[71229]:   <source dev="/dev/sde"/>
Apr 11 15:32:49 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 15:32:49 user nova-compute[71229]:   <serial>03f9a930-7552-492c-b996-4c3b05c42706</serial>
Apr 11 15:32:49 user nova-compute[71229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 15:32:49 user nova-compute[71229]: </disk>
Apr 11 15:32:49 user nova-compute[71229]:  {{(pid=71229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 15:32:49 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-270db701-b5bd-4916-859f-b6272194f217 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Successfully detached device vdb from instance d534d17d-ba77-4447-8a63-7d6021ad7896 from the persistent domain config.
Apr 11 15:32:49 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-270db701-b5bd-4916-859f-b6272194f217 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d534d17d-ba77-4447-8a63-7d6021ad7896 from the live domain config. {{(pid=71229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 15:32:49 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-270db701-b5bd-4916-859f-b6272194f217 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 15:32:49 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:32:49 user nova-compute[71229]:   <source dev="/dev/sde"/>
Apr 11 15:32:49 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 15:32:49 user nova-compute[71229]:   <serial>03f9a930-7552-492c-b996-4c3b05c42706</serial>
Apr 11 15:32:49 user nova-compute[71229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 15:32:49 user nova-compute[71229]: </disk>
Apr 11 15:32:49 user nova-compute[71229]:  {{(pid=71229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Received event <DeviceRemovedEvent: 1681227170.1743338, d534d17d-ba77-4447-8a63-7d6021ad7896 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71229) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-270db701-b5bd-4916-859f-b6272194f217 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d534d17d-ba77-4447-8a63-7d6021ad7896 {{(pid=71229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 15:32:50 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-270db701-b5bd-4916-859f-b6272194f217 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Successfully detached device vdb from instance d534d17d-ba77-4447-8a63-7d6021ad7896 from the live domain config.
Apr 11 15:32:50 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-270db701-b5bd-4916-859f-b6272194f217 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-270db701-b5bd-4916-859f-b6272194f217 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:03f9a930-7552-492c-b996-4c3b05c42706', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IyOWuYTn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:32:50 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-270db701-b5bd-4916-859f-b6272194f217 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:32:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-270db701-b5bd-4916-859f-b6272194f217 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-270db701-b5bd-4916-859f-b6272194f217 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[30222a46-ebc8-48c0-a85d-35dd302f0a2a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03f9a930-7552-492c-b996-4c3b05c42706\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-270db701-b5bd-4916-859f-b6272194f217 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 15:32:50 user nova-compute[71229]: No targets found.
Apr 11 15:32:50 user nova-compute[71229]: iSNS:
Apr 11 15:32:50 user nova-compute[71229]: No targets found.
Apr 11 15:32:50 user nova-compute[71229]: STATIC:
Apr 11 15:32:50 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb
Apr 11 15:32:50 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:32:50 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:32:50 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2
Apr 11 15:32:50 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:32:50 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:32:50 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:03f9a930-7552-492c-b996-4c3b05c42706
Apr 11 15:32:50 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:32:50 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:32:50 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4
Apr 11 15:32:50 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:32:50 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:32:50 user nova-compute[71229]: FIRMWARE:
Apr 11 15:32:50 user nova-compute[71229]: No targets found.
Apr 11 15:32:50 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-270db701-b5bd-4916-859f-b6272194f217 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 15:32:50 user nova-compute[71229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 15:32:50 user nova-compute[71229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71229) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-270db701-b5bd-4916-859f-b6272194f217 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03f9a930-7552-492c-b996-4c3b05c42706', 0)] {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40536d0-edf1-49f9-bdd1-e02d87e6edc1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03f9a930-7552-492c-b996-4c3b05c42706\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG nova.compute.manager [req-1af23219-295e-4572-9b34-8b1dbf05ffc4 req-074636f9-626b-4964-8849-75f87440a94f service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received event network-changed-b7d90fa1-965a-4cc7-bc48-64a43041af23 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG nova.compute.manager [req-1af23219-295e-4572-9b34-8b1dbf05ffc4 req-074636f9-626b-4964-8849-75f87440a94f service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Refreshing instance network info cache due to event network-changed-b7d90fa1-965a-4cc7-bc48-64a43041af23. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-1af23219-295e-4572-9b34-8b1dbf05ffc4 req-074636f9-626b-4964-8849-75f87440a94f service nova] Acquiring lock "refresh_cache-fa6dc9c1-6786-4c17-a23e-f71c21ac08a7" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-1af23219-295e-4572-9b34-8b1dbf05ffc4 req-074636f9-626b-4964-8849-75f87440a94f service nova] Acquired lock "refresh_cache-fa6dc9c1-6786-4c17-a23e-f71c21ac08a7" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG nova.network.neutron [req-1af23219-295e-4572-9b34-8b1dbf05ffc4 req-074636f9-626b-4964-8849-75f87440a94f service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Refreshing network info cache for port b7d90fa1-965a-4cc7-bc48-64a43041af23 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3273ca9-b7f7-4017-bcc1-36b839b6ac26]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f9a930-7552-492c-b996-4c3b05c42706 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-270db701-b5bd-4916-859f-b6272194f217 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:32:50 user nova-compute[71229]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:32:50 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:32:50 user nova-compute[71229]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f9a930-7552-492c-b996-4c3b05c42706 (non-flash)
Apr 11 15:32:50 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-270db701-b5bd-4916-859f-b6272194f217 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:32:50 user nova-compute[71229]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:32:50 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:32:50 user nova-compute[71229]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f9a930-7552-492c-b996-4c3b05c42706 (non-flash)
Apr 11 15:32:50 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-270db701-b5bd-4916-859f-b6272194f217 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb643a3d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03f9a930-7552-492c-b996-4c3b05c42706'): ({'sde'}, set())}) {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-270db701-b5bd-4916-859f-b6272194f217 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Removing single pathed devices sde {{(pid=71229) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea90c0ee-7439-4128-aec6-96e0da01d610]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[22af3c50-00e5-4ffc-8063-671ca5269428]: (4, ('ok\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-270db701-b5bd-4916-859f-b6272194f217 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Flushing IO for device /dev/sde {{(pid=71229) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG nova.network.neutron [req-1af23219-295e-4572-9b34-8b1dbf05ffc4 req-074636f9-626b-4964-8849-75f87440a94f service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG nova.network.neutron [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Successfully updated port: 44becdbc-fa86-4dbe-ac1a-e0e01648513b {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcdc2425-bbf8-4edd-bede-ddfd7ef48a4d]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-270db701-b5bd-4916-859f-b6272194f217 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71229) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1c0875-aff3-4fa0-bcef-2beea29cc678]: (4, ('1', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-270db701-b5bd-4916-859f-b6272194f217 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-270db701-b5bd-4916-859f-b6272194f217 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] SCSI volumes sde have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-270db701-b5bd-4916-859f-b6272194f217 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03f9a930-7552-492c-b996-4c3b05c42706')] {{(pid=71229) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f9a930-7552-492c-b996-4c3b05c42706 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f9a930-7552-492c-b996-4c3b05c42706 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e955e2b5-2feb-470a-b37f-c2debb931635]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-270db701-b5bd-4916-859f-b6272194f217 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f9a930-7552-492c-b996-4c3b05c42706 -p 172.16.0.220:3260 --logout {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f9a930-7552-492c-b996-4c3b05c42706 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[92cde5db-13f4-4e1e-ac93-20ce54b33364]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:03f9a930-7552-492c-b996-4c3b05c42706, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:03f9a930-7552-492c-b996-4c3b05c42706, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-270db701-b5bd-4916-859f-b6272194f217 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:03f9a930-7552-492c-b996-4c3b05c42706, portal: 172.16.0.220,3260]
Apr 11 15:32:50 user nova-compute[71229]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:03f9a930-7552-492c-b996-4c3b05c42706, portal: 172.16.0.220,3260] successful.
Apr 11 15:32:50 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f9a930-7552-492c-b996-4c3b05c42706 -p 172.16.0.220:3260 --op delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f9a930-7552-492c-b996-4c3b05c42706 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99fb67d-a043-4438-9544-2e31fe3330aa]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-270db701-b5bd-4916-859f-b6272194f217 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-270db701-b5bd-4916-859f-b6272194f217 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-270db701-b5bd-4916-859f-b6272194f217 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] <== disconnect_volume: return (347ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-270db701-b5bd-4916-859f-b6272194f217 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG nova.network.neutron [req-1af23219-295e-4572-9b34-8b1dbf05ffc4 req-074636f9-626b-4964-8849-75f87440a94f service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-1af23219-295e-4572-9b34-8b1dbf05ffc4 req-074636f9-626b-4964-8849-75f87440a94f service nova] Releasing lock "refresh_cache-fa6dc9c1-6786-4c17-a23e-f71c21ac08a7" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG nova.compute.manager [req-1af23219-295e-4572-9b34-8b1dbf05ffc4 req-074636f9-626b-4964-8849-75f87440a94f service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received event network-changed-fafe4f73-4fc5-401b-a2bf-542bea23915f {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG nova.compute.manager [req-1af23219-295e-4572-9b34-8b1dbf05ffc4 req-074636f9-626b-4964-8849-75f87440a94f service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Refreshing instance network info cache due to event network-changed-fafe4f73-4fc5-401b-a2bf-542bea23915f. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-1af23219-295e-4572-9b34-8b1dbf05ffc4 req-074636f9-626b-4964-8849-75f87440a94f service nova] Acquiring lock "refresh_cache-fa6dc9c1-6786-4c17-a23e-f71c21ac08a7" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-1af23219-295e-4572-9b34-8b1dbf05ffc4 req-074636f9-626b-4964-8849-75f87440a94f service nova] Acquired lock "refresh_cache-fa6dc9c1-6786-4c17-a23e-f71c21ac08a7" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG nova.network.neutron [req-1af23219-295e-4572-9b34-8b1dbf05ffc4 req-074636f9-626b-4964-8849-75f87440a94f service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Refreshing network info cache for port fafe4f73-4fc5-401b-a2bf-542bea23915f {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG nova.network.neutron [req-1af23219-295e-4572-9b34-8b1dbf05ffc4 req-074636f9-626b-4964-8849-75f87440a94f service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG nova.network.neutron [req-1af23219-295e-4572-9b34-8b1dbf05ffc4 req-074636f9-626b-4964-8849-75f87440a94f service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:32:50 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-1af23219-295e-4572-9b34-8b1dbf05ffc4 req-074636f9-626b-4964-8849-75f87440a94f service nova] Releasing lock "refresh_cache-fa6dc9c1-6786-4c17-a23e-f71c21ac08a7" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:32:51 user nova-compute[71229]: DEBUG nova.network.neutron [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Successfully updated port: bf63f34a-3145-4251-a036-a35bd08ef45f {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:32:51 user nova-compute[71229]: DEBUG nova.objects.instance [None req-270db701-b5bd-4916-859f-b6272194f217 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lazy-loading 'flavor' on Instance uuid d534d17d-ba77-4447-8a63-7d6021ad7896 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:32:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-270db701-b5bd-4916-859f-b6272194f217 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "d534d17d-ba77-4447-8a63-7d6021ad7896" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.831s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:32:51 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:32:51 user nova-compute[71229]: DEBUG nova.network.neutron [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Successfully updated port: e5066fdb-ea6f-4df5-b185-56f1a0dbe539 {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:32:52 user nova-compute[71229]: DEBUG nova.compute.manager [req-1a37ce58-c5af-4e96-9217-bf795276a875 req-0d1139e7-da4c-4d3c-9d53-269c5f5235dc service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received event network-changed-44becdbc-fa86-4dbe-ac1a-e0e01648513b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:32:52 user nova-compute[71229]: DEBUG nova.compute.manager [req-1a37ce58-c5af-4e96-9217-bf795276a875 req-0d1139e7-da4c-4d3c-9d53-269c5f5235dc service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Refreshing instance network info cache due to event network-changed-44becdbc-fa86-4dbe-ac1a-e0e01648513b. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:32:52 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-1a37ce58-c5af-4e96-9217-bf795276a875 req-0d1139e7-da4c-4d3c-9d53-269c5f5235dc service nova] Acquiring lock "refresh_cache-fa6dc9c1-6786-4c17-a23e-f71c21ac08a7" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:32:52 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-1a37ce58-c5af-4e96-9217-bf795276a875 req-0d1139e7-da4c-4d3c-9d53-269c5f5235dc service nova] Acquired lock "refresh_cache-fa6dc9c1-6786-4c17-a23e-f71c21ac08a7" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:32:52 user nova-compute[71229]: DEBUG nova.network.neutron [req-1a37ce58-c5af-4e96-9217-bf795276a875 req-0d1139e7-da4c-4d3c-9d53-269c5f5235dc service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Refreshing network info cache for port 44becdbc-fa86-4dbe-ac1a-e0e01648513b {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:32:52 user nova-compute[71229]: DEBUG nova.network.neutron [req-1a37ce58-c5af-4e96-9217-bf795276a875 req-0d1139e7-da4c-4d3c-9d53-269c5f5235dc service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:32:52 user nova-compute[71229]: DEBUG nova.network.neutron [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Successfully updated port: b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:32:52 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Acquiring lock "refresh_cache-fa6dc9c1-6786-4c17-a23e-f71c21ac08a7" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:32:52 user nova-compute[71229]: DEBUG nova.network.neutron [req-1a37ce58-c5af-4e96-9217-bf795276a875 req-0d1139e7-da4c-4d3c-9d53-269c5f5235dc service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:32:52 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-1a37ce58-c5af-4e96-9217-bf795276a875 req-0d1139e7-da4c-4d3c-9d53-269c5f5235dc service nova] Releasing lock "refresh_cache-fa6dc9c1-6786-4c17-a23e-f71c21ac08a7" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:32:52 user nova-compute[71229]: DEBUG nova.compute.manager [req-1a37ce58-c5af-4e96-9217-bf795276a875 req-0d1139e7-da4c-4d3c-9d53-269c5f5235dc service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received event network-changed-bf63f34a-3145-4251-a036-a35bd08ef45f {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:32:52 user nova-compute[71229]: DEBUG nova.compute.manager [req-1a37ce58-c5af-4e96-9217-bf795276a875 req-0d1139e7-da4c-4d3c-9d53-269c5f5235dc service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Refreshing instance network info cache due to event network-changed-bf63f34a-3145-4251-a036-a35bd08ef45f. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:32:52 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-1a37ce58-c5af-4e96-9217-bf795276a875 req-0d1139e7-da4c-4d3c-9d53-269c5f5235dc service nova] Acquiring lock "refresh_cache-fa6dc9c1-6786-4c17-a23e-f71c21ac08a7" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:32:52 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-1a37ce58-c5af-4e96-9217-bf795276a875 req-0d1139e7-da4c-4d3c-9d53-269c5f5235dc service nova] Acquired lock "refresh_cache-fa6dc9c1-6786-4c17-a23e-f71c21ac08a7" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:32:52 user nova-compute[71229]: DEBUG nova.network.neutron [req-1a37ce58-c5af-4e96-9217-bf795276a875 req-0d1139e7-da4c-4d3c-9d53-269c5f5235dc service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Refreshing network info cache for port bf63f34a-3145-4251-a036-a35bd08ef45f {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:32:52 user nova-compute[71229]: DEBUG nova.network.neutron [req-1a37ce58-c5af-4e96-9217-bf795276a875 req-0d1139e7-da4c-4d3c-9d53-269c5f5235dc service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:32:52 user nova-compute[71229]: DEBUG nova.network.neutron [req-1a37ce58-c5af-4e96-9217-bf795276a875 req-0d1139e7-da4c-4d3c-9d53-269c5f5235dc service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:32:52 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-1a37ce58-c5af-4e96-9217-bf795276a875 req-0d1139e7-da4c-4d3c-9d53-269c5f5235dc service nova] Releasing lock "refresh_cache-fa6dc9c1-6786-4c17-a23e-f71c21ac08a7" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:32:52 user nova-compute[71229]: DEBUG nova.compute.manager [req-1a37ce58-c5af-4e96-9217-bf795276a875 req-0d1139e7-da4c-4d3c-9d53-269c5f5235dc service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received event network-changed-e5066fdb-ea6f-4df5-b185-56f1a0dbe539 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:32:52 user nova-compute[71229]: DEBUG nova.compute.manager [req-1a37ce58-c5af-4e96-9217-bf795276a875 req-0d1139e7-da4c-4d3c-9d53-269c5f5235dc service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Refreshing instance network info cache due to event network-changed-e5066fdb-ea6f-4df5-b185-56f1a0dbe539. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:32:52 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-1a37ce58-c5af-4e96-9217-bf795276a875 req-0d1139e7-da4c-4d3c-9d53-269c5f5235dc service nova] Acquiring lock "refresh_cache-fa6dc9c1-6786-4c17-a23e-f71c21ac08a7" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:32:52 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-1a37ce58-c5af-4e96-9217-bf795276a875 req-0d1139e7-da4c-4d3c-9d53-269c5f5235dc service nova] Acquired lock "refresh_cache-fa6dc9c1-6786-4c17-a23e-f71c21ac08a7" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:32:52 user nova-compute[71229]: DEBUG nova.network.neutron [req-1a37ce58-c5af-4e96-9217-bf795276a875 req-0d1139e7-da4c-4d3c-9d53-269c5f5235dc service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Refreshing network info cache for port e5066fdb-ea6f-4df5-b185-56f1a0dbe539 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:32:52 user nova-compute[71229]: INFO nova.virt.block_device [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Booting with volume 0acddd31-7aa7-4ce3-8628-e562af3c393e at /dev/vdc
Apr 11 15:32:53 user nova-compute[71229]: DEBUG nova.network.neutron [req-1a37ce58-c5af-4e96-9217-bf795276a875 req-0d1139e7-da4c-4d3c-9d53-269c5f5235dc service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:32:53 user nova-compute[71229]: DEBUG os_brick.utils [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:32:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:53 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbebab8-d23d-4b1d-bca6-18d6cd825fc7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d55e24a97c90\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:53 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe73255-9dfb-47a6-bd88-755922de52f5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:53 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[238fd2dc-f3b6-41d6-9dc5-648aafa4cadc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:53 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca798c9-49e8-40e7-bf5d-aa6dcc19600e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Running cmd (subprocess): nvme version {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] 'nvme version' failed. Not Retrying. {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:32:53 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] nvme not present on system {{(pid=71229) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 15:32:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:32:53 user nova-compute[71229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 15:32:53 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba722568-95ed-4278-aa7e-2dd3ad80cbf2]: (4, '') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:53 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71229) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 15:32:53 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 15:32:53 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] LIGHTOS: no hostnqn found. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 15:32:53 user nova-compute[71229]: DEBUG os_brick.utils [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d55e24a97c90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:32:53 user nova-compute[71229]: DEBUG nova.virt.block_device [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Updating existing volume attachment record: 0779f9a4-bc2b-4f86-9a4b-50a9bde77b15 {{(pid=71229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 15:32:53 user nova-compute[71229]: DEBUG nova.network.neutron [req-1a37ce58-c5af-4e96-9217-bf795276a875 req-0d1139e7-da4c-4d3c-9d53-269c5f5235dc service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:32:53 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-1a37ce58-c5af-4e96-9217-bf795276a875 req-0d1139e7-da4c-4d3c-9d53-269c5f5235dc service nova] Releasing lock "refresh_cache-fa6dc9c1-6786-4c17-a23e-f71c21ac08a7" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:32:53 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Acquired lock "refresh_cache-fa6dc9c1-6786-4c17-a23e-f71c21ac08a7" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:32:53 user nova-compute[71229]: DEBUG nova.network.neutron [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:32:53 user nova-compute[71229]: DEBUG nova.network.neutron [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:32:53 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:32:54 user nova-compute[71229]: DEBUG nova.compute.manager [req-5d6fca47-9395-4eb3-8345-fc296994958b req-74c6bfa1-5a52-4405-9440-7c6aac6c2106 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received event network-changed-b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:32:54 user nova-compute[71229]: DEBUG nova.compute.manager [req-5d6fca47-9395-4eb3-8345-fc296994958b req-74c6bfa1-5a52-4405-9440-7c6aac6c2106 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Refreshing instance network info cache due to event network-changed-b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:32:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-5d6fca47-9395-4eb3-8345-fc296994958b req-74c6bfa1-5a52-4405-9440-7c6aac6c2106 service nova] Acquiring lock "refresh_cache-fa6dc9c1-6786-4c17-a23e-f71c21ac08a7" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:32:55 user nova-compute[71229]: DEBUG nova.network.neutron [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Updating instance_info_cache with network_info: [{"id": "7485c140-3c08-4191-9929-3c41cb6fd725", "address": "fa:16:3e:3a:3c:8e", "network": {"id": "e4b9e2d9-6b8e-4857-bd3e-19c5d7c80f69", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2926051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7485c140-3c", "ovs_interfaceid": "7485c140-3c08-4191-9929-3c41cb6fd725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b7d90fa1-965a-4cc7-bc48-64a43041af23", "address": "fa:16:3e:b2:3b:c0", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d90fa1-96", "ovs_interfaceid": "b7d90fa1-965a-4cc7-bc48-64a43041af23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fafe4f73-4fc5-401b-a2bf-542bea23915f", "address": "fa:16:3e:e2:5f:81", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfafe4f73-4f", "ovs_interfaceid": "fafe4f73-4fc5-401b-a2bf-542bea23915f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "44becdbc-fa86-4dbe-ac1a-e0e01648513b", "address": "fa:16:3e:ed:b8:03", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44becdbc-fa", "ovs_interfaceid": "44becdbc-fa86-4dbe-ac1a-e0e01648513b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bf63f34a-3145-4251-a036-a35bd08ef45f", "address": "fa:16:3e:4a:ce:66", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf63f34a-31", "ovs_interfaceid": "bf63f34a-3145-4251-a036-a35bd08ef45f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e5066fdb-ea6f-4df5-b185-56f1a0dbe539", "address": "fa:16:3e:5f:b5:3e", "network": {"id": "a08657fa-cfdb-4f36-b464-53fe53b857af", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819766267", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5066fdb-ea", "ovs_interfaceid": "e5066fdb-ea6f-4df5-b185-56f1a0dbe539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f", "address": "fa:16:3e:e7:ca:1c", "network": {"id": "a08657fa-cfdb-4f36-b464-53fe53b857af", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819766267", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00381a8-f9", "ovs_interfaceid": "b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:32:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Releasing lock "refresh_cache-fa6dc9c1-6786-4c17-a23e-f71c21ac08a7" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:32:55 user nova-compute[71229]: DEBUG nova.compute.manager [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Instance network_info: |[{"id": "7485c140-3c08-4191-9929-3c41cb6fd725", "address": "fa:16:3e:3a:3c:8e", "network": {"id": "e4b9e2d9-6b8e-4857-bd3e-19c5d7c80f69", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2926051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7485c140-3c", "ovs_interfaceid": "7485c140-3c08-4191-9929-3c41cb6fd725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b7d90fa1-965a-4cc7-bc48-64a43041af23", "address": "fa:16:3e:b2:3b:c0", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d90fa1-96", "ovs_interfaceid": "b7d90fa1-965a-4cc7-bc48-64a43041af23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fafe4f73-4fc5-401b-a2bf-542bea23915f", "address": "fa:16:3e:e2:5f:81", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfafe4f73-4f", "ovs_interfaceid": "fafe4f73-4fc5-401b-a2bf-542bea23915f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "44becdbc-fa86-4dbe-ac1a-e0e01648513b", "address": "fa:16:3e:ed:b8:03", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44becdbc-fa", "ovs_interfaceid": "44becdbc-fa86-4dbe-ac1a-e0e01648513b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bf63f34a-3145-4251-a036-a35bd08ef45f", "address": "fa:16:3e:4a:ce:66", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf63f34a-31", "ovs_interfaceid": "bf63f34a-3145-4251-a036-a35bd08ef45f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e5066fdb-ea6f-4df5-b185-56f1a0dbe539", "address": "fa:16:3e:5f:b5:3e", "network": {"id": "a08657fa-cfdb-4f36-b464-53fe53b857af", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819766267", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5066fdb-ea", "ovs_interfaceid": "e5066fdb-ea6f-4df5-b185-56f1a0dbe539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f", "address": "fa:16:3e:e7:ca:1c", "network": {"id": "a08657fa-cfdb-4f36-b464-53fe53b857af", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819766267", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00381a8-f9", "ovs_interfaceid": "b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 15:32:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-5d6fca47-9395-4eb3-8345-fc296994958b req-74c6bfa1-5a52-4405-9440-7c6aac6c2106 service nova] Acquired lock "refresh_cache-fa6dc9c1-6786-4c17-a23e-f71c21ac08a7" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:32:55 user nova-compute[71229]: DEBUG nova.network.neutron [req-5d6fca47-9395-4eb3-8345-fc296994958b req-74c6bfa1-5a52-4405-9440-7c6aac6c2106 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Refreshing network info cache for port b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:32:56 user nova-compute[71229]: DEBUG nova.network.neutron [req-5d6fca47-9395-4eb3-8345-fc296994958b req-74c6bfa1-5a52-4405-9440-7c6aac6c2106 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Updated VIF entry in instance network info cache for port b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:32:56 user nova-compute[71229]: DEBUG nova.network.neutron [req-5d6fca47-9395-4eb3-8345-fc296994958b req-74c6bfa1-5a52-4405-9440-7c6aac6c2106 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Updating instance_info_cache with network_info: [{"id": "7485c140-3c08-4191-9929-3c41cb6fd725", "address": "fa:16:3e:3a:3c:8e", "network": {"id": "e4b9e2d9-6b8e-4857-bd3e-19c5d7c80f69", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2926051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7485c140-3c", "ovs_interfaceid": "7485c140-3c08-4191-9929-3c41cb6fd725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b7d90fa1-965a-4cc7-bc48-64a43041af23", "address": "fa:16:3e:b2:3b:c0", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d90fa1-96", "ovs_interfaceid": "b7d90fa1-965a-4cc7-bc48-64a43041af23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fafe4f73-4fc5-401b-a2bf-542bea23915f", "address": "fa:16:3e:e2:5f:81", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfafe4f73-4f", "ovs_interfaceid": "fafe4f73-4fc5-401b-a2bf-542bea23915f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "44becdbc-fa86-4dbe-ac1a-e0e01648513b", "address": "fa:16:3e:ed:b8:03", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44becdbc-fa", "ovs_interfaceid": "44becdbc-fa86-4dbe-ac1a-e0e01648513b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bf63f34a-3145-4251-a036-a35bd08ef45f", "address": "fa:16:3e:4a:ce:66", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf63f34a-31", "ovs_interfaceid": "bf63f34a-3145-4251-a036-a35bd08ef45f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e5066fdb-ea6f-4df5-b185-56f1a0dbe539", "address": "fa:16:3e:5f:b5:3e", "network": {"id": "a08657fa-cfdb-4f36-b464-53fe53b857af", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819766267", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5066fdb-ea", "ovs_interfaceid": "e5066fdb-ea6f-4df5-b185-56f1a0dbe539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f", "address": "fa:16:3e:e7:ca:1c", "network": {"id": "a08657fa-cfdb-4f36-b464-53fe53b857af", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819766267", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00381a8-f9", "ovs_interfaceid": "b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:32:56 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-5d6fca47-9395-4eb3-8345-fc296994958b req-74c6bfa1-5a52-4405-9440-7c6aac6c2106 service nova] Releasing lock "refresh_cache-fa6dc9c1-6786-4c17-a23e-f71c21ac08a7" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:32:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG nova.compute.manager [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Start spawning the instance on the hypervisor. {{(pid=71229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Creating instance directory {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 15:32:57 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Creating image(s)
Apr 11 15:32:57 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Did not create local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Ensure instance console log exists: /opt/stack/data/nova/instances/fa6dc9c1-6786-4c17-a23e-f71c21ac08a7/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Start _get_guest_xml network_info=[{"id": "7485c140-3c08-4191-9929-3c41cb6fd725", "address": "fa:16:3e:3a:3c:8e", "network": {"id": "e4b9e2d9-6b8e-4857-bd3e-19c5d7c80f69", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2926051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7485c140-3c", "ovs_interfaceid": "7485c140-3c08-4191-9929-3c41cb6fd725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b7d90fa1-965a-4cc7-bc48-64a43041af23", "address": "fa:16:3e:b2:3b:c0", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d90fa1-96", "ovs_interfaceid": "b7d90fa1-965a-4cc7-bc48-64a43041af23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fafe4f73-4fc5-401b-a2bf-542bea23915f", "address": "fa:16:3e:e2:5f:81", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfafe4f73-4f", "ovs_interfaceid": "fafe4f73-4fc5-401b-a2bf-542bea23915f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "44becdbc-fa86-4dbe-ac1a-e0e01648513b", "address": "fa:16:3e:ed:b8:03", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44becdbc-fa", "ovs_interfaceid": "44becdbc-fa86-4dbe-ac1a-e0e01648513b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bf63f34a-3145-4251-a036-a35bd08ef45f", "address": "fa:16:3e:4a:ce:66", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf63f34a-31", "ovs_interfaceid": "bf63f34a-3145-4251-a036-a35bd08ef45f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e5066fdb-ea6f-4df5-b185-56f1a0dbe539", "address": "fa:16:3e:5f:b5:3e", "network": {"id": "a08657fa-cfdb-4f36-b464-53fe53b857af", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819766267", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5066fdb-ea", "ovs_interfaceid": "e5066fdb-ea6f-4df5-b185-56f1a0dbe539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f", "address": "fa:16:3e:e7:ca:1c", "network": {"id": "a08657fa-cfdb-4f36-b464-53fe53b857af", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819766267", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00381a8-f9", "ovs_interfaceid": "b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GHxnRMyi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fa6dc9c1-6786-4c17-a23e-f71c21ac08a7', 'attached_at': '', 'detached_at': '', 'volume_id': '08362a1c-0e13-45ed-84c9-e9bcb01bf532', 'serial': '08362a1c-0e13-45ed-84c9-e9bcb01bf532'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'ecf7a55e-55ed-473d-8cf8-13efd779112a', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None}, {'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xEbTZiPX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fa6dc9c1-6786-4c17-a23e-f71c21ac08a7', 'attached_at': '', 'detached_at': '', 'volume_id': '19a0b36e-cc56-4f19-904a-03c416d6a452', 'serial': '19a0b36e-cc56-4f19-904a-03c416d6a452'}, 'boot_index': 1, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'ce4ea7cf-fbc8-42ba-a3b7-0e094eda28a9', 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None}, {'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WJRPsMZd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fa6dc9c1-6786-4c17-a23e-f71c21ac08a7', 'attached_at': '', 'detached_at': '', 'volume_id': '0acddd31-7aa7-4ce3-8628-e562af3c393e', 'serial': '0acddd31-7aa7-4ce3-8628-e562af3c393e'}, 'boot_index': 2, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '0779f9a4-bc2b-4f86-9a4b-50a9bde77b15', 'guest_format': None, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:32:57 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:32:57 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:32:57 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GHxnRMyi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:32:57 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:32:57 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:32:57 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:32:57 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:32:57 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 15:32:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50b8a61-9474-4ff4-9611-97f20ed8498d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 15:32:57 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 -p 172.16.0.220:3260 --interface default --op new {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[74fa6f9a-f4af-4a7a-a714-9cdc9f925edb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532] added\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532] added
Apr 11 15:32:57 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6290efac-24d4-4653-b7dd-f637c9cc53a6]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[979b6c62-add3-4268-ab43-c90c8da846aa]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GHxnRMyi {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GHxnRMyi" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f48f691-815d-4f2d-958c-24615eb9d66d]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GHxnRMyi'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e357589-bda9-45f1-97f7-028a610f2e36]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91758b4-8ec7-4f7e-8786-16a121ee865a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:32:57 user nova-compute[71229]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:32:57 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:32:57 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:32:57 user nova-compute[71229]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:32:57 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:32:57 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 -p 172.16.0.220:3260 --login {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7145332-c2d6-4b28-be61-ed9a3edd7230]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532, portal: 172.16.0.220,3260]
Apr 11 15:32:57 user nova-compute[71229]: Login to [iface: default, target: iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532, portal: 172.16.0.220,3260] successful.
Apr 11 15:32:57 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7afb6e-3b27-4df6-949d-7c370eea777e]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a69da3-1e20-4f4e-bdb1-4488deb20aa1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:57 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:32:57 user nova-compute[71229]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:32:57 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:32:57 user nova-compute[71229]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 (non-flash)
Apr 11 15:32:57 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:32:58 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:32:58 user nova-compute[71229]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:32:58 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:32:58 user nova-compute[71229]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 (non-flash)
Apr 11 15:32:58 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:32:58 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:32:58 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 15:32:58 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] HCTL ('36', '-', '-', 0) found on session 28 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 15:32:58 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 15:32:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:58 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1699edc8-8463-4c8c-a729-38e261d135fd]: (4, ('- - 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:58 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: None {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:32:58 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:32:58 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 15:32:58 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:32:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:32:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:32:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:32:58 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 15:32:58 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:32:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GHxnRMyi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23761393364393765', 'path': '/dev/sde'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761393364393765', 'path': '/dev/sde'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xEbTZiPX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:32:59 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:32:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:32:59 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:32:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:32:59 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 15:32:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452 -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[933581c8-2a16-488c-bf1c-b43861dcc8c4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 15:32:59 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452 -p 172.16.0.220:3260 --interface default --op new {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[35fcd6c1-1018-4096-a318-c04be3983a40]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452] added\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452] added
Apr 11 15:32:59 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d978bde1-2dfc-480f-81d4-883b4dfc4238]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf757682-2eeb-4466-a4a5-2ad29ecf240b]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xEbTZiPX {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xEbTZiPX" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9613642-d376-47bf-a6ff-c74be5e85e6e]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xEbTZiPX'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c4070e-d70b-4af8-a5df-37eefbea74d3]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e46a3a-fa16-4d70-84a6-f1b874558f30]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:32:59 user nova-compute[71229]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:32:59 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:32:59 user nova-compute[71229]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 (non-flash)
Apr 11 15:32:59 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:32:59 user nova-compute[71229]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:32:59 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:32:59 user nova-compute[71229]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 (non-flash)
Apr 11 15:32:59 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452 -p 172.16.0.220:3260 --login {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e1dfa8-1c03-402e-b284-2edfa8c9cfc3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452, portal: 172.16.0.220,3260]
Apr 11 15:32:59 user nova-compute[71229]: Login to [iface: default, target: iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452, portal: 172.16.0.220,3260] successful.
Apr 11 15:32:59 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d08735-8809-4bdf-ac0c-2833d737a579]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9160ad0-4f6c-4ba4-ab1b-f56581347759]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:32:59 user nova-compute[71229]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:32:59 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:32:59 user nova-compute[71229]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 (non-flash)
Apr 11 15:32:59 user nova-compute[71229]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452 (non-flash)
Apr 11 15:32:59 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:32:59 user nova-compute[71229]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:32:59 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:32:59 user nova-compute[71229]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 (non-flash)
Apr 11 15:32:59 user nova-compute[71229]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452 (non-flash)
Apr 11 15:32:59 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] HCTL ('37', '-', '-', 0) found on session 29 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30bffc7-380c-4f10-84ba-94f3bd586e01]: (4, ('- - 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Searching for a device in session 29 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xEbTZiPX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85658a44-9ff2-4553-b9fd-686bf35fd6ec/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85658a44-9ff2-4553-b9fd-686bf35fd6ec/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85658a44-9ff2-4553-b9fd-686bf35fd6ec/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85658a44-9ff2-4553-b9fd-686bf35fd6ec/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc25fc1-e59f-42c8-a371-b4b12e17fd59/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc25fc1-e59f-42c8-a371-b4b12e17fd59/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:32:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc25fc1-e59f-42c8-a371-b4b12e17fd59/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc25fc1-e59f-42c8-a371-b4b12e17fd59/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d534d17d-ba77-4447-8a63-7d6021ad7896/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d534d17d-ba77-4447-8a63-7d6021ad7896/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d534d17d-ba77-4447-8a63-7d6021ad7896/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d534d17d-ba77-4447-8a63-7d6021ad7896/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4555892-7abb-4a3c-a4ae-a27ad4902708/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '23831666632333734', 'path': '/dev/sdf'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831666632333734', 'path': '/dev/sdf'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4555892-7abb-4a3c-a4ae-a27ad4902708/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4555892-7abb-4a3c-a4ae-a27ad4902708/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WJRPsMZd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:33:00 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:33:00 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:33:00 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:33:00 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:33:00 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 15:33:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4c99c6-55d9-4d78-afb5-4b5c174a4763]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 15:33:00 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e -p 172.16.0.220:3260 --interface default --op new {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.041s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca13191-d981-44d3-8846-e84b33f857d1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e] added\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e] added
Apr 11 15:33:00 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d310df-ba92-4387-80af-853147976388]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[39150023-84ae-444f-b1c6-9af47831b025]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WJRPsMZd {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4555892-7abb-4a3c-a4ae-a27ad4902708/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WJRPsMZd" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[69370180-11c0-4af3-8ba4-5d1e51e46331]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WJRPsMZd'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c4016d-c59b-4aad-93bc-cdf0d24994f3]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ef5fb6-9af8-4398-9e8e-2e46d0ec9d3d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:33:00 user nova-compute[71229]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:33:00 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:33:00 user nova-compute[71229]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 (non-flash)
Apr 11 15:33:00 user nova-compute[71229]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452 (non-flash)
Apr 11 15:33:00 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:33:00 user nova-compute[71229]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:33:00 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:33:00 user nova-compute[71229]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 (non-flash)
Apr 11 15:33:00 user nova-compute[71229]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452 (non-flash)
Apr 11 15:33:00 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e -p 172.16.0.220:3260 --login {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8accf180-255f-48e2-afe5-bc593eb1e8b6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e, portal: 172.16.0.220,3260]
Apr 11 15:33:00 user nova-compute[71229]: Login to [iface: default, target: iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e, portal: 172.16.0.220,3260] successful.
Apr 11 15:33:00 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ce2b70-b5e1-436d-8785-e1a0fe2ae5e3]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd1f3f5-eb1e-405a-a6de-b4e518637c7d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:33:00 user nova-compute[71229]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:33:00 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:33:00 user nova-compute[71229]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 (non-flash)
Apr 11 15:33:00 user nova-compute[71229]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452 (non-flash)
Apr 11 15:33:00 user nova-compute[71229]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e (non-flash)
Apr 11 15:33:00 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:33:00 user nova-compute[71229]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:33:00 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:33:00 user nova-compute[71229]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 (non-flash)
Apr 11 15:33:00 user nova-compute[71229]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452 (non-flash)
Apr 11 15:33:00 user nova-compute[71229]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e (non-flash)
Apr 11 15:33:00 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.368s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] HCTL ('38', '-', '-', 0) found on session 30 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfb2cdc-799e-4c60-919d-4552cc545193]: (4, ('- - 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Searching for a device in session 30 and hctl ['38', '*', '*', 0] yield: None {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:33:00 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:33:01 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:33:01 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:33:01 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=7960MB free_disk=26.099029541015625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 15:33:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:33:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:33:01 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance de1a45fd-27be-4438-80a4-2f3a100643c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:33:01 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance b0d90fd2-6a95-43c4-8756-e82071d99154 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:33:01 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance e4555892-7abb-4a3c-a4ae-a27ad4902708 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:33:01 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance d534d17d-ba77-4447-8a63-7d6021ad7896 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:33:01 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 7c4329ae-07cb-4f28-9fd6-29b398517d2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:33:01 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 6a805345-374c-4326-9e8f-39bfc7947a35 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:33:01 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance ffc25fc1-e59f-42c8-a371-b4b12e17fd59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:33:01 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 85658a44-9ff2-4553-b9fd-686bf35fd6ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:33:01 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance d09cda86-eca1-4c42-8654-758eb6cd30e0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:33:01 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:33:01 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 15:33:01 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 15:33:01 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Refreshing inventories for resource provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 15:33:01 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Updating ProviderTree inventory for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 15:33:01 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Updating inventory in ProviderTree for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 15:33:01 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Refreshing aggregate associations for resource provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de, aggregates: None {{(pid=71229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 15:33:01 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Refreshing trait associations for resource provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de, traits: COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=71229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 15:33:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:01 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:33:01 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Searching for a device in session 30 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:33:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WJRPsMZd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 15:33:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.398s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:33:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] <== connect_volume: return (1400ms) {'type': 'block', 'scsi_wwn': '23432636166666362', 'path': '/dev/sdg'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:33:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23432636166666362', 'path': '/dev/sdg'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 15:33:01 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:33:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T15:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1266828186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1266828186',id=24,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrVMNOfvpNw0WxXnYb9GHoGjkGsVckNGNNSEeB0ystk/UW+bmvyI9JyrkIyp1aWJMJE8lx1rxmssoUoMpwQTPTewIcUxPaAcoIQfMD8tyeIllleUvA0Rxy5zvvcCtrC3Q==',key_name='tempest-keypair-1319177828',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7df6e56783b84282be0ca425358015dd',ramdisk_id='',reservation_id='r-w3y72isf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-341576311',owner_user_name='tempest-TaggedBootDevicesTest-341576311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:32:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='645eeb4fbb2a46d09fd18eaf7de500d0',uuid=fa6dc9c1-6786-4c17-a23e-f71c21ac08a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7485c140-3c08-4191-9929-3c41cb6fd725", "address": "fa:16:3e:3a:3c:8e", "network": {"id": "e4b9e2d9-6b8e-4857-bd3e-19c5d7c80f69", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2926051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7485c140-3c", "ovs_interfaceid": "7485c140-3c08-4191-9929-3c41cb6fd725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:33:01 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Converting VIF {"id": "7485c140-3c08-4191-9929-3c41cb6fd725", "address": "fa:16:3e:3a:3c:8e", "network": {"id": "e4b9e2d9-6b8e-4857-bd3e-19c5d7c80f69", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2926051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7485c140-3c", "ovs_interfaceid": "7485c140-3c08-4191-9929-3c41cb6fd725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:33:01 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:3c:8e,bridge_name='br-int',has_traffic_filtering=True,id=7485c140-3c08-4191-9929-3c41cb6fd725,network=Network(e4b9e2d9-6b8e-4857-bd3e-19c5d7c80f69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7485c140-3c') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:33:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T15:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1266828186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1266828186',id=24,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrVMNOfvpNw0WxXnYb9GHoGjkGsVckNGNNSEeB0ystk/UW+bmvyI9JyrkIyp1aWJMJE8lx1rxmssoUoMpwQTPTewIcUxPaAcoIQfMD8tyeIllleUvA0Rxy5zvvcCtrC3Q==',key_name='tempest-keypair-1319177828',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7df6e56783b84282be0ca425358015dd',ramdisk_id='',reservation_id='r-w3y72isf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-341576311',owner_user_name='tempest-TaggedBootDevicesTest-341576311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:32:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='645eeb4fbb2a46d09fd18eaf7de500d0',uuid=fa6dc9c1-6786-4c17-a23e-f71c21ac08a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7d90fa1-965a-4cc7-bc48-64a43041af23", "address": "fa:16:3e:b2:3b:c0", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d90fa1-96", "ovs_interfaceid": "b7d90fa1-965a-4cc7-bc48-64a43041af23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:33:01 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Converting VIF {"id": "b7d90fa1-965a-4cc7-bc48-64a43041af23", "address": "fa:16:3e:b2:3b:c0", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d90fa1-96", "ovs_interfaceid": "b7d90fa1-965a-4cc7-bc48-64a43041af23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:33:01 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:3b:c0,bridge_name='br-int',has_traffic_filtering=True,id=b7d90fa1-965a-4cc7-bc48-64a43041af23,network=Network(69f124ac-e977-41ac-8d55-e156f042bab8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb7d90fa1-96') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:33:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T15:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1266828186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1266828186',id=24,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrVMNOfvpNw0WxXnYb9GHoGjkGsVckNGNNSEeB0ystk/UW+bmvyI9JyrkIyp1aWJMJE8lx1rxmssoUoMpwQTPTewIcUxPaAcoIQfMD8tyeIllleUvA0Rxy5zvvcCtrC3Q==',key_name='tempest-keypair-1319177828',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7df6e56783b84282be0ca425358015dd',ramdisk_id='',reservation_id='r-w3y72isf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-341576311',owner_user_name='tempest-TaggedBootDevicesTest-341576311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:32:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='645eeb4fbb2a46d09fd18eaf7de500d0',uuid=fa6dc9c1-6786-4c17-a23e-f71c21ac08a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fafe4f73-4fc5-401b-a2bf-542bea23915f", "address": "fa:16:3e:e2:5f:81", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfafe4f73-4f", "ovs_interfaceid": "fafe4f73-4fc5-401b-a2bf-542bea23915f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:33:01 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Converting VIF {"id": "fafe4f73-4fc5-401b-a2bf-542bea23915f", "address": "fa:16:3e:e2:5f:81", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfafe4f73-4f", "ovs_interfaceid": "fafe4f73-4fc5-401b-a2bf-542bea23915f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:33:01 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:5f:81,bridge_name='br-int',has_traffic_filtering=True,id=fafe4f73-4fc5-401b-a2bf-542bea23915f,network=Network(69f124ac-e977-41ac-8d55-e156f042bab8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfafe4f73-4f') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:33:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T15:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1266828186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1266828186',id=24,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrVMNOfvpNw0WxXnYb9GHoGjkGsVckNGNNSEeB0ystk/UW+bmvyI9JyrkIyp1aWJMJE8lx1rxmssoUoMpwQTPTewIcUxPaAcoIQfMD8tyeIllleUvA0Rxy5zvvcCtrC3Q==',key_name='tempest-keypair-1319177828',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7df6e56783b84282be0ca425358015dd',ramdisk_id='',reservation_id='r-w3y72isf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-341576311',owner_user_name='tempest-TaggedBootDevicesTest-341576311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:32:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='645eeb4fbb2a46d09fd18eaf7de500d0',uuid=fa6dc9c1-6786-4c17-a23e-f71c21ac08a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44becdbc-fa86-4dbe-ac1a-e0e01648513b", "address": "fa:16:3e:ed:b8:03", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44becdbc-fa", "ovs_interfaceid": "44becdbc-fa86-4dbe-ac1a-e0e01648513b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:33:01 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Converting VIF {"id": "44becdbc-fa86-4dbe-ac1a-e0e01648513b", "address": "fa:16:3e:ed:b8:03", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44becdbc-fa", "ovs_interfaceid": "44becdbc-fa86-4dbe-ac1a-e0e01648513b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:33:01 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:b8:03,bridge_name='br-int',has_traffic_filtering=True,id=44becdbc-fa86-4dbe-ac1a-e0e01648513b,network=Network(69f124ac-e977-41ac-8d55-e156f042bab8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44becdbc-fa') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:33:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T15:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1266828186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1266828186',id=24,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrVMNOfvpNw0WxXnYb9GHoGjkGsVckNGNNSEeB0ystk/UW+bmvyI9JyrkIyp1aWJMJE8lx1rxmssoUoMpwQTPTewIcUxPaAcoIQfMD8tyeIllleUvA0Rxy5zvvcCtrC3Q==',key_name='tempest-keypair-1319177828',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7df6e56783b84282be0ca425358015dd',ramdisk_id='',reservation_id='r-w3y72isf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-341576311',owner_user_name='tempest-TaggedBootDevicesTest-341576311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:32:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='645eeb4fbb2a46d09fd18eaf7de500d0',uuid=fa6dc9c1-6786-4c17-a23e-f71c21ac08a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf63f34a-3145-4251-a036-a35bd08ef45f", "address": "fa:16:3e:4a:ce:66", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf63f34a-31", "ovs_interfaceid": "bf63f34a-3145-4251-a036-a35bd08ef45f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:33:01 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Converting VIF {"id": "bf63f34a-3145-4251-a036-a35bd08ef45f", "address": "fa:16:3e:4a:ce:66", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf63f34a-31", "ovs_interfaceid": "bf63f34a-3145-4251-a036-a35bd08ef45f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:33:01 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:ce:66,bridge_name='br-int',has_traffic_filtering=True,id=bf63f34a-3145-4251-a036-a35bd08ef45f,network=Network(69f124ac-e977-41ac-8d55-e156f042bab8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf63f34a-31') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:33:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T15:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1266828186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1266828186',id=24,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrVMNOfvpNw0WxXnYb9GHoGjkGsVckNGNNSEeB0ystk/UW+bmvyI9JyrkIyp1aWJMJE8lx1rxmssoUoMpwQTPTewIcUxPaAcoIQfMD8tyeIllleUvA0Rxy5zvvcCtrC3Q==',key_name='tempest-keypair-1319177828',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7df6e56783b84282be0ca425358015dd',ramdisk_id='',reservation_id='r-w3y72isf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-341576311',owner_user_name='tempest-TaggedBootDevicesTest-341576311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:32:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='645eeb4fbb2a46d09fd18eaf7de500d0',uuid=fa6dc9c1-6786-4c17-a23e-f71c21ac08a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5066fdb-ea6f-4df5-b185-56f1a0dbe539", "address": "fa:16:3e:5f:b5:3e", "network": {"id": "a08657fa-cfdb-4f36-b464-53fe53b857af", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819766267", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5066fdb-ea", "ovs_interfaceid": "e5066fdb-ea6f-4df5-b185-56f1a0dbe539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:33:01 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Converting VIF {"id": "e5066fdb-ea6f-4df5-b185-56f1a0dbe539", "address": "fa:16:3e:5f:b5:3e", "network": {"id": "a08657fa-cfdb-4f36-b464-53fe53b857af", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819766267", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5066fdb-ea", "ovs_interfaceid": "e5066fdb-ea6f-4df5-b185-56f1a0dbe539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:33:01 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:b5:3e,bridge_name='br-int',has_traffic_filtering=True,id=e5066fdb-ea6f-4df5-b185-56f1a0dbe539,network=Network(a08657fa-cfdb-4f36-b464-53fe53b857af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5066fdb-ea') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:33:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T15:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1266828186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1266828186',id=24,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrVMNOfvpNw0WxXnYb9GHoGjkGsVckNGNNSEeB0ystk/UW+bmvyI9JyrkIyp1aWJMJE8lx1rxmssoUoMpwQTPTewIcUxPaAcoIQfMD8tyeIllleUvA0Rxy5zvvcCtrC3Q==',key_name='tempest-keypair-1319177828',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7df6e56783b84282be0ca425358015dd',ramdisk_id='',reservation_id='r-w3y72isf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-341576311',owner_user_name='tempest-TaggedBootDevicesTest-341576311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:32:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='645eeb4fbb2a46d09fd18eaf7de500d0',uuid=fa6dc9c1-6786-4c17-a23e-f71c21ac08a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f", "address": "fa:16:3e:e7:ca:1c", "network": {"id": "a08657fa-cfdb-4f36-b464-53fe53b857af", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819766267", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00381a8-f9", "ovs_interfaceid": "b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:33:01 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Converting VIF {"id": "b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f", "address": "fa:16:3e:e7:ca:1c", "network": {"id": "a08657fa-cfdb-4f36-b464-53fe53b857af", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819766267", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00381a8-f9", "ovs_interfaceid": "b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:33:01 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ca:1c,bridge_name='br-int',has_traffic_filtering=True,id=b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f,network=Network(a08657fa-cfdb-4f36-b464-53fe53b857af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb00381a8-f9') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:33:01 user nova-compute[71229]: DEBUG nova.objects.instance [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lazy-loading 'pci_devices' on Instance uuid fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:33:01 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 15:33:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.594s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:33:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:33:01 user nova-compute[71229]:   <uuid>fa6dc9c1-6786-4c17-a23e-f71c21ac08a7</uuid>
Apr 11 15:33:01 user nova-compute[71229]:   <name>instance-00000018</name>
Apr 11 15:33:01 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:33:01 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:33:01 user nova-compute[71229]:   <metadata>
Apr 11 15:33:01 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:33:01 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:33:01 user nova-compute[71229]:       <nova:name>tempest-device-tagging-server-1266828186</nova:name>
Apr 11 15:33:01 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:32:57</nova:creationTime>
Apr 11 15:33:01 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:33:01 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:33:01 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:33:01 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:33:01 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:33:01 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:33:01 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:33:01 user nova-compute[71229]:       <nova:owner>
Apr 11 15:33:01 user nova-compute[71229]:         <nova:user uuid="645eeb4fbb2a46d09fd18eaf7de500d0">tempest-TaggedBootDevicesTest-341576311-project-member</nova:user>
Apr 11 15:33:01 user nova-compute[71229]:         <nova:project uuid="7df6e56783b84282be0ca425358015dd">tempest-TaggedBootDevicesTest-341576311</nova:project>
Apr 11 15:33:01 user nova-compute[71229]:       </nova:owner>
Apr 11 15:33:01 user nova-compute[71229]:       <nova:root type="image" uuid="52fe638c-5ada-47d5-b376-233bfa808a37"/>
Apr 11 15:33:01 user nova-compute[71229]:       <nova:ports>
Apr 11 15:33:01 user nova-compute[71229]:         <nova:port uuid="7485c140-3c08-4191-9929-3c41cb6fd725">
Apr 11 15:33:01 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 11 15:33:01 user nova-compute[71229]:         </nova:port>
Apr 11 15:33:01 user nova-compute[71229]:         <nova:port uuid="b7d90fa1-965a-4cc7-bc48-64a43041af23">
Apr 11 15:33:01 user nova-compute[71229]:           <nova:ip type="fixed" address="10.1.1.188" ipVersion="4"/>
Apr 11 15:33:01 user nova-compute[71229]:         </nova:port>
Apr 11 15:33:01 user nova-compute[71229]:         <nova:port uuid="fafe4f73-4fc5-401b-a2bf-542bea23915f">
Apr 11 15:33:01 user nova-compute[71229]:           <nova:ip type="fixed" address="10.1.1.219" ipVersion="4"/>
Apr 11 15:33:01 user nova-compute[71229]:         </nova:port>
Apr 11 15:33:01 user nova-compute[71229]:         <nova:port uuid="44becdbc-fa86-4dbe-ac1a-e0e01648513b">
Apr 11 15:33:01 user nova-compute[71229]:           <nova:ip type="fixed" address="10.1.1.70" ipVersion="4"/>
Apr 11 15:33:01 user nova-compute[71229]:         </nova:port>
Apr 11 15:33:01 user nova-compute[71229]:         <nova:port uuid="bf63f34a-3145-4251-a036-a35bd08ef45f">
Apr 11 15:33:01 user nova-compute[71229]:           <nova:ip type="fixed" address="10.1.1.121" ipVersion="4"/>
Apr 11 15:33:01 user nova-compute[71229]:         </nova:port>
Apr 11 15:33:01 user nova-compute[71229]:         <nova:port uuid="e5066fdb-ea6f-4df5-b185-56f1a0dbe539">
Apr 11 15:33:01 user nova-compute[71229]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 11 15:33:01 user nova-compute[71229]:         </nova:port>
Apr 11 15:33:01 user nova-compute[71229]:         <nova:port uuid="b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f">
Apr 11 15:33:01 user nova-compute[71229]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 11 15:33:01 user nova-compute[71229]:         </nova:port>
Apr 11 15:33:01 user nova-compute[71229]:       </nova:ports>
Apr 11 15:33:01 user nova-compute[71229]:     </nova:instance>
Apr 11 15:33:01 user nova-compute[71229]:   </metadata>
Apr 11 15:33:01 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:33:01 user nova-compute[71229]:     <system>
Apr 11 15:33:01 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:33:01 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:33:01 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:33:01 user nova-compute[71229]:       <entry name="serial">fa6dc9c1-6786-4c17-a23e-f71c21ac08a7</entry>
Apr 11 15:33:01 user nova-compute[71229]:       <entry name="uuid">fa6dc9c1-6786-4c17-a23e-f71c21ac08a7</entry>
Apr 11 15:33:01 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:33:01 user nova-compute[71229]:     </system>
Apr 11 15:33:01 user nova-compute[71229]:   </sysinfo>
Apr 11 15:33:01 user nova-compute[71229]:   <os>
Apr 11 15:33:01 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:33:01 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 15:33:01 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:33:01 user nova-compute[71229]:   </os>
Apr 11 15:33:01 user nova-compute[71229]:   <features>
Apr 11 15:33:01 user nova-compute[71229]:     <acpi/>
Apr 11 15:33:01 user nova-compute[71229]:     <apic/>
Apr 11 15:33:01 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:33:01 user nova-compute[71229]:   </features>
Apr 11 15:33:01 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:33:01 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:33:01 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:33:01 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:33:01 user nova-compute[71229]:   </clock>
Apr 11 15:33:01 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:33:01 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:33:01 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:33:01 user nova-compute[71229]:   </cpu>
Apr 11 15:33:01 user nova-compute[71229]:   <devices>
Apr 11 15:33:01 user nova-compute[71229]:     <disk type="file" device="cdrom">
Apr 11 15:33:01 user nova-compute[71229]:       <driver name="qemu" type="raw" cache="none"/>
Apr 11 15:33:01 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/fa6dc9c1-6786-4c17-a23e-f71c21ac08a7/disk.config"/>
Apr 11 15:33:01 user nova-compute[71229]:       <target dev="hda" bus="ide"/>
Apr 11 15:33:01 user nova-compute[71229]:     </disk>
Apr 11 15:33:01 user nova-compute[71229]:     <disk type="block" device="disk">
Apr 11 15:33:01 user nova-compute[71229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:33:01 user nova-compute[71229]:       <source dev="/dev/sde"/>
Apr 11 15:33:01 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:33:01 user nova-compute[71229]:       <serial>08362a1c-0e13-45ed-84c9-e9bcb01bf532</serial>
Apr 11 15:33:01 user nova-compute[71229]:     </disk>
Apr 11 15:33:01 user nova-compute[71229]:     <disk type="block" device="disk">
Apr 11 15:33:01 user nova-compute[71229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:33:01 user nova-compute[71229]:       <source dev="/dev/sdf"/>
Apr 11 15:33:01 user nova-compute[71229]:       <target dev="vdb" bus="virtio"/>
Apr 11 15:33:01 user nova-compute[71229]:       <serial>19a0b36e-cc56-4f19-904a-03c416d6a452</serial>
Apr 11 15:33:01 user nova-compute[71229]:     </disk>
Apr 11 15:33:01 user nova-compute[71229]:     <disk type="block" device="disk">
Apr 11 15:33:01 user nova-compute[71229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:33:01 user nova-compute[71229]:       <source dev="/dev/sdg"/>
Apr 11 15:33:01 user nova-compute[71229]:       <target dev="vdc" bus="virtio"/>
Apr 11 15:33:01 user nova-compute[71229]:       <serial>0acddd31-7aa7-4ce3-8628-e562af3c393e</serial>
Apr 11 15:33:01 user nova-compute[71229]:     </disk>
Apr 11 15:33:01 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:33:01 user nova-compute[71229]:       <mac address="fa:16:3e:3a:3c:8e"/>
Apr 11 15:33:01 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:33:01 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:33:01 user nova-compute[71229]:       <target dev="tap7485c140-3c"/>
Apr 11 15:33:01 user nova-compute[71229]:     </interface>
Apr 11 15:33:01 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:33:01 user nova-compute[71229]:       <mac address="fa:16:3e:b2:3b:c0"/>
Apr 11 15:33:01 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:33:01 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:33:01 user nova-compute[71229]:       <target dev="tapb7d90fa1-96"/>
Apr 11 15:33:01 user nova-compute[71229]:     </interface>
Apr 11 15:33:01 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:33:01 user nova-compute[71229]:       <mac address="fa:16:3e:e2:5f:81"/>
Apr 11 15:33:01 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:33:01 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:33:01 user nova-compute[71229]:       <target dev="tapfafe4f73-4f"/>
Apr 11 15:33:01 user nova-compute[71229]:     </interface>
Apr 11 15:33:01 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:33:01 user nova-compute[71229]:       <mac address="fa:16:3e:ed:b8:03"/>
Apr 11 15:33:01 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:33:01 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:33:01 user nova-compute[71229]:       <target dev="tap44becdbc-fa"/>
Apr 11 15:33:01 user nova-compute[71229]:     </interface>
Apr 11 15:33:01 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:33:01 user nova-compute[71229]:       <mac address="fa:16:3e:4a:ce:66"/>
Apr 11 15:33:01 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:33:01 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:33:01 user nova-compute[71229]:       <target dev="tapbf63f34a-31"/>
Apr 11 15:33:01 user nova-compute[71229]:     </interface>
Apr 11 15:33:01 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:33:01 user nova-compute[71229]:       <mac address="fa:16:3e:5f:b5:3e"/>
Apr 11 15:33:01 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:33:01 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:33:01 user nova-compute[71229]:       <target dev="tape5066fdb-ea"/>
Apr 11 15:33:01 user nova-compute[71229]:     </interface>
Apr 11 15:33:01 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:33:01 user nova-compute[71229]:       <mac address="fa:16:3e:e7:ca:1c"/>
Apr 11 15:33:01 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:33:01 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:33:01 user nova-compute[71229]:       <target dev="tapb00381a8-f9"/>
Apr 11 15:33:01 user nova-compute[71229]:     </interface>
Apr 11 15:33:01 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:33:01 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/fa6dc9c1-6786-4c17-a23e-f71c21ac08a7/console.log" append="off"/>
Apr 11 15:33:01 user nova-compute[71229]:     </serial>
Apr 11 15:33:01 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:33:01 user nova-compute[71229]:     <video>
Apr 11 15:33:01 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:33:01 user nova-compute[71229]:     </video>
Apr 11 15:33:01 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:33:01 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:33:01 user nova-compute[71229]:     </rng>
Apr 11 15:33:01 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:33:01 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:33:01 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:33:01 user nova-compute[71229]:     </memballoon>
Apr 11 15:33:01 user nova-compute[71229]:   </devices>
Apr 11 15:33:01 user nova-compute[71229]: </domain>
Apr 11 15:33:01 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T15:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1266828186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1266828186',id=24,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrVMNOfvpNw0WxXnYb9GHoGjkGsVckNGNNSEeB0ystk/UW+bmvyI9JyrkIyp1aWJMJE8lx1rxmssoUoMpwQTPTewIcUxPaAcoIQfMD8tyeIllleUvA0Rxy5zvvcCtrC3Q==',key_name='tempest-keypair-1319177828',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7df6e56783b84282be0ca425358015dd',ramdisk_id='',reservation_id='r-w3y72isf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-341576311',owner_user_name='tempest-TaggedBootDevicesTest-341576311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:32:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='645eeb4fbb2a46d09fd18eaf7de500d0',uuid=fa6dc9c1-6786-4c17-a23e-f71c21ac08a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7485c140-3c08-4191-9929-3c41cb6fd725", "address": "fa:16:3e:3a:3c:8e", "network": {"id": "e4b9e2d9-6b8e-4857-bd3e-19c5d7c80f69", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2926051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7485c140-3c", "ovs_interfaceid": "7485c140-3c08-4191-9929-3c41cb6fd725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Converting VIF {"id": "7485c140-3c08-4191-9929-3c41cb6fd725", "address": "fa:16:3e:3a:3c:8e", "network": {"id": "e4b9e2d9-6b8e-4857-bd3e-19c5d7c80f69", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2926051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7485c140-3c", "ovs_interfaceid": "7485c140-3c08-4191-9929-3c41cb6fd725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:3c:8e,bridge_name='br-int',has_traffic_filtering=True,id=7485c140-3c08-4191-9929-3c41cb6fd725,network=Network(e4b9e2d9-6b8e-4857-bd3e-19c5d7c80f69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7485c140-3c') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG os_vif [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:3c:8e,bridge_name='br-int',has_traffic_filtering=True,id=7485c140-3c08-4191-9929-3c41cb6fd725,network=Network(e4b9e2d9-6b8e-4857-bd3e-19c5d7c80f69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7485c140-3c') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7485c140-3c, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7485c140-3c, col_values=(('external_ids', {'iface-id': '7485c140-3c08-4191-9929-3c41cb6fd725', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:3c:8e', 'vm-uuid': 'fa6dc9c1-6786-4c17-a23e-f71c21ac08a7'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:02 user nova-compute[71229]: INFO os_vif [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:3c:8e,bridge_name='br-int',has_traffic_filtering=True,id=7485c140-3c08-4191-9929-3c41cb6fd725,network=Network(e4b9e2d9-6b8e-4857-bd3e-19c5d7c80f69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7485c140-3c')
Apr 11 15:33:02 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T15:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1266828186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1266828186',id=24,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrVMNOfvpNw0WxXnYb9GHoGjkGsVckNGNNSEeB0ystk/UW+bmvyI9JyrkIyp1aWJMJE8lx1rxmssoUoMpwQTPTewIcUxPaAcoIQfMD8tyeIllleUvA0Rxy5zvvcCtrC3Q==',key_name='tempest-keypair-1319177828',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7df6e56783b84282be0ca425358015dd',ramdisk_id='',reservation_id='r-w3y72isf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-341576311',owner_user_name='tempest-TaggedBootDevicesTest-341576311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:32:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='645eeb4fbb2a46d09fd18eaf7de500d0',uuid=fa6dc9c1-6786-4c17-a23e-f71c21ac08a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7d90fa1-965a-4cc7-bc48-64a43041af23", "address": "fa:16:3e:b2:3b:c0", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d90fa1-96", "ovs_interfaceid": "b7d90fa1-965a-4cc7-bc48-64a43041af23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Converting VIF {"id": "b7d90fa1-965a-4cc7-bc48-64a43041af23", "address": "fa:16:3e:b2:3b:c0", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d90fa1-96", "ovs_interfaceid": "b7d90fa1-965a-4cc7-bc48-64a43041af23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:3b:c0,bridge_name='br-int',has_traffic_filtering=True,id=b7d90fa1-965a-4cc7-bc48-64a43041af23,network=Network(69f124ac-e977-41ac-8d55-e156f042bab8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb7d90fa1-96') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG os_vif [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:3b:c0,bridge_name='br-int',has_traffic_filtering=True,id=b7d90fa1-965a-4cc7-bc48-64a43041af23,network=Network(69f124ac-e977-41ac-8d55-e156f042bab8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb7d90fa1-96') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7d90fa1-96, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb7d90fa1-96, col_values=(('external_ids', {'iface-id': 'b7d90fa1-965a-4cc7-bc48-64a43041af23', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:3b:c0', 'vm-uuid': 'fa6dc9c1-6786-4c17-a23e-f71c21ac08a7'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:02 user nova-compute[71229]: INFO os_vif [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:3b:c0,bridge_name='br-int',has_traffic_filtering=True,id=b7d90fa1-965a-4cc7-bc48-64a43041af23,network=Network(69f124ac-e977-41ac-8d55-e156f042bab8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb7d90fa1-96')
Apr 11 15:33:02 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T15:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1266828186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1266828186',id=24,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrVMNOfvpNw0WxXnYb9GHoGjkGsVckNGNNSEeB0ystk/UW+bmvyI9JyrkIyp1aWJMJE8lx1rxmssoUoMpwQTPTewIcUxPaAcoIQfMD8tyeIllleUvA0Rxy5zvvcCtrC3Q==',key_name='tempest-keypair-1319177828',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7df6e56783b84282be0ca425358015dd',ramdisk_id='',reservation_id='r-w3y72isf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-341576311',owner_user_name='tempest-TaggedBootDevicesTest-341576311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:32:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='645eeb4fbb2a46d09fd18eaf7de500d0',uuid=fa6dc9c1-6786-4c17-a23e-f71c21ac08a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fafe4f73-4fc5-401b-a2bf-542bea23915f", "address": "fa:16:3e:e2:5f:81", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfafe4f73-4f", "ovs_interfaceid": "fafe4f73-4fc5-401b-a2bf-542bea23915f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Converting VIF {"id": "fafe4f73-4fc5-401b-a2bf-542bea23915f", "address": "fa:16:3e:e2:5f:81", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfafe4f73-4f", "ovs_interfaceid": "fafe4f73-4fc5-401b-a2bf-542bea23915f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:5f:81,bridge_name='br-int',has_traffic_filtering=True,id=fafe4f73-4fc5-401b-a2bf-542bea23915f,network=Network(69f124ac-e977-41ac-8d55-e156f042bab8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfafe4f73-4f') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG os_vif [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:5f:81,bridge_name='br-int',has_traffic_filtering=True,id=fafe4f73-4fc5-401b-a2bf-542bea23915f,network=Network(69f124ac-e977-41ac-8d55-e156f042bab8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfafe4f73-4f') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfafe4f73-4f, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfafe4f73-4f, col_values=(('external_ids', {'iface-id': 'fafe4f73-4fc5-401b-a2bf-542bea23915f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:5f:81', 'vm-uuid': 'fa6dc9c1-6786-4c17-a23e-f71c21ac08a7'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:02 user nova-compute[71229]: INFO os_vif [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:5f:81,bridge_name='br-int',has_traffic_filtering=True,id=fafe4f73-4fc5-401b-a2bf-542bea23915f,network=Network(69f124ac-e977-41ac-8d55-e156f042bab8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfafe4f73-4f')
Apr 11 15:33:02 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T15:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1266828186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1266828186',id=24,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrVMNOfvpNw0WxXnYb9GHoGjkGsVckNGNNSEeB0ystk/UW+bmvyI9JyrkIyp1aWJMJE8lx1rxmssoUoMpwQTPTewIcUxPaAcoIQfMD8tyeIllleUvA0Rxy5zvvcCtrC3Q==',key_name='tempest-keypair-1319177828',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7df6e56783b84282be0ca425358015dd',ramdisk_id='',reservation_id='r-w3y72isf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-341576311',owner_user_name='tempest-TaggedBootDevicesTest-341576311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:32:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='645eeb4fbb2a46d09fd18eaf7de500d0',uuid=fa6dc9c1-6786-4c17-a23e-f71c21ac08a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44becdbc-fa86-4dbe-ac1a-e0e01648513b", "address": "fa:16:3e:ed:b8:03", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44becdbc-fa", "ovs_interfaceid": "44becdbc-fa86-4dbe-ac1a-e0e01648513b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Converting VIF {"id": "44becdbc-fa86-4dbe-ac1a-e0e01648513b", "address": "fa:16:3e:ed:b8:03", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44becdbc-fa", "ovs_interfaceid": "44becdbc-fa86-4dbe-ac1a-e0e01648513b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:b8:03,bridge_name='br-int',has_traffic_filtering=True,id=44becdbc-fa86-4dbe-ac1a-e0e01648513b,network=Network(69f124ac-e977-41ac-8d55-e156f042bab8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44becdbc-fa') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG os_vif [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:b8:03,bridge_name='br-int',has_traffic_filtering=True,id=44becdbc-fa86-4dbe-ac1a-e0e01648513b,network=Network(69f124ac-e977-41ac-8d55-e156f042bab8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44becdbc-fa') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap44becdbc-fa, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap44becdbc-fa, col_values=(('external_ids', {'iface-id': '44becdbc-fa86-4dbe-ac1a-e0e01648513b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:b8:03', 'vm-uuid': 'fa6dc9c1-6786-4c17-a23e-f71c21ac08a7'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:02 user nova-compute[71229]: INFO os_vif [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:b8:03,bridge_name='br-int',has_traffic_filtering=True,id=44becdbc-fa86-4dbe-ac1a-e0e01648513b,network=Network(69f124ac-e977-41ac-8d55-e156f042bab8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44becdbc-fa')
Apr 11 15:33:02 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T15:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1266828186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1266828186',id=24,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrVMNOfvpNw0WxXnYb9GHoGjkGsVckNGNNSEeB0ystk/UW+bmvyI9JyrkIyp1aWJMJE8lx1rxmssoUoMpwQTPTewIcUxPaAcoIQfMD8tyeIllleUvA0Rxy5zvvcCtrC3Q==',key_name='tempest-keypair-1319177828',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7df6e56783b84282be0ca425358015dd',ramdisk_id='',reservation_id='r-w3y72isf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-341576311',owner_user_name='tempest-TaggedBootDevicesTest-341576311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:32:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='645eeb4fbb2a46d09fd18eaf7de500d0',uuid=fa6dc9c1-6786-4c17-a23e-f71c21ac08a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf63f34a-3145-4251-a036-a35bd08ef45f", "address": "fa:16:3e:4a:ce:66", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf63f34a-31", "ovs_interfaceid": "bf63f34a-3145-4251-a036-a35bd08ef45f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Converting VIF {"id": "bf63f34a-3145-4251-a036-a35bd08ef45f", "address": "fa:16:3e:4a:ce:66", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf63f34a-31", "ovs_interfaceid": "bf63f34a-3145-4251-a036-a35bd08ef45f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:ce:66,bridge_name='br-int',has_traffic_filtering=True,id=bf63f34a-3145-4251-a036-a35bd08ef45f,network=Network(69f124ac-e977-41ac-8d55-e156f042bab8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf63f34a-31') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG os_vif [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:ce:66,bridge_name='br-int',has_traffic_filtering=True,id=bf63f34a-3145-4251-a036-a35bd08ef45f,network=Network(69f124ac-e977-41ac-8d55-e156f042bab8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf63f34a-31') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf63f34a-31, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbf63f34a-31, col_values=(('external_ids', {'iface-id': 'bf63f34a-3145-4251-a036-a35bd08ef45f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:ce:66', 'vm-uuid': 'fa6dc9c1-6786-4c17-a23e-f71c21ac08a7'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:02 user nova-compute[71229]: INFO os_vif [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:ce:66,bridge_name='br-int',has_traffic_filtering=True,id=bf63f34a-3145-4251-a036-a35bd08ef45f,network=Network(69f124ac-e977-41ac-8d55-e156f042bab8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf63f34a-31')
Apr 11 15:33:02 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T15:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1266828186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1266828186',id=24,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrVMNOfvpNw0WxXnYb9GHoGjkGsVckNGNNSEeB0ystk/UW+bmvyI9JyrkIyp1aWJMJE8lx1rxmssoUoMpwQTPTewIcUxPaAcoIQfMD8tyeIllleUvA0Rxy5zvvcCtrC3Q==',key_name='tempest-keypair-1319177828',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7df6e56783b84282be0ca425358015dd',ramdisk_id='',reservation_id='r-w3y72isf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-341576311',owner_user_name='tempest-TaggedBootDevicesTest-341576311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:32:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='645eeb4fbb2a46d09fd18eaf7de500d0',uuid=fa6dc9c1-6786-4c17-a23e-f71c21ac08a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5066fdb-ea6f-4df5-b185-56f1a0dbe539", "address": "fa:16:3e:5f:b5:3e", "network": {"id": "a08657fa-cfdb-4f36-b464-53fe53b857af", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819766267", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5066fdb-ea", "ovs_interfaceid": "e5066fdb-ea6f-4df5-b185-56f1a0dbe539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Converting VIF {"id": "e5066fdb-ea6f-4df5-b185-56f1a0dbe539", "address": "fa:16:3e:5f:b5:3e", "network": {"id": "a08657fa-cfdb-4f36-b464-53fe53b857af", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819766267", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5066fdb-ea", "ovs_interfaceid": "e5066fdb-ea6f-4df5-b185-56f1a0dbe539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:b5:3e,bridge_name='br-int',has_traffic_filtering=True,id=e5066fdb-ea6f-4df5-b185-56f1a0dbe539,network=Network(a08657fa-cfdb-4f36-b464-53fe53b857af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5066fdb-ea') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG os_vif [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:b5:3e,bridge_name='br-int',has_traffic_filtering=True,id=e5066fdb-ea6f-4df5-b185-56f1a0dbe539,network=Network(a08657fa-cfdb-4f36-b464-53fe53b857af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5066fdb-ea') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape5066fdb-ea, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape5066fdb-ea, col_values=(('external_ids', {'iface-id': 'e5066fdb-ea6f-4df5-b185-56f1a0dbe539', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:b5:3e', 'vm-uuid': 'fa6dc9c1-6786-4c17-a23e-f71c21ac08a7'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:02 user nova-compute[71229]: INFO os_vif [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:b5:3e,bridge_name='br-int',has_traffic_filtering=True,id=e5066fdb-ea6f-4df5-b185-56f1a0dbe539,network=Network(a08657fa-cfdb-4f36-b464-53fe53b857af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5066fdb-ea')
Apr 11 15:33:02 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T15:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1266828186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1266828186',id=24,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrVMNOfvpNw0WxXnYb9GHoGjkGsVckNGNNSEeB0ystk/UW+bmvyI9JyrkIyp1aWJMJE8lx1rxmssoUoMpwQTPTewIcUxPaAcoIQfMD8tyeIllleUvA0Rxy5zvvcCtrC3Q==',key_name='tempest-keypair-1319177828',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7df6e56783b84282be0ca425358015dd',ramdisk_id='',reservation_id='r-w3y72isf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-341576311',owner_user_name='tempest-TaggedBootDevicesTest-341576311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:32:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='645eeb4fbb2a46d09fd18eaf7de500d0',uuid=fa6dc9c1-6786-4c17-a23e-f71c21ac08a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f", "address": "fa:16:3e:e7:ca:1c", "network": {"id": "a08657fa-cfdb-4f36-b464-53fe53b857af", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819766267", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00381a8-f9", "ovs_interfaceid": "b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Converting VIF {"id": "b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f", "address": "fa:16:3e:e7:ca:1c", "network": {"id": "a08657fa-cfdb-4f36-b464-53fe53b857af", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819766267", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00381a8-f9", "ovs_interfaceid": "b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ca:1c,bridge_name='br-int',has_traffic_filtering=True,id=b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f,network=Network(a08657fa-cfdb-4f36-b464-53fe53b857af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb00381a8-f9') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG os_vif [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ca:1c,bridge_name='br-int',has_traffic_filtering=True,id=b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f,network=Network(a08657fa-cfdb-4f36-b464-53fe53b857af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb00381a8-f9') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb00381a8-f9, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb00381a8-f9, col_values=(('external_ids', {'iface-id': 'b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:ca:1c', 'vm-uuid': 'fa6dc9c1-6786-4c17-a23e-f71c21ac08a7'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:02 user nova-compute[71229]: INFO os_vif [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ca:1c,bridge_name='br-int',has_traffic_filtering=True,id=b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f,network=Network(a08657fa-cfdb-4f36-b464-53fe53b857af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb00381a8-f9')
Apr 11 15:33:02 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] No BDM found with device name hda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] No VIF found with MAC fa:16:3e:3a:3c:8e, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] No VIF found with MAC fa:16:3e:4a:ce:66, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:33:02 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Using config drive
Apr 11 15:33:02 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Creating config drive at /opt/stack/data/nova/instances/fa6dc9c1-6786-4c17-a23e-f71c21ac08a7/disk.config
Apr 11 15:33:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fa6dc9c1-6786-4c17-a23e-f71c21ac08a7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmprqkl2p4t {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fa6dc9c1-6786-4c17-a23e-f71c21ac08a7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmprqkl2p4t" returned: 0 in 0.060s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:33:03 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:03 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:03 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:33:03 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:33:03 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:33:03 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 15:33:03 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "refresh_cache-6a805345-374c-4326-9e8f-39bfc7947a35" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:33:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquired lock "refresh_cache-6a805345-374c-4326-9e8f-39bfc7947a35" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:33:04 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Forcefully refreshing network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 15:33:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:04 user nova-compute[71229]: DEBUG nova.compute.manager [req-705cab4b-a7c3-4b3f-a854-71b755c00847 req-7e5047bf-b5fe-4c82-ab8c-50c2dbf039ba service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received event network-vif-plugged-7485c140-3c08-4191-9929-3c41cb6fd725 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:33:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-705cab4b-a7c3-4b3f-a854-71b755c00847 req-7e5047bf-b5fe-4c82-ab8c-50c2dbf039ba service nova] Acquiring lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:33:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-705cab4b-a7c3-4b3f-a854-71b755c00847 req-7e5047bf-b5fe-4c82-ab8c-50c2dbf039ba service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:33:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-705cab4b-a7c3-4b3f-a854-71b755c00847 req-7e5047bf-b5fe-4c82-ab8c-50c2dbf039ba service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:33:04 user nova-compute[71229]: DEBUG nova.compute.manager [req-705cab4b-a7c3-4b3f-a854-71b755c00847 req-7e5047bf-b5fe-4c82-ab8c-50c2dbf039ba service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] No waiting events found dispatching network-vif-plugged-7485c140-3c08-4191-9929-3c41cb6fd725 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:33:04 user nova-compute[71229]: WARNING nova.compute.manager [req-705cab4b-a7c3-4b3f-a854-71b755c00847 req-7e5047bf-b5fe-4c82-ab8c-50c2dbf039ba service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received unexpected event network-vif-plugged-7485c140-3c08-4191-9929-3c41cb6fd725 for instance with vm_state building and task_state spawning.
Apr 11 15:33:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:04 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Updating instance_info_cache with network_info: [{"id": "d8c64197-b034-4f38-821d-ba030f1fca6b", "address": "fa:16:3e:0f:f8:cb", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c64197-b0", "ovs_interfaceid": "d8c64197-b034-4f38-821d-ba030f1fca6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:33:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Releasing lock "refresh_cache-6a805345-374c-4326-9e8f-39bfc7947a35" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:33:04 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Updated the network info_cache for instance {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 15:33:04 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:33:04 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:33:04 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:33:04 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:33:04 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:33:04 user nova-compute[71229]: DEBUG nova.compute.manager [req-aef16efc-8db6-4093-b2b7-7580ba3a2a6e req-2cd26fae-575b-4548-9935-3c20fc9b570a service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received event network-vif-plugged-b7d90fa1-965a-4cc7-bc48-64a43041af23 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:33:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-aef16efc-8db6-4093-b2b7-7580ba3a2a6e req-2cd26fae-575b-4548-9935-3c20fc9b570a service nova] Acquiring lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:33:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-aef16efc-8db6-4093-b2b7-7580ba3a2a6e req-2cd26fae-575b-4548-9935-3c20fc9b570a service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:33:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-aef16efc-8db6-4093-b2b7-7580ba3a2a6e req-2cd26fae-575b-4548-9935-3c20fc9b570a service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:33:04 user nova-compute[71229]: DEBUG nova.compute.manager [req-aef16efc-8db6-4093-b2b7-7580ba3a2a6e req-2cd26fae-575b-4548-9935-3c20fc9b570a service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] No waiting events found dispatching network-vif-plugged-b7d90fa1-965a-4cc7-bc48-64a43041af23 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:33:04 user nova-compute[71229]: WARNING nova.compute.manager [req-aef16efc-8db6-4093-b2b7-7580ba3a2a6e req-2cd26fae-575b-4548-9935-3c20fc9b570a service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received unexpected event network-vif-plugged-b7d90fa1-965a-4cc7-bc48-64a43041af23 for instance with vm_state building and task_state spawning.
Apr 11 15:33:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:04 user nova-compute[71229]: DEBUG nova.compute.manager [req-6abd559d-86d6-48d9-be60-f905ccce78f6 req-f2e9fa12-2b5a-429b-b7f3-edcfafce5d80 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received event network-vif-plugged-fafe4f73-4fc5-401b-a2bf-542bea23915f {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:33:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-6abd559d-86d6-48d9-be60-f905ccce78f6 req-f2e9fa12-2b5a-429b-b7f3-edcfafce5d80 service nova] Acquiring lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:33:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-6abd559d-86d6-48d9-be60-f905ccce78f6 req-f2e9fa12-2b5a-429b-b7f3-edcfafce5d80 service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:33:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-6abd559d-86d6-48d9-be60-f905ccce78f6 req-f2e9fa12-2b5a-429b-b7f3-edcfafce5d80 service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:33:04 user nova-compute[71229]: DEBUG nova.compute.manager [req-6abd559d-86d6-48d9-be60-f905ccce78f6 req-f2e9fa12-2b5a-429b-b7f3-edcfafce5d80 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] No waiting events found dispatching network-vif-plugged-fafe4f73-4fc5-401b-a2bf-542bea23915f {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:33:04 user nova-compute[71229]: WARNING nova.compute.manager [req-6abd559d-86d6-48d9-be60-f905ccce78f6 req-f2e9fa12-2b5a-429b-b7f3-edcfafce5d80 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received unexpected event network-vif-plugged-fafe4f73-4fc5-401b-a2bf-542bea23915f for instance with vm_state building and task_state spawning.
Apr 11 15:33:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:06 user nova-compute[71229]: DEBUG nova.compute.manager [req-fb4a171c-6a6a-4a79-ab6a-8b30c99d016b req-1bb4fe93-f196-465a-87d5-4c27d7807bff service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received event network-vif-plugged-7485c140-3c08-4191-9929-3c41cb6fd725 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:33:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-fb4a171c-6a6a-4a79-ab6a-8b30c99d016b req-1bb4fe93-f196-465a-87d5-4c27d7807bff service nova] Acquiring lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:33:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-fb4a171c-6a6a-4a79-ab6a-8b30c99d016b req-1bb4fe93-f196-465a-87d5-4c27d7807bff service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:33:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-fb4a171c-6a6a-4a79-ab6a-8b30c99d016b req-1bb4fe93-f196-465a-87d5-4c27d7807bff service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:33:06 user nova-compute[71229]: DEBUG nova.compute.manager [req-fb4a171c-6a6a-4a79-ab6a-8b30c99d016b req-1bb4fe93-f196-465a-87d5-4c27d7807bff service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] No waiting events found dispatching network-vif-plugged-7485c140-3c08-4191-9929-3c41cb6fd725 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:33:06 user nova-compute[71229]: WARNING nova.compute.manager [req-fb4a171c-6a6a-4a79-ab6a-8b30c99d016b req-1bb4fe93-f196-465a-87d5-4c27d7807bff service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received unexpected event network-vif-plugged-7485c140-3c08-4191-9929-3c41cb6fd725 for instance with vm_state building and task_state spawning.
Apr 11 15:33:06 user nova-compute[71229]: DEBUG nova.compute.manager [req-fb4a171c-6a6a-4a79-ab6a-8b30c99d016b req-1bb4fe93-f196-465a-87d5-4c27d7807bff service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received event network-vif-plugged-bf63f34a-3145-4251-a036-a35bd08ef45f {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:33:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-fb4a171c-6a6a-4a79-ab6a-8b30c99d016b req-1bb4fe93-f196-465a-87d5-4c27d7807bff service nova] Acquiring lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:33:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-fb4a171c-6a6a-4a79-ab6a-8b30c99d016b req-1bb4fe93-f196-465a-87d5-4c27d7807bff service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:33:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-fb4a171c-6a6a-4a79-ab6a-8b30c99d016b req-1bb4fe93-f196-465a-87d5-4c27d7807bff service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:33:06 user nova-compute[71229]: DEBUG nova.compute.manager [req-fb4a171c-6a6a-4a79-ab6a-8b30c99d016b req-1bb4fe93-f196-465a-87d5-4c27d7807bff service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] No waiting events found dispatching network-vif-plugged-bf63f34a-3145-4251-a036-a35bd08ef45f {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:33:06 user nova-compute[71229]: WARNING nova.compute.manager [req-fb4a171c-6a6a-4a79-ab6a-8b30c99d016b req-1bb4fe93-f196-465a-87d5-4c27d7807bff service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received unexpected event network-vif-plugged-bf63f34a-3145-4251-a036-a35bd08ef45f for instance with vm_state building and task_state spawning.
Apr 11 15:33:06 user nova-compute[71229]: DEBUG nova.compute.manager [req-fb4a171c-6a6a-4a79-ab6a-8b30c99d016b req-1bb4fe93-f196-465a-87d5-4c27d7807bff service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received event network-vif-plugged-bf63f34a-3145-4251-a036-a35bd08ef45f {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:33:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-fb4a171c-6a6a-4a79-ab6a-8b30c99d016b req-1bb4fe93-f196-465a-87d5-4c27d7807bff service nova] Acquiring lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:33:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-fb4a171c-6a6a-4a79-ab6a-8b30c99d016b req-1bb4fe93-f196-465a-87d5-4c27d7807bff service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:33:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-fb4a171c-6a6a-4a79-ab6a-8b30c99d016b req-1bb4fe93-f196-465a-87d5-4c27d7807bff service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:33:06 user nova-compute[71229]: DEBUG nova.compute.manager [req-fb4a171c-6a6a-4a79-ab6a-8b30c99d016b req-1bb4fe93-f196-465a-87d5-4c27d7807bff service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] No waiting events found dispatching network-vif-plugged-bf63f34a-3145-4251-a036-a35bd08ef45f {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:33:06 user nova-compute[71229]: WARNING nova.compute.manager [req-fb4a171c-6a6a-4a79-ab6a-8b30c99d016b req-1bb4fe93-f196-465a-87d5-4c27d7807bff service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received unexpected event network-vif-plugged-bf63f34a-3145-4251-a036-a35bd08ef45f for instance with vm_state building and task_state spawning.
Apr 11 15:33:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:06 user nova-compute[71229]: DEBUG nova.compute.manager [req-3c560f71-c89d-4eed-9d0a-cc9dcd188c56 req-425c5dda-e3ee-4b56-843f-45015c1bc594 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received event network-vif-plugged-b7d90fa1-965a-4cc7-bc48-64a43041af23 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:33:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3c560f71-c89d-4eed-9d0a-cc9dcd188c56 req-425c5dda-e3ee-4b56-843f-45015c1bc594 service nova] Acquiring lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:33:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3c560f71-c89d-4eed-9d0a-cc9dcd188c56 req-425c5dda-e3ee-4b56-843f-45015c1bc594 service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:33:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3c560f71-c89d-4eed-9d0a-cc9dcd188c56 req-425c5dda-e3ee-4b56-843f-45015c1bc594 service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:33:06 user nova-compute[71229]: DEBUG nova.compute.manager [req-3c560f71-c89d-4eed-9d0a-cc9dcd188c56 req-425c5dda-e3ee-4b56-843f-45015c1bc594 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] No waiting events found dispatching network-vif-plugged-b7d90fa1-965a-4cc7-bc48-64a43041af23 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:33:06 user nova-compute[71229]: WARNING nova.compute.manager [req-3c560f71-c89d-4eed-9d0a-cc9dcd188c56 req-425c5dda-e3ee-4b56-843f-45015c1bc594 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received unexpected event network-vif-plugged-b7d90fa1-965a-4cc7-bc48-64a43041af23 for instance with vm_state building and task_state spawning.
Apr 11 15:33:06 user nova-compute[71229]: DEBUG nova.compute.manager [req-3c560f71-c89d-4eed-9d0a-cc9dcd188c56 req-425c5dda-e3ee-4b56-843f-45015c1bc594 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received event network-vif-plugged-44becdbc-fa86-4dbe-ac1a-e0e01648513b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:33:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3c560f71-c89d-4eed-9d0a-cc9dcd188c56 req-425c5dda-e3ee-4b56-843f-45015c1bc594 service nova] Acquiring lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:33:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3c560f71-c89d-4eed-9d0a-cc9dcd188c56 req-425c5dda-e3ee-4b56-843f-45015c1bc594 service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:33:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3c560f71-c89d-4eed-9d0a-cc9dcd188c56 req-425c5dda-e3ee-4b56-843f-45015c1bc594 service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:33:06 user nova-compute[71229]: DEBUG nova.compute.manager [req-3c560f71-c89d-4eed-9d0a-cc9dcd188c56 req-425c5dda-e3ee-4b56-843f-45015c1bc594 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] No waiting events found dispatching network-vif-plugged-44becdbc-fa86-4dbe-ac1a-e0e01648513b {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:33:06 user nova-compute[71229]: WARNING nova.compute.manager [req-3c560f71-c89d-4eed-9d0a-cc9dcd188c56 req-425c5dda-e3ee-4b56-843f-45015c1bc594 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received unexpected event network-vif-plugged-44becdbc-fa86-4dbe-ac1a-e0e01648513b for instance with vm_state building and task_state spawning.
Apr 11 15:33:06 user nova-compute[71229]: DEBUG nova.compute.manager [req-3c560f71-c89d-4eed-9d0a-cc9dcd188c56 req-425c5dda-e3ee-4b56-843f-45015c1bc594 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received event network-vif-plugged-44becdbc-fa86-4dbe-ac1a-e0e01648513b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:33:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3c560f71-c89d-4eed-9d0a-cc9dcd188c56 req-425c5dda-e3ee-4b56-843f-45015c1bc594 service nova] Acquiring lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:33:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3c560f71-c89d-4eed-9d0a-cc9dcd188c56 req-425c5dda-e3ee-4b56-843f-45015c1bc594 service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:33:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3c560f71-c89d-4eed-9d0a-cc9dcd188c56 req-425c5dda-e3ee-4b56-843f-45015c1bc594 service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:33:06 user nova-compute[71229]: DEBUG nova.compute.manager [req-3c560f71-c89d-4eed-9d0a-cc9dcd188c56 req-425c5dda-e3ee-4b56-843f-45015c1bc594 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] No waiting events found dispatching network-vif-plugged-44becdbc-fa86-4dbe-ac1a-e0e01648513b {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:33:06 user nova-compute[71229]: WARNING nova.compute.manager [req-3c560f71-c89d-4eed-9d0a-cc9dcd188c56 req-425c5dda-e3ee-4b56-843f-45015c1bc594 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received unexpected event network-vif-plugged-44becdbc-fa86-4dbe-ac1a-e0e01648513b for instance with vm_state building and task_state spawning.
Apr 11 15:33:06 user nova-compute[71229]: DEBUG nova.compute.manager [req-3c560f71-c89d-4eed-9d0a-cc9dcd188c56 req-425c5dda-e3ee-4b56-843f-45015c1bc594 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received event network-vif-plugged-e5066fdb-ea6f-4df5-b185-56f1a0dbe539 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:33:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3c560f71-c89d-4eed-9d0a-cc9dcd188c56 req-425c5dda-e3ee-4b56-843f-45015c1bc594 service nova] Acquiring lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:33:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3c560f71-c89d-4eed-9d0a-cc9dcd188c56 req-425c5dda-e3ee-4b56-843f-45015c1bc594 service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:33:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3c560f71-c89d-4eed-9d0a-cc9dcd188c56 req-425c5dda-e3ee-4b56-843f-45015c1bc594 service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:33:06 user nova-compute[71229]: DEBUG nova.compute.manager [req-3c560f71-c89d-4eed-9d0a-cc9dcd188c56 req-425c5dda-e3ee-4b56-843f-45015c1bc594 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] No waiting events found dispatching network-vif-plugged-e5066fdb-ea6f-4df5-b185-56f1a0dbe539 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:33:06 user nova-compute[71229]: WARNING nova.compute.manager [req-3c560f71-c89d-4eed-9d0a-cc9dcd188c56 req-425c5dda-e3ee-4b56-843f-45015c1bc594 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received unexpected event network-vif-plugged-e5066fdb-ea6f-4df5-b185-56f1a0dbe539 for instance with vm_state building and task_state spawning.
Apr 11 15:33:06 user nova-compute[71229]: DEBUG nova.compute.manager [req-3c560f71-c89d-4eed-9d0a-cc9dcd188c56 req-425c5dda-e3ee-4b56-843f-45015c1bc594 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received event network-vif-plugged-e5066fdb-ea6f-4df5-b185-56f1a0dbe539 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:33:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3c560f71-c89d-4eed-9d0a-cc9dcd188c56 req-425c5dda-e3ee-4b56-843f-45015c1bc594 service nova] Acquiring lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:33:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3c560f71-c89d-4eed-9d0a-cc9dcd188c56 req-425c5dda-e3ee-4b56-843f-45015c1bc594 service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:33:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3c560f71-c89d-4eed-9d0a-cc9dcd188c56 req-425c5dda-e3ee-4b56-843f-45015c1bc594 service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:33:06 user nova-compute[71229]: DEBUG nova.compute.manager [req-3c560f71-c89d-4eed-9d0a-cc9dcd188c56 req-425c5dda-e3ee-4b56-843f-45015c1bc594 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] No waiting events found dispatching network-vif-plugged-e5066fdb-ea6f-4df5-b185-56f1a0dbe539 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:33:06 user nova-compute[71229]: WARNING nova.compute.manager [req-3c560f71-c89d-4eed-9d0a-cc9dcd188c56 req-425c5dda-e3ee-4b56-843f-45015c1bc594 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received unexpected event network-vif-plugged-e5066fdb-ea6f-4df5-b185-56f1a0dbe539 for instance with vm_state building and task_state spawning.
Apr 11 15:33:06 user nova-compute[71229]: DEBUG nova.compute.manager [req-3c560f71-c89d-4eed-9d0a-cc9dcd188c56 req-425c5dda-e3ee-4b56-843f-45015c1bc594 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received event network-vif-plugged-b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:33:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3c560f71-c89d-4eed-9d0a-cc9dcd188c56 req-425c5dda-e3ee-4b56-843f-45015c1bc594 service nova] Acquiring lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:33:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3c560f71-c89d-4eed-9d0a-cc9dcd188c56 req-425c5dda-e3ee-4b56-843f-45015c1bc594 service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:33:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3c560f71-c89d-4eed-9d0a-cc9dcd188c56 req-425c5dda-e3ee-4b56-843f-45015c1bc594 service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:33:06 user nova-compute[71229]: DEBUG nova.compute.manager [req-3c560f71-c89d-4eed-9d0a-cc9dcd188c56 req-425c5dda-e3ee-4b56-843f-45015c1bc594 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] No waiting events found dispatching network-vif-plugged-b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:33:06 user nova-compute[71229]: WARNING nova.compute.manager [req-3c560f71-c89d-4eed-9d0a-cc9dcd188c56 req-425c5dda-e3ee-4b56-843f-45015c1bc594 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received unexpected event network-vif-plugged-b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f for instance with vm_state building and task_state spawning.
Apr 11 15:33:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:06 user nova-compute[71229]: DEBUG nova.compute.manager [req-11dc5cf2-8d82-4783-8841-38b346814a81 req-aa9157c8-d7b8-4bf0-a40d-edd90ab61cfe service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received event network-vif-plugged-fafe4f73-4fc5-401b-a2bf-542bea23915f {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:33:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-11dc5cf2-8d82-4783-8841-38b346814a81 req-aa9157c8-d7b8-4bf0-a40d-edd90ab61cfe service nova] Acquiring lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:33:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-11dc5cf2-8d82-4783-8841-38b346814a81 req-aa9157c8-d7b8-4bf0-a40d-edd90ab61cfe service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:33:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-11dc5cf2-8d82-4783-8841-38b346814a81 req-aa9157c8-d7b8-4bf0-a40d-edd90ab61cfe service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:33:06 user nova-compute[71229]: DEBUG nova.compute.manager [req-11dc5cf2-8d82-4783-8841-38b346814a81 req-aa9157c8-d7b8-4bf0-a40d-edd90ab61cfe service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] No waiting events found dispatching network-vif-plugged-fafe4f73-4fc5-401b-a2bf-542bea23915f {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:33:06 user nova-compute[71229]: WARNING nova.compute.manager [req-11dc5cf2-8d82-4783-8841-38b346814a81 req-aa9157c8-d7b8-4bf0-a40d-edd90ab61cfe service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received unexpected event network-vif-plugged-fafe4f73-4fc5-401b-a2bf-542bea23915f for instance with vm_state building and task_state spawning.
Apr 11 15:33:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:08 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227188.0858686, fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:33:08 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] VM Resumed (Lifecycle Event)
Apr 11 15:33:08 user nova-compute[71229]: DEBUG nova.compute.manager [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 15:33:08 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Guest created on hypervisor {{(pid=71229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 15:33:08 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Instance spawned successfully.
Apr 11 15:33:08 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 15:33:08 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:33:08 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:33:08 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Found default for hw_cdrom_bus of ide {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:33:08 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Found default for hw_disk_bus of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:33:08 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Found default for hw_input_bus of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:33:08 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Found default for hw_pointer_model of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:33:08 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Found default for hw_video_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:33:08 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Found default for hw_vif_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:33:08 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:33:08 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227188.0903873, fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:33:08 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] VM Started (Lifecycle Event)
Apr 11 15:33:08 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:33:08 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:33:08 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:33:08 user nova-compute[71229]: INFO nova.compute.manager [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Took 10.56 seconds to spawn the instance on the hypervisor.
Apr 11 15:33:08 user nova-compute[71229]: DEBUG nova.compute.manager [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:33:08 user nova-compute[71229]: INFO nova.compute.manager [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Took 25.32 seconds to build instance.
Apr 11 15:33:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-05e60972-279d-4f02-9a30-355333e612ab tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.422s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:33:08 user nova-compute[71229]: DEBUG nova.compute.manager [req-950947f2-620a-4b5b-bc24-a1f120a07d11 req-50f18b7c-628c-4ec9-8f8a-e453f155765c service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received event network-vif-plugged-b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:33:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-950947f2-620a-4b5b-bc24-a1f120a07d11 req-50f18b7c-628c-4ec9-8f8a-e453f155765c service nova] Acquiring lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:33:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-950947f2-620a-4b5b-bc24-a1f120a07d11 req-50f18b7c-628c-4ec9-8f8a-e453f155765c service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:33:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-950947f2-620a-4b5b-bc24-a1f120a07d11 req-50f18b7c-628c-4ec9-8f8a-e453f155765c service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:33:08 user nova-compute[71229]: DEBUG nova.compute.manager [req-950947f2-620a-4b5b-bc24-a1f120a07d11 req-50f18b7c-628c-4ec9-8f8a-e453f155765c service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] No waiting events found dispatching network-vif-plugged-b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:33:08 user nova-compute[71229]: WARNING nova.compute.manager [req-950947f2-620a-4b5b-bc24-a1f120a07d11 req-50f18b7c-628c-4ec9-8f8a-e453f155765c service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received unexpected event network-vif-plugged-b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f for instance with vm_state active and task_state None.
Apr 11 15:33:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:12 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:16 user nova-compute[71229]: DEBUG nova.compute.manager [req-22bf1387-d01e-436e-8287-f6f082a1fd47 req-9e887cff-5a37-48ce-b8e6-542f22f0eb80 service nova] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Received event network-changed-3ae0cd28-c459-47b7-be17-133b69773f9c {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:33:16 user nova-compute[71229]: DEBUG nova.compute.manager [req-22bf1387-d01e-436e-8287-f6f082a1fd47 req-9e887cff-5a37-48ce-b8e6-542f22f0eb80 service nova] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Refreshing instance network info cache due to event network-changed-3ae0cd28-c459-47b7-be17-133b69773f9c. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:33:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-22bf1387-d01e-436e-8287-f6f082a1fd47 req-9e887cff-5a37-48ce-b8e6-542f22f0eb80 service nova] Acquiring lock "refresh_cache-ffc25fc1-e59f-42c8-a371-b4b12e17fd59" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:33:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-22bf1387-d01e-436e-8287-f6f082a1fd47 req-9e887cff-5a37-48ce-b8e6-542f22f0eb80 service nova] Acquired lock "refresh_cache-ffc25fc1-e59f-42c8-a371-b4b12e17fd59" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:33:16 user nova-compute[71229]: DEBUG nova.network.neutron [req-22bf1387-d01e-436e-8287-f6f082a1fd47 req-9e887cff-5a37-48ce-b8e6-542f22f0eb80 service nova] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Refreshing network info cache for port 3ae0cd28-c459-47b7-be17-133b69773f9c {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:33:16 user nova-compute[71229]: DEBUG nova.network.neutron [req-22bf1387-d01e-436e-8287-f6f082a1fd47 req-9e887cff-5a37-48ce-b8e6-542f22f0eb80 service nova] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Updated VIF entry in instance network info cache for port 3ae0cd28-c459-47b7-be17-133b69773f9c. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:33:16 user nova-compute[71229]: DEBUG nova.network.neutron [req-22bf1387-d01e-436e-8287-f6f082a1fd47 req-9e887cff-5a37-48ce-b8e6-542f22f0eb80 service nova] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Updating instance_info_cache with network_info: [{"id": "3ae0cd28-c459-47b7-be17-133b69773f9c", "address": "fa:16:3e:b9:69:19", "network": {"id": "15a1a586-0100-4057-8501-5c5a282d4063", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834988552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b9b79fb98441fd9f1b5df54471f0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae0cd28-c4", "ovs_interfaceid": "3ae0cd28-c459-47b7-be17-133b69773f9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:33:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-22bf1387-d01e-436e-8287-f6f082a1fd47 req-9e887cff-5a37-48ce-b8e6-542f22f0eb80 service nova] Releasing lock "refresh_cache-ffc25fc1-e59f-42c8-a371-b4b12e17fd59" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:33:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-bc7514dc-0f12-4924-a823-e05b6dbc4d23 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ffc25fc1-e59f-42c8-a371-b4b12e17fd59" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:33:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-bc7514dc-0f12-4924-a823-e05b6dbc4d23 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ffc25fc1-e59f-42c8-a371-b4b12e17fd59" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:33:18 user nova-compute[71229]: INFO nova.compute.manager [None req-bc7514dc-0f12-4924-a823-e05b6dbc4d23 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Shelving
Apr 11 15:33:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:19 user nova-compute[71229]: DEBUG nova.compute.manager [req-b66b60b5-7e71-4b58-87d0-3982039db371 req-7c543db8-68e5-4193-a662-2d6cb6a22883 service nova] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Received event network-vif-unplugged-3ae0cd28-c459-47b7-be17-133b69773f9c {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:33:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-b66b60b5-7e71-4b58-87d0-3982039db371 req-7c543db8-68e5-4193-a662-2d6cb6a22883 service nova] Acquiring lock "ffc25fc1-e59f-42c8-a371-b4b12e17fd59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:33:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-b66b60b5-7e71-4b58-87d0-3982039db371 req-7c543db8-68e5-4193-a662-2d6cb6a22883 service nova] Lock "ffc25fc1-e59f-42c8-a371-b4b12e17fd59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:33:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-b66b60b5-7e71-4b58-87d0-3982039db371 req-7c543db8-68e5-4193-a662-2d6cb6a22883 service nova] Lock "ffc25fc1-e59f-42c8-a371-b4b12e17fd59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:33:19 user nova-compute[71229]: DEBUG nova.compute.manager [req-b66b60b5-7e71-4b58-87d0-3982039db371 req-7c543db8-68e5-4193-a662-2d6cb6a22883 service nova] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] No waiting events found dispatching network-vif-unplugged-3ae0cd28-c459-47b7-be17-133b69773f9c {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:33:19 user nova-compute[71229]: WARNING nova.compute.manager [req-b66b60b5-7e71-4b58-87d0-3982039db371 req-7c543db8-68e5-4193-a662-2d6cb6a22883 service nova] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Received unexpected event network-vif-unplugged-3ae0cd28-c459-47b7-be17-133b69773f9c for instance with vm_state active and task_state shelving.
Apr 11 15:33:19 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Instance destroyed successfully.
Apr 11 15:33:19 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-bc7514dc-0f12-4924-a823-e05b6dbc4d23 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Beginning cold snapshot process
Apr 11 15:33:19 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:19 user nova-compute[71229]: DEBUG nova.privsep.utils [None req-bc7514dc-0f12-4924-a823-e05b6dbc4d23 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71229) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 15:33:19 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-bc7514dc-0f12-4924-a823-e05b6dbc4d23 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ffc25fc1-e59f-42c8-a371-b4b12e17fd59/disk /opt/stack/data/nova/instances/snapshots/tmp6i9abg1s/7f8b39afeb254eb184dc79e73119af47 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-bc7514dc-0f12-4924-a823-e05b6dbc4d23 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ffc25fc1-e59f-42c8-a371-b4b12e17fd59/disk /opt/stack/data/nova/instances/snapshots/tmp6i9abg1s/7f8b39afeb254eb184dc79e73119af47" returned: 0 in 0.457s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:33:20 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-bc7514dc-0f12-4924-a823-e05b6dbc4d23 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Snapshot extracted, beginning image upload
Apr 11 15:33:21 user nova-compute[71229]: DEBUG nova.compute.manager [req-fb1c30a0-5ac7-4dae-a5f6-a56ab1cd56f6 req-00b55ac6-632e-4fd0-809e-a7962d5f3529 service nova] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Received event network-vif-plugged-3ae0cd28-c459-47b7-be17-133b69773f9c {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:33:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-fb1c30a0-5ac7-4dae-a5f6-a56ab1cd56f6 req-00b55ac6-632e-4fd0-809e-a7962d5f3529 service nova] Acquiring lock "ffc25fc1-e59f-42c8-a371-b4b12e17fd59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:33:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-fb1c30a0-5ac7-4dae-a5f6-a56ab1cd56f6 req-00b55ac6-632e-4fd0-809e-a7962d5f3529 service nova] Lock "ffc25fc1-e59f-42c8-a371-b4b12e17fd59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:33:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-fb1c30a0-5ac7-4dae-a5f6-a56ab1cd56f6 req-00b55ac6-632e-4fd0-809e-a7962d5f3529 service nova] Lock "ffc25fc1-e59f-42c8-a371-b4b12e17fd59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:33:21 user nova-compute[71229]: DEBUG nova.compute.manager [req-fb1c30a0-5ac7-4dae-a5f6-a56ab1cd56f6 req-00b55ac6-632e-4fd0-809e-a7962d5f3529 service nova] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] No waiting events found dispatching network-vif-plugged-3ae0cd28-c459-47b7-be17-133b69773f9c {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:33:21 user nova-compute[71229]: WARNING nova.compute.manager [req-fb1c30a0-5ac7-4dae-a5f6-a56ab1cd56f6 req-00b55ac6-632e-4fd0-809e-a7962d5f3529 service nova] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Received unexpected event network-vif-plugged-3ae0cd28-c459-47b7-be17-133b69773f9c for instance with vm_state active and task_state shelving_image_uploading.
Apr 11 15:33:21 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:22 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-bc7514dc-0f12-4924-a823-e05b6dbc4d23 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Snapshot image upload complete
Apr 11 15:33:22 user nova-compute[71229]: DEBUG nova.compute.manager [None req-bc7514dc-0f12-4924-a823-e05b6dbc4d23 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:33:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:22 user nova-compute[71229]: INFO nova.compute.manager [None req-bc7514dc-0f12-4924-a823-e05b6dbc4d23 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Shelve offloading
Apr 11 15:33:22 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Instance destroyed successfully.
Apr 11 15:33:22 user nova-compute[71229]: DEBUG nova.compute.manager [None req-bc7514dc-0f12-4924-a823-e05b6dbc4d23 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:33:22 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-bc7514dc-0f12-4924-a823-e05b6dbc4d23 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "refresh_cache-ffc25fc1-e59f-42c8-a371-b4b12e17fd59" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:33:22 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-bc7514dc-0f12-4924-a823-e05b6dbc4d23 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquired lock "refresh_cache-ffc25fc1-e59f-42c8-a371-b4b12e17fd59" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:33:22 user nova-compute[71229]: DEBUG nova.network.neutron [None req-bc7514dc-0f12-4924-a823-e05b6dbc4d23 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:33:22 user nova-compute[71229]: DEBUG nova.network.neutron [None req-bc7514dc-0f12-4924-a823-e05b6dbc4d23 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Updating instance_info_cache with network_info: [{"id": "3ae0cd28-c459-47b7-be17-133b69773f9c", "address": "fa:16:3e:b9:69:19", "network": {"id": "15a1a586-0100-4057-8501-5c5a282d4063", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834988552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b9b79fb98441fd9f1b5df54471f0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae0cd28-c4", "ovs_interfaceid": "3ae0cd28-c459-47b7-be17-133b69773f9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:33:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-bc7514dc-0f12-4924-a823-e05b6dbc4d23 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Releasing lock "refresh_cache-ffc25fc1-e59f-42c8-a371-b4b12e17fd59" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:33:23 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Instance destroyed successfully.
Apr 11 15:33:23 user nova-compute[71229]: DEBUG nova.objects.instance [None req-bc7514dc-0f12-4924-a823-e05b6dbc4d23 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lazy-loading 'resources' on Instance uuid ffc25fc1-e59f-42c8-a371-b4b12e17fd59 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:33:23 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-bc7514dc-0f12-4924-a823-e05b6dbc4d23 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:31:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1714025063',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1714025063',id=21,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYrUwvaqlHN87/1coexF5rSHRlGXUa9nMDtkuMig5cppT2KcjZ1/LzgWVf5StAo8KnqLK68JMRfWhU47MCnTdmCe53lfYleLEedLL3gnNiTy7iFFgo0q1LydREc5eKJzQ==',key_name='tempest-keypair-1917410281',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:31:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='63b9b79fb98441fd9f1b5df54471f0bd',ramdisk_id='',reservation_id='r-kzb2xrpd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1785499036',owner_user_name='tempest-AttachVolumeShelveTestJSON-1785499036-project-member',shelved_at='2023-04-11T15:33:22.236297',shelved_host='user',shelved_image_id='37770c03-60d7-4c48-b5b9-8b5fb0e7e81c'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:33:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88d988d9ce0a41669b7c487ac07b4cfe',uuid=ffc25fc1-e59f-42c8-a371-b4b12e17fd59,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "3ae0cd28-c459-47b7-be17-133b69773f9c", "address": "fa:16:3e:b9:69:19", "network": {"id": "15a1a586-0100-4057-8501-5c5a282d4063", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834988552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b9b79fb98441fd9f1b5df54471f0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae0cd28-c4", "ovs_interfaceid": "3ae0cd28-c459-47b7-be17-133b69773f9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:33:23 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-bc7514dc-0f12-4924-a823-e05b6dbc4d23 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Converting VIF {"id": "3ae0cd28-c459-47b7-be17-133b69773f9c", "address": "fa:16:3e:b9:69:19", "network": {"id": "15a1a586-0100-4057-8501-5c5a282d4063", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834988552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b9b79fb98441fd9f1b5df54471f0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae0cd28-c4", "ovs_interfaceid": "3ae0cd28-c459-47b7-be17-133b69773f9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:33:23 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-bc7514dc-0f12-4924-a823-e05b6dbc4d23 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:69:19,bridge_name='br-int',has_traffic_filtering=True,id=3ae0cd28-c459-47b7-be17-133b69773f9c,network=Network(15a1a586-0100-4057-8501-5c5a282d4063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ae0cd28-c4') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:33:23 user nova-compute[71229]: DEBUG os_vif [None req-bc7514dc-0f12-4924-a823-e05b6dbc4d23 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:69:19,bridge_name='br-int',has_traffic_filtering=True,id=3ae0cd28-c459-47b7-be17-133b69773f9c,network=Network(15a1a586-0100-4057-8501-5c5a282d4063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ae0cd28-c4') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:33:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ae0cd28-c4, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:33:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:33:23 user nova-compute[71229]: INFO os_vif [None req-bc7514dc-0f12-4924-a823-e05b6dbc4d23 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:69:19,bridge_name='br-int',has_traffic_filtering=True,id=3ae0cd28-c459-47b7-be17-133b69773f9c,network=Network(15a1a586-0100-4057-8501-5c5a282d4063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ae0cd28-c4')
Apr 11 15:33:23 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-bc7514dc-0f12-4924-a823-e05b6dbc4d23 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Deleting instance files /opt/stack/data/nova/instances/ffc25fc1-e59f-42c8-a371-b4b12e17fd59_del
Apr 11 15:33:23 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-bc7514dc-0f12-4924-a823-e05b6dbc4d23 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Deletion of /opt/stack/data/nova/instances/ffc25fc1-e59f-42c8-a371-b4b12e17fd59_del complete
Apr 11 15:33:23 user nova-compute[71229]: DEBUG nova.compute.manager [req-e989d00c-a2dc-4ba0-9ce6-da06b604a976 req-5cd71a7f-121c-4de7-b74a-a7a4b869e25c service nova] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Received event network-changed-3ae0cd28-c459-47b7-be17-133b69773f9c {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:33:23 user nova-compute[71229]: DEBUG nova.compute.manager [req-e989d00c-a2dc-4ba0-9ce6-da06b604a976 req-5cd71a7f-121c-4de7-b74a-a7a4b869e25c service nova] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Refreshing instance network info cache due to event network-changed-3ae0cd28-c459-47b7-be17-133b69773f9c. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:33:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e989d00c-a2dc-4ba0-9ce6-da06b604a976 req-5cd71a7f-121c-4de7-b74a-a7a4b869e25c service nova] Acquiring lock "refresh_cache-ffc25fc1-e59f-42c8-a371-b4b12e17fd59" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:33:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e989d00c-a2dc-4ba0-9ce6-da06b604a976 req-5cd71a7f-121c-4de7-b74a-a7a4b869e25c service nova] Acquired lock "refresh_cache-ffc25fc1-e59f-42c8-a371-b4b12e17fd59" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:33:23 user nova-compute[71229]: DEBUG nova.network.neutron [req-e989d00c-a2dc-4ba0-9ce6-da06b604a976 req-5cd71a7f-121c-4de7-b74a-a7a4b869e25c service nova] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Refreshing network info cache for port 3ae0cd28-c459-47b7-be17-133b69773f9c {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:33:23 user nova-compute[71229]: INFO nova.scheduler.client.report [None req-bc7514dc-0f12-4924-a823-e05b6dbc4d23 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Deleted allocations for instance ffc25fc1-e59f-42c8-a371-b4b12e17fd59
Apr 11 15:33:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-bc7514dc-0f12-4924-a823-e05b6dbc4d23 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:33:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-bc7514dc-0f12-4924-a823-e05b6dbc4d23 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:33:23 user nova-compute[71229]: DEBUG nova.objects.instance [None req-bc7514dc-0f12-4924-a823-e05b6dbc4d23 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lazy-loading 'numa_topology' on Instance uuid ffc25fc1-e59f-42c8-a371-b4b12e17fd59 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:33:24 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-bc7514dc-0f12-4924-a823-e05b6dbc4d23 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:33:24 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-bc7514dc-0f12-4924-a823-e05b6dbc4d23 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:33:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-bc7514dc-0f12-4924-a823-e05b6dbc4d23 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.353s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:33:24 user nova-compute[71229]: DEBUG nova.network.neutron [req-e989d00c-a2dc-4ba0-9ce6-da06b604a976 req-5cd71a7f-121c-4de7-b74a-a7a4b869e25c service nova] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Updated VIF entry in instance network info cache for port 3ae0cd28-c459-47b7-be17-133b69773f9c. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:33:24 user nova-compute[71229]: DEBUG nova.network.neutron [req-e989d00c-a2dc-4ba0-9ce6-da06b604a976 req-5cd71a7f-121c-4de7-b74a-a7a4b869e25c service nova] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Updating instance_info_cache with network_info: [{"id": "3ae0cd28-c459-47b7-be17-133b69773f9c", "address": "fa:16:3e:b9:69:19", "network": {"id": "15a1a586-0100-4057-8501-5c5a282d4063", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-834988552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b9b79fb98441fd9f1b5df54471f0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap3ae0cd28-c4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:33:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e989d00c-a2dc-4ba0-9ce6-da06b604a976 req-5cd71a7f-121c-4de7-b74a-a7a4b869e25c service nova] Releasing lock "refresh_cache-ffc25fc1-e59f-42c8-a371-b4b12e17fd59" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:33:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-bc7514dc-0f12-4924-a823-e05b6dbc4d23 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ffc25fc1-e59f-42c8-a371-b4b12e17fd59" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.707s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:33:24 user nova-compute[71229]: DEBUG nova.compute.manager [req-a7b7e238-891a-4656-84d7-d456122b8936 req-caa5c11a-1497-49d8-b4d7-98e9cda967f6 service nova] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Received event network-changed-c6826c01-eadd-49db-a842-accd25f7534a {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:33:24 user nova-compute[71229]: DEBUG nova.compute.manager [req-a7b7e238-891a-4656-84d7-d456122b8936 req-caa5c11a-1497-49d8-b4d7-98e9cda967f6 service nova] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Refreshing instance network info cache due to event network-changed-c6826c01-eadd-49db-a842-accd25f7534a. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:33:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a7b7e238-891a-4656-84d7-d456122b8936 req-caa5c11a-1497-49d8-b4d7-98e9cda967f6 service nova] Acquiring lock "refresh_cache-85658a44-9ff2-4553-b9fd-686bf35fd6ec" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:33:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a7b7e238-891a-4656-84d7-d456122b8936 req-caa5c11a-1497-49d8-b4d7-98e9cda967f6 service nova] Acquired lock "refresh_cache-85658a44-9ff2-4553-b9fd-686bf35fd6ec" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:33:24 user nova-compute[71229]: DEBUG nova.network.neutron [req-a7b7e238-891a-4656-84d7-d456122b8936 req-caa5c11a-1497-49d8-b4d7-98e9cda967f6 service nova] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Refreshing network info cache for port c6826c01-eadd-49db-a842-accd25f7534a {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:33:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "85658a44-9ff2-4553-b9fd-686bf35fd6ec" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:33:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "85658a44-9ff2-4553-b9fd-686bf35fd6ec" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:33:24 user nova-compute[71229]: DEBUG nova.objects.instance [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lazy-loading 'flavor' on Instance uuid 85658a44-9ff2-4553-b9fd-686bf35fd6ec {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:33:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "85658a44-9ff2-4553-b9fd-686bf35fd6ec" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:33:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "85658a44-9ff2-4553-b9fd-686bf35fd6ec" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:33:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "85658a44-9ff2-4553-b9fd-686bf35fd6ec" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:33:24 user nova-compute[71229]: INFO nova.compute.manager [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Attaching volume 5975605f-731a-43b1-8fef-2c0b05624d1a to /dev/vdb
Apr 11 15:33:25 user nova-compute[71229]: DEBUG os_brick.utils [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:33:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:33:25 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b479ba-41f4-4c7e-a0e7-caf8614981e7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d55e24a97c90\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:33:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:33:25 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8ddcab-a17c-4b40-bb3c-baa5e329cf6d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:33:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:33:25 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4029dd01-8a34-4839-9bbc-0b11066ba1a3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:33:25 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a352cb42-fda1-420f-ac30-abbe02eff0d5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:33:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Running cmd (subprocess): nvme version {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] 'nvme version' failed. Not Retrying. {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:33:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] nvme not present on system {{(pid=71229) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 15:33:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:33:25 user nova-compute[71229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 15:33:25 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b243ed8-7330-456b-bd80-929c2082090a]: (4, '') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:33:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71229) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 15:33:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 15:33:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] LIGHTOS: no hostnqn found. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 15:33:25 user nova-compute[71229]: DEBUG os_brick.utils [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d55e24a97c90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:33:25 user nova-compute[71229]: DEBUG nova.virt.block_device [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Updating existing volume attachment record: 8f242ae7-3e5e-41e7-977c-9843c6068112 {{(pid=71229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 15:33:25 user nova-compute[71229]: DEBUG nova.network.neutron [req-a7b7e238-891a-4656-84d7-d456122b8936 req-caa5c11a-1497-49d8-b4d7-98e9cda967f6 service nova] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Updated VIF entry in instance network info cache for port c6826c01-eadd-49db-a842-accd25f7534a. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:33:25 user nova-compute[71229]: DEBUG nova.network.neutron [req-a7b7e238-891a-4656-84d7-d456122b8936 req-caa5c11a-1497-49d8-b4d7-98e9cda967f6 service nova] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Updating instance_info_cache with network_info: [{"id": "c6826c01-eadd-49db-a842-accd25f7534a", "address": "fa:16:3e:0d:20:92", "network": {"id": "8dd93667-4f8b-4d89-b7be-056f5f39bffe", "bridge": "br-int", "label": "tempest-TestStampPattern-1555823894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0f7abe5e3144c7ab354ffaba1748616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6826c01-ea", "ovs_interfaceid": "c6826c01-eadd-49db-a842-accd25f7534a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:33:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a7b7e238-891a-4656-84d7-d456122b8936 req-caa5c11a-1497-49d8-b4d7-98e9cda967f6 service nova] Releasing lock "refresh_cache-85658a44-9ff2-4553-b9fd-686bf35fd6ec" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:33:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5975605f-731a-43b1-8fef-2c0b05624d1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LBvXDnxd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:33:29 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:33:29 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:33:29 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:33:29 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5975605f-731a-43b1-8fef-2c0b05624d1a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5975605f-731a-43b1-8fef-2c0b05624d1a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:33:29 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 15:33:29 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5975605f-731a-43b1-8fef-2c0b05624d1a -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5975605f-731a-43b1-8fef-2c0b05624d1a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[569d32f9-1545-4bc1-a872-5fde1132e122]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 15:33:29 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5975605f-731a-43b1-8fef-2c0b05624d1a -p 172.16.0.220:3260 --interface default --op new {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5975605f-731a-43b1-8fef-2c0b05624d1a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b197ae-971a-4841-8cfc-ab2e54f37cd5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5975605f-731a-43b1-8fef-2c0b05624d1a] added\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5975605f-731a-43b1-8fef-2c0b05624d1a] added
Apr 11 15:33:29 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5975605f-731a-43b1-8fef-2c0b05624d1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5975605f-731a-43b1-8fef-2c0b05624d1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6293fd0-a280-4a07-8aae-08775d0cdf10]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5975605f-731a-43b1-8fef-2c0b05624d1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5975605f-731a-43b1-8fef-2c0b05624d1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea63ea3-e744-4e58-9fc0-e249c27dee01]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5975605f-731a-43b1-8fef-2c0b05624d1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LBvXDnxd {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5975605f-731a-43b1-8fef-2c0b05624d1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LBvXDnxd" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[762c8a05-58ec-4947-bdad-3a0d5d539126]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LBvXDnxd'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5975605f-731a-43b1-8fef-2c0b05624d1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5975605f-731a-43b1-8fef-2c0b05624d1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c069c1e4-0064-433a-898f-f47a7300b945]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de391b4-92a0-4707-8544-fc46fd27e92a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:33:29 user nova-compute[71229]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:33:29 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:33:29 user nova-compute[71229]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 (non-flash)
Apr 11 15:33:29 user nova-compute[71229]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452 (non-flash)
Apr 11 15:33:29 user nova-compute[71229]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e (non-flash)
Apr 11 15:33:29 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:33:29 user nova-compute[71229]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:33:29 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:33:29 user nova-compute[71229]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 (non-flash)
Apr 11 15:33:29 user nova-compute[71229]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452 (non-flash)
Apr 11 15:33:29 user nova-compute[71229]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e (non-flash)
Apr 11 15:33:29 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5975605f-731a-43b1-8fef-2c0b05624d1a -p 172.16.0.220:3260 --login {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5975605f-731a-43b1-8fef-2c0b05624d1a -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e39035-69af-4fe1-850c-1ff026c28348]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5975605f-731a-43b1-8fef-2c0b05624d1a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5975605f-731a-43b1-8fef-2c0b05624d1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5975605f-731a-43b1-8fef-2c0b05624d1a, portal: 172.16.0.220,3260]
Apr 11 15:33:29 user nova-compute[71229]: Login to [iface: default, target: iqn.2010-10.org.openstack:5975605f-731a-43b1-8fef-2c0b05624d1a, portal: 172.16.0.220,3260] successful.
Apr 11 15:33:29 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5975605f-731a-43b1-8fef-2c0b05624d1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5975605f-731a-43b1-8fef-2c0b05624d1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a281e69-918e-4a6c-92d3-bf70ae140fa4]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44f9b8c-ad8f-4c01-a6aa-3b153b34db72]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5975605f-731a-43b1-8fef-2c0b05624d1a (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:33:29 user nova-compute[71229]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:33:29 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:33:29 user nova-compute[71229]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 (non-flash)
Apr 11 15:33:29 user nova-compute[71229]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452 (non-flash)
Apr 11 15:33:29 user nova-compute[71229]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e (non-flash)
Apr 11 15:33:29 user nova-compute[71229]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5975605f-731a-43b1-8fef-2c0b05624d1a (non-flash)
Apr 11 15:33:29 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:33:29 user nova-compute[71229]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:33:29 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:33:29 user nova-compute[71229]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 (non-flash)
Apr 11 15:33:29 user nova-compute[71229]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452 (non-flash)
Apr 11 15:33:29 user nova-compute[71229]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e (non-flash)
Apr 11 15:33:29 user nova-compute[71229]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5975605f-731a-43b1-8fef-2c0b05624d1a (non-flash)
Apr 11 15:33:29 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5975605f-731a-43b1-8fef-2c0b05624d1a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] HCTL ('39', '-', '-', 0) found on session 31 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[589123b6-9dfa-457d-8fc5-faded784c57d]: (4, ('- - 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Searching for a device in session 31 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:33:29 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:5975605f-731a-43b1-8fef-2c0b05624d1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LBvXDnxd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 15:33:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:33:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23132333139663136', 'path': '/dev/sdh'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:33:30 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132333139663136', 'path': '/dev/sdh'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 15:33:30 user nova-compute[71229]: DEBUG nova.objects.instance [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lazy-loading 'flavor' on Instance uuid 85658a44-9ff2-4553-b9fd-686bf35fd6ec {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:33:30 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 15:33:30 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:33:30 user nova-compute[71229]:   <source dev="/dev/sdh"/>
Apr 11 15:33:30 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 15:33:30 user nova-compute[71229]:   <serial>5975605f-731a-43b1-8fef-2c0b05624d1a</serial>
Apr 11 15:33:30 user nova-compute[71229]: </disk>
Apr 11 15:33:30 user nova-compute[71229]:  {{(pid=71229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 15:33:31 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:33:31 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:33:31 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] No VIF found with MAC fa:16:3e:0d:20:92, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:33:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-32935986-90d7-43d3-8f38-8a87b3926f50 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "85658a44-9ff2-4553-b9fd-686bf35fd6ec" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.246s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:33:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-34cc8898-56bd-44e9-bc64-148a4f29054c tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "85658a44-9ff2-4553-b9fd-686bf35fd6ec" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:33:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-34cc8898-56bd-44e9-bc64-148a4f29054c tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "85658a44-9ff2-4553-b9fd-686bf35fd6ec" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:33:32 user nova-compute[71229]: INFO nova.compute.manager [None req-34cc8898-56bd-44e9-bc64-148a4f29054c tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Detaching volume 5975605f-731a-43b1-8fef-2c0b05624d1a
Apr 11 15:33:32 user nova-compute[71229]: INFO nova.virt.block_device [None req-34cc8898-56bd-44e9-bc64-148a4f29054c tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Attempting to driver detach volume 5975605f-731a-43b1-8fef-2c0b05624d1a from mountpoint /dev/vdb
Apr 11 15:33:32 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-34cc8898-56bd-44e9-bc64-148a4f29054c tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Attempting to detach device vdb from instance 85658a44-9ff2-4553-b9fd-686bf35fd6ec from the persistent domain config. {{(pid=71229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 15:33:32 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-34cc8898-56bd-44e9-bc64-148a4f29054c tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 15:33:32 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:33:32 user nova-compute[71229]:   <source dev="/dev/sdh"/>
Apr 11 15:33:32 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 15:33:32 user nova-compute[71229]:   <serial>5975605f-731a-43b1-8fef-2c0b05624d1a</serial>
Apr 11 15:33:32 user nova-compute[71229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 15:33:32 user nova-compute[71229]: </disk>
Apr 11 15:33:32 user nova-compute[71229]:  {{(pid=71229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 15:33:32 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-34cc8898-56bd-44e9-bc64-148a4f29054c tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Successfully detached device vdb from instance 85658a44-9ff2-4553-b9fd-686bf35fd6ec from the persistent domain config.
Apr 11 15:33:32 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-34cc8898-56bd-44e9-bc64-148a4f29054c tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 85658a44-9ff2-4553-b9fd-686bf35fd6ec from the live domain config. {{(pid=71229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 15:33:32 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-34cc8898-56bd-44e9-bc64-148a4f29054c tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 15:33:32 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:33:32 user nova-compute[71229]:   <source dev="/dev/sdh"/>
Apr 11 15:33:32 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 15:33:32 user nova-compute[71229]:   <serial>5975605f-731a-43b1-8fef-2c0b05624d1a</serial>
Apr 11 15:33:32 user nova-compute[71229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 15:33:32 user nova-compute[71229]: </disk>
Apr 11 15:33:32 user nova-compute[71229]:  {{(pid=71229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Received event <DeviceRemovedEvent: 1681227213.295247, 85658a44-9ff2-4553-b9fd-686bf35fd6ec => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71229) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-34cc8898-56bd-44e9-bc64-148a4f29054c tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 85658a44-9ff2-4553-b9fd-686bf35fd6ec {{(pid=71229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 15:33:33 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-34cc8898-56bd-44e9-bc64-148a4f29054c tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Successfully detached device vdb from instance 85658a44-9ff2-4553-b9fd-686bf35fd6ec from the live domain config.
Apr 11 15:33:33 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34cc8898-56bd-44e9-bc64-148a4f29054c tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cc8898-56bd-44e9-bc64-148a4f29054c tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:5975605f-731a-43b1-8fef-2c0b05624d1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LBvXDnxd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:33:33 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-34cc8898-56bd-44e9-bc64-148a4f29054c tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:33:33 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-34cc8898-56bd-44e9-bc64-148a4f29054c tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-34cc8898-56bd-44e9-bc64-148a4f29054c tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ecdcbf4-e9e3-4dc3-bd4a-4a705635fe30]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5975605f-731a-43b1-8fef-2c0b05624d1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cc8898-56bd-44e9-bc64-148a4f29054c tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 15:33:33 user nova-compute[71229]: No targets found.
Apr 11 15:33:33 user nova-compute[71229]: iSNS:
Apr 11 15:33:33 user nova-compute[71229]: No targets found.
Apr 11 15:33:33 user nova-compute[71229]: STATIC:
Apr 11 15:33:33 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb
Apr 11 15:33:33 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:33:33 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:33:33 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2
Apr 11 15:33:33 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:33:33 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:33:33 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452
Apr 11 15:33:33 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:33:33 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:33:33 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532
Apr 11 15:33:33 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:33:33 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:33:33 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4
Apr 11 15:33:33 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:33:33 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:33:33 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e
Apr 11 15:33:33 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:33:33 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:33:33 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:5975605f-731a-43b1-8fef-2c0b05624d1a
Apr 11 15:33:33 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:33:33 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:33:33 user nova-compute[71229]: FIRMWARE:
Apr 11 15:33:33 user nova-compute[71229]: No targets found.
Apr 11 15:33:33 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cc8898-56bd-44e9-bc64-148a4f29054c tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 15:33:33 user nova-compute[71229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 15:33:33 user nova-compute[71229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71229) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cc8898-56bd-44e9-bc64-148a4f29054c tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5975605f-731a-43b1-8fef-2c0b05624d1a', 0)] {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[adabf98a-884b-44f0-8ba0-8719ddaaeb61]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5975605f-731a-43b1-8fef-2c0b05624d1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d806ae6e-1892-4480-b8d9-df62fb78687f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5975605f-731a-43b1-8fef-2c0b05624d1a (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cc8898-56bd-44e9-bc64-148a4f29054c tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:33:33 user nova-compute[71229]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:33:33 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:33:33 user nova-compute[71229]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 (non-flash)
Apr 11 15:33:33 user nova-compute[71229]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452 (non-flash)
Apr 11 15:33:33 user nova-compute[71229]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e (non-flash)
Apr 11 15:33:33 user nova-compute[71229]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5975605f-731a-43b1-8fef-2c0b05624d1a (non-flash)
Apr 11 15:33:33 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cc8898-56bd-44e9-bc64-148a4f29054c tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:33:33 user nova-compute[71229]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:33:33 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:33:33 user nova-compute[71229]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 (non-flash)
Apr 11 15:33:33 user nova-compute[71229]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452 (non-flash)
Apr 11 15:33:33 user nova-compute[71229]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e (non-flash)
Apr 11 15:33:33 user nova-compute[71229]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5975605f-731a-43b1-8fef-2c0b05624d1a (non-flash)
Apr 11 15:33:33 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cc8898-56bd-44e9-bc64-148a4f29054c tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb641bc0d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5975605f-731a-43b1-8fef-2c0b05624d1a'): ({'sdh'}, set())}) {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-34cc8898-56bd-44e9-bc64-148a4f29054c tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Removing single pathed devices sdh {{(pid=71229) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61be63d-ac7b-4dc2-afab-056908e71b92]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de38dc3-0add-40cc-9813-d21c89800a7a]: (4, ('ok\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-34cc8898-56bd-44e9-bc64-148a4f29054c tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Flushing IO for device /dev/sdh {{(pid=71229) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d1449d-5e31-49ca-b7a4-ed45049ea8b3]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-34cc8898-56bd-44e9-bc64-148a4f29054c tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71229) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.035s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c766ac4b-24f6-40c0-a058-d792d8890f0d]: (4, ('1', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-34cc8898-56bd-44e9-bc64-148a4f29054c tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-34cc8898-56bd-44e9-bc64-148a4f29054c tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] SCSI volumes sdh have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cc8898-56bd-44e9-bc64-148a4f29054c tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5975605f-731a-43b1-8fef-2c0b05624d1a')] {{(pid=71229) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5975605f-731a-43b1-8fef-2c0b05624d1a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5975605f-731a-43b1-8fef-2c0b05624d1a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd60f025-f7b4-4f11-b013-64b7395b3318]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cc8898-56bd-44e9-bc64-148a4f29054c tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5975605f-731a-43b1-8fef-2c0b05624d1a -p 172.16.0.220:3260 --logout {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5975605f-731a-43b1-8fef-2c0b05624d1a -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[86af9ebf-7614-4b8a-9667-1f0462a3bb7e]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:5975605f-731a-43b1-8fef-2c0b05624d1a, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:5975605f-731a-43b1-8fef-2c0b05624d1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cc8898-56bd-44e9-bc64-148a4f29054c tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:5975605f-731a-43b1-8fef-2c0b05624d1a, portal: 172.16.0.220,3260]
Apr 11 15:33:33 user nova-compute[71229]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:5975605f-731a-43b1-8fef-2c0b05624d1a, portal: 172.16.0.220,3260] successful.
Apr 11 15:33:33 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5975605f-731a-43b1-8fef-2c0b05624d1a -p 172.16.0.220:3260 --op delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5975605f-731a-43b1-8fef-2c0b05624d1a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee974365-49f0-49a0-8a95-3e5ecc7792f7]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cc8898-56bd-44e9-bc64-148a4f29054c tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-34cc8898-56bd-44e9-bc64-148a4f29054c tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cc8898-56bd-44e9-bc64-148a4f29054c tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] <== disconnect_volume: return (316ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34cc8898-56bd-44e9-bc64-148a4f29054c tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 15:33:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:34 user nova-compute[71229]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681227199.2782812, ffc25fc1-e59f-42c8-a371-b4b12e17fd59 => Stopped> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:33:34 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] VM Stopped (Lifecycle Event)
Apr 11 15:33:34 user nova-compute[71229]: DEBUG nova.compute.manager [None req-68653452-d068-4bfd-8980-0bab1c27b43d None None] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:33:34 user nova-compute[71229]: DEBUG nova.objects.instance [None req-34cc8898-56bd-44e9-bc64-148a4f29054c tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lazy-loading 'flavor' on Instance uuid 85658a44-9ff2-4553-b9fd-686bf35fd6ec {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:33:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-34cc8898-56bd-44e9-bc64-148a4f29054c tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "85658a44-9ff2-4553-b9fd-686bf35fd6ec" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.667s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:33:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-297d73ad-9598-4d85-82b6-39b86524752e tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Acquiring lock "e4555892-7abb-4a3c-a4ae-a27ad4902708" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:33:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-297d73ad-9598-4d85-82b6-39b86524752e tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "e4555892-7abb-4a3c-a4ae-a27ad4902708" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:33:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-297d73ad-9598-4d85-82b6-39b86524752e tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Acquiring lock "e4555892-7abb-4a3c-a4ae-a27ad4902708-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:33:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-297d73ad-9598-4d85-82b6-39b86524752e tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "e4555892-7abb-4a3c-a4ae-a27ad4902708-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:33:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-297d73ad-9598-4d85-82b6-39b86524752e tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "e4555892-7abb-4a3c-a4ae-a27ad4902708-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:33:40 user nova-compute[71229]: INFO nova.compute.manager [None req-297d73ad-9598-4d85-82b6-39b86524752e tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Terminating instance
Apr 11 15:33:40 user nova-compute[71229]: DEBUG nova.compute.manager [None req-297d73ad-9598-4d85-82b6-39b86524752e tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Start destroying the instance on the hypervisor. {{(pid=71229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 15:33:40 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:40 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:40 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:40 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:40 user nova-compute[71229]: DEBUG nova.compute.manager [req-c05dbe1a-0864-4030-9f40-1b9d87e4b05c req-f84807f8-4eb6-4cba-9baf-1799aea9829b service nova] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Received event network-vif-unplugged-a002e821-ea54-4d5c-b25c-8c517fab4e92 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:33:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c05dbe1a-0864-4030-9f40-1b9d87e4b05c req-f84807f8-4eb6-4cba-9baf-1799aea9829b service nova] Acquiring lock "e4555892-7abb-4a3c-a4ae-a27ad4902708-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:33:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c05dbe1a-0864-4030-9f40-1b9d87e4b05c req-f84807f8-4eb6-4cba-9baf-1799aea9829b service nova] Lock "e4555892-7abb-4a3c-a4ae-a27ad4902708-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:33:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c05dbe1a-0864-4030-9f40-1b9d87e4b05c req-f84807f8-4eb6-4cba-9baf-1799aea9829b service nova] Lock "e4555892-7abb-4a3c-a4ae-a27ad4902708-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:33:40 user nova-compute[71229]: DEBUG nova.compute.manager [req-c05dbe1a-0864-4030-9f40-1b9d87e4b05c req-f84807f8-4eb6-4cba-9baf-1799aea9829b service nova] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] No waiting events found dispatching network-vif-unplugged-a002e821-ea54-4d5c-b25c-8c517fab4e92 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:33:40 user nova-compute[71229]: DEBUG nova.compute.manager [req-c05dbe1a-0864-4030-9f40-1b9d87e4b05c req-f84807f8-4eb6-4cba-9baf-1799aea9829b service nova] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Received event network-vif-unplugged-a002e821-ea54-4d5c-b25c-8c517fab4e92 for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 15:33:40 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Instance destroyed successfully.
Apr 11 15:33:40 user nova-compute[71229]: DEBUG nova.objects.instance [None req-297d73ad-9598-4d85-82b6-39b86524752e tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lazy-loading 'resources' on Instance uuid e4555892-7abb-4a3c-a4ae-a27ad4902708 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:33:40 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-297d73ad-9598-4d85-82b6-39b86524752e tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:25:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-704141251',display_name='tempest-ServersNegativeTestJSON-server-704141251',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-704141251',id=15,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:25:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='561130d089c8415297697bcedc93aefc',ramdisk_id='',reservation_id='r-rf6vqksg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1004375615',owner_user_name='tempest-ServersNegativeTestJSON-1004375615-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:25:09Z,user_data=None,user_id='b2538af5c739404aa433b766976e5b2d',uuid=e4555892-7abb-4a3c-a4ae-a27ad4902708,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a002e821-ea54-4d5c-b25c-8c517fab4e92", "address": "fa:16:3e:49:8a:71", "network": {"id": "f9b1d398-27cb-42de-9d95-0e031b1bd6ec", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1833751152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "561130d089c8415297697bcedc93aefc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa002e821-ea", "ovs_interfaceid": "a002e821-ea54-4d5c-b25c-8c517fab4e92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:33:40 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-297d73ad-9598-4d85-82b6-39b86524752e tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Converting VIF {"id": "a002e821-ea54-4d5c-b25c-8c517fab4e92", "address": "fa:16:3e:49:8a:71", "network": {"id": "f9b1d398-27cb-42de-9d95-0e031b1bd6ec", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1833751152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "561130d089c8415297697bcedc93aefc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa002e821-ea", "ovs_interfaceid": "a002e821-ea54-4d5c-b25c-8c517fab4e92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:33:40 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-297d73ad-9598-4d85-82b6-39b86524752e tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:8a:71,bridge_name='br-int',has_traffic_filtering=True,id=a002e821-ea54-4d5c-b25c-8c517fab4e92,network=Network(f9b1d398-27cb-42de-9d95-0e031b1bd6ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa002e821-ea') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:33:40 user nova-compute[71229]: DEBUG os_vif [None req-297d73ad-9598-4d85-82b6-39b86524752e tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:8a:71,bridge_name='br-int',has_traffic_filtering=True,id=a002e821-ea54-4d5c-b25c-8c517fab4e92,network=Network(f9b1d398-27cb-42de-9d95-0e031b1bd6ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa002e821-ea') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:33:40 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:40 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa002e821-ea, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:33:40 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:33:41 user nova-compute[71229]: INFO os_vif [None req-297d73ad-9598-4d85-82b6-39b86524752e tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:8a:71,bridge_name='br-int',has_traffic_filtering=True,id=a002e821-ea54-4d5c-b25c-8c517fab4e92,network=Network(f9b1d398-27cb-42de-9d95-0e031b1bd6ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa002e821-ea')
Apr 11 15:33:41 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-297d73ad-9598-4d85-82b6-39b86524752e tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Deleting instance files /opt/stack/data/nova/instances/e4555892-7abb-4a3c-a4ae-a27ad4902708_del
Apr 11 15:33:41 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-297d73ad-9598-4d85-82b6-39b86524752e tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Deletion of /opt/stack/data/nova/instances/e4555892-7abb-4a3c-a4ae-a27ad4902708_del complete
Apr 11 15:33:41 user nova-compute[71229]: INFO nova.compute.manager [None req-297d73ad-9598-4d85-82b6-39b86524752e tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Took 0.67 seconds to destroy the instance on the hypervisor.
Apr 11 15:33:41 user nova-compute[71229]: DEBUG oslo.service.loopingcall [None req-297d73ad-9598-4d85-82b6-39b86524752e tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71229) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 15:33:41 user nova-compute[71229]: DEBUG nova.compute.manager [-] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Deallocating network for instance {{(pid=71229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 15:33:41 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] deallocate_for_instance() {{(pid=71229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 15:33:41 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:33:41 user nova-compute[71229]: DEBUG nova.compute.manager [req-143f5844-dac1-4f4d-b6ed-e657972757a4 req-17d5c960-b8a3-4dbc-b02b-69d5a3477aca service nova] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Received event network-vif-deleted-a002e821-ea54-4d5c-b25c-8c517fab4e92 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:33:41 user nova-compute[71229]: INFO nova.compute.manager [req-143f5844-dac1-4f4d-b6ed-e657972757a4 req-17d5c960-b8a3-4dbc-b02b-69d5a3477aca service nova] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Neutron deleted interface a002e821-ea54-4d5c-b25c-8c517fab4e92; detaching it from the instance and deleting it from the info cache
Apr 11 15:33:41 user nova-compute[71229]: DEBUG nova.network.neutron [req-143f5844-dac1-4f4d-b6ed-e657972757a4 req-17d5c960-b8a3-4dbc-b02b-69d5a3477aca service nova] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:33:41 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Took 0.55 seconds to deallocate network for instance.
Apr 11 15:33:41 user nova-compute[71229]: DEBUG nova.compute.manager [req-143f5844-dac1-4f4d-b6ed-e657972757a4 req-17d5c960-b8a3-4dbc-b02b-69d5a3477aca service nova] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Detach interface failed, port_id=a002e821-ea54-4d5c-b25c-8c517fab4e92, reason: Instance e4555892-7abb-4a3c-a4ae-a27ad4902708 could not be found. {{(pid=71229) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 15:33:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-297d73ad-9598-4d85-82b6-39b86524752e tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:33:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-297d73ad-9598-4d85-82b6-39b86524752e tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:33:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:41 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-297d73ad-9598-4d85-82b6-39b86524752e tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:33:41 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-297d73ad-9598-4d85-82b6-39b86524752e tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:33:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-297d73ad-9598-4d85-82b6-39b86524752e tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.309s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:33:42 user nova-compute[71229]: INFO nova.scheduler.client.report [None req-297d73ad-9598-4d85-82b6-39b86524752e tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Deleted allocations for instance e4555892-7abb-4a3c-a4ae-a27ad4902708
Apr 11 15:33:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-297d73ad-9598-4d85-82b6-39b86524752e tempest-ServersNegativeTestJSON-1004375615 tempest-ServersNegativeTestJSON-1004375615-project-member] Lock "e4555892-7abb-4a3c-a4ae-a27ad4902708" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.725s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:33:42 user nova-compute[71229]: DEBUG nova.compute.manager [req-a7415769-9f44-442f-ad26-71b21a691d3d req-c4553d3f-6ec7-4352-8c18-1b1471a44bd9 service nova] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Received event network-vif-plugged-a002e821-ea54-4d5c-b25c-8c517fab4e92 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:33:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a7415769-9f44-442f-ad26-71b21a691d3d req-c4553d3f-6ec7-4352-8c18-1b1471a44bd9 service nova] Acquiring lock "e4555892-7abb-4a3c-a4ae-a27ad4902708-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:33:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a7415769-9f44-442f-ad26-71b21a691d3d req-c4553d3f-6ec7-4352-8c18-1b1471a44bd9 service nova] Lock "e4555892-7abb-4a3c-a4ae-a27ad4902708-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:33:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a7415769-9f44-442f-ad26-71b21a691d3d req-c4553d3f-6ec7-4352-8c18-1b1471a44bd9 service nova] Lock "e4555892-7abb-4a3c-a4ae-a27ad4902708-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:33:42 user nova-compute[71229]: DEBUG nova.compute.manager [req-a7415769-9f44-442f-ad26-71b21a691d3d req-c4553d3f-6ec7-4352-8c18-1b1471a44bd9 service nova] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] No waiting events found dispatching network-vif-plugged-a002e821-ea54-4d5c-b25c-8c517fab4e92 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:33:42 user nova-compute[71229]: WARNING nova.compute.manager [req-a7415769-9f44-442f-ad26-71b21a691d3d req-c4553d3f-6ec7-4352-8c18-1b1471a44bd9 service nova] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Received unexpected event network-vif-plugged-a002e821-ea54-4d5c-b25c-8c517fab4e92 for instance with vm_state deleted and task_state None.
Apr 11 15:33:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:47 user nova-compute[71229]: DEBUG nova.compute.manager [req-f906bb88-25b2-4b10-8f14-feee6f1a8a98 req-e2470765-bf85-4410-abab-68e806d2bc4c service nova] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Received event network-changed-05f23fee-4450-48d6-8b2f-6c1fcf308da6 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:33:47 user nova-compute[71229]: DEBUG nova.compute.manager [req-f906bb88-25b2-4b10-8f14-feee6f1a8a98 req-e2470765-bf85-4410-abab-68e806d2bc4c service nova] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Refreshing instance network info cache due to event network-changed-05f23fee-4450-48d6-8b2f-6c1fcf308da6. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:33:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-f906bb88-25b2-4b10-8f14-feee6f1a8a98 req-e2470765-bf85-4410-abab-68e806d2bc4c service nova] Acquiring lock "refresh_cache-d534d17d-ba77-4447-8a63-7d6021ad7896" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:33:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-f906bb88-25b2-4b10-8f14-feee6f1a8a98 req-e2470765-bf85-4410-abab-68e806d2bc4c service nova] Acquired lock "refresh_cache-d534d17d-ba77-4447-8a63-7d6021ad7896" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:33:47 user nova-compute[71229]: DEBUG nova.network.neutron [req-f906bb88-25b2-4b10-8f14-feee6f1a8a98 req-e2470765-bf85-4410-abab-68e806d2bc4c service nova] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Refreshing network info cache for port 05f23fee-4450-48d6-8b2f-6c1fcf308da6 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:33:48 user nova-compute[71229]: DEBUG nova.network.neutron [req-f906bb88-25b2-4b10-8f14-feee6f1a8a98 req-e2470765-bf85-4410-abab-68e806d2bc4c service nova] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Updated VIF entry in instance network info cache for port 05f23fee-4450-48d6-8b2f-6c1fcf308da6. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:33:48 user nova-compute[71229]: DEBUG nova.network.neutron [req-f906bb88-25b2-4b10-8f14-feee6f1a8a98 req-e2470765-bf85-4410-abab-68e806d2bc4c service nova] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Updating instance_info_cache with network_info: [{"id": "05f23fee-4450-48d6-8b2f-6c1fcf308da6", "address": "fa:16:3e:61:6a:d2", "network": {"id": "fc99abc0-f7ce-488e-b3d5-926973bb5e6b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2010457639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90bfd48094c54cd5b13dabf27ebdd5dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05f23fee-44", "ovs_interfaceid": "05f23fee-4450-48d6-8b2f-6c1fcf308da6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:33:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-f906bb88-25b2-4b10-8f14-feee6f1a8a98 req-e2470765-bf85-4410-abab-68e806d2bc4c service nova] Releasing lock "refresh_cache-d534d17d-ba77-4447-8a63-7d6021ad7896" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:33:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ab0b4838-f153-4017-b2d5-46d26e4c0a25 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "d534d17d-ba77-4447-8a63-7d6021ad7896" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:33:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ab0b4838-f153-4017-b2d5-46d26e4c0a25 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "d534d17d-ba77-4447-8a63-7d6021ad7896" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:33:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ab0b4838-f153-4017-b2d5-46d26e4c0a25 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "d534d17d-ba77-4447-8a63-7d6021ad7896-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:33:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ab0b4838-f153-4017-b2d5-46d26e4c0a25 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "d534d17d-ba77-4447-8a63-7d6021ad7896-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:33:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ab0b4838-f153-4017-b2d5-46d26e4c0a25 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "d534d17d-ba77-4447-8a63-7d6021ad7896-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:33:49 user nova-compute[71229]: INFO nova.compute.manager [None req-ab0b4838-f153-4017-b2d5-46d26e4c0a25 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Terminating instance
Apr 11 15:33:49 user nova-compute[71229]: DEBUG nova.compute.manager [None req-ab0b4838-f153-4017-b2d5-46d26e4c0a25 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Start destroying the instance on the hypervisor. {{(pid=71229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 15:33:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:49 user nova-compute[71229]: DEBUG nova.compute.manager [req-c9b6b266-61db-4ee7-9d79-4958234b87de req-e357739f-12e3-4a77-a12c-e9d2d63f8ff6 service nova] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Received event network-vif-unplugged-05f23fee-4450-48d6-8b2f-6c1fcf308da6 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:33:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c9b6b266-61db-4ee7-9d79-4958234b87de req-e357739f-12e3-4a77-a12c-e9d2d63f8ff6 service nova] Acquiring lock "d534d17d-ba77-4447-8a63-7d6021ad7896-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:33:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c9b6b266-61db-4ee7-9d79-4958234b87de req-e357739f-12e3-4a77-a12c-e9d2d63f8ff6 service nova] Lock "d534d17d-ba77-4447-8a63-7d6021ad7896-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:33:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c9b6b266-61db-4ee7-9d79-4958234b87de req-e357739f-12e3-4a77-a12c-e9d2d63f8ff6 service nova] Lock "d534d17d-ba77-4447-8a63-7d6021ad7896-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:33:49 user nova-compute[71229]: DEBUG nova.compute.manager [req-c9b6b266-61db-4ee7-9d79-4958234b87de req-e357739f-12e3-4a77-a12c-e9d2d63f8ff6 service nova] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] No waiting events found dispatching network-vif-unplugged-05f23fee-4450-48d6-8b2f-6c1fcf308da6 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:33:49 user nova-compute[71229]: DEBUG nova.compute.manager [req-c9b6b266-61db-4ee7-9d79-4958234b87de req-e357739f-12e3-4a77-a12c-e9d2d63f8ff6 service nova] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Received event network-vif-unplugged-05f23fee-4450-48d6-8b2f-6c1fcf308da6 for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 15:33:49 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Instance destroyed successfully.
Apr 11 15:33:49 user nova-compute[71229]: DEBUG nova.objects.instance [None req-ab0b4838-f153-4017-b2d5-46d26e4c0a25 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lazy-loading 'resources' on Instance uuid d534d17d-ba77-4447-8a63-7d6021ad7896 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:33:49 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-ab0b4838-f153-4017-b2d5-46d26e4c0a25 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:27:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1036280409',display_name='tempest-SnapshotDataIntegrityTests-server-1036280409',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1036280409',id=18,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEsY8FMpTDo2iDL8D2048rjTj/VI+ylGYuKoz69HdKNUW8YbpOt3axid+tNJOYBWww9OiD0Ac5LQl/2OtP+ihiza/khI/3Fa6GADgrvtJLGlEyRQIArtEl+HOseWnLoJKA==',key_name='tempest-SnapshotDataIntegrityTests-465777949',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:27:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='90bfd48094c54cd5b13dabf27ebdd5dd',ramdisk_id='',reservation_id='r-go1a1mo9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1684503145',owner_user_name='tempest-SnapshotDataIntegrityTests-1684503145-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:27:49Z,user_data=None,user_id='091ece3baa634583a7cc3000c78f2c26',uuid=d534d17d-ba77-4447-8a63-7d6021ad7896,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05f23fee-4450-48d6-8b2f-6c1fcf308da6", "address": "fa:16:3e:61:6a:d2", "network": {"id": "fc99abc0-f7ce-488e-b3d5-926973bb5e6b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2010457639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90bfd48094c54cd5b13dabf27ebdd5dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05f23fee-44", "ovs_interfaceid": "05f23fee-4450-48d6-8b2f-6c1fcf308da6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:33:49 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-ab0b4838-f153-4017-b2d5-46d26e4c0a25 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Converting VIF {"id": "05f23fee-4450-48d6-8b2f-6c1fcf308da6", "address": "fa:16:3e:61:6a:d2", "network": {"id": "fc99abc0-f7ce-488e-b3d5-926973bb5e6b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2010457639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90bfd48094c54cd5b13dabf27ebdd5dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05f23fee-44", "ovs_interfaceid": "05f23fee-4450-48d6-8b2f-6c1fcf308da6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:33:49 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-ab0b4838-f153-4017-b2d5-46d26e4c0a25 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:6a:d2,bridge_name='br-int',has_traffic_filtering=True,id=05f23fee-4450-48d6-8b2f-6c1fcf308da6,network=Network(fc99abc0-f7ce-488e-b3d5-926973bb5e6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05f23fee-44') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:33:49 user nova-compute[71229]: DEBUG os_vif [None req-ab0b4838-f153-4017-b2d5-46d26e4c0a25 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:6a:d2,bridge_name='br-int',has_traffic_filtering=True,id=05f23fee-4450-48d6-8b2f-6c1fcf308da6,network=Network(fc99abc0-f7ce-488e-b3d5-926973bb5e6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05f23fee-44') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:33:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap05f23fee-44, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:33:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:33:49 user nova-compute[71229]: INFO os_vif [None req-ab0b4838-f153-4017-b2d5-46d26e4c0a25 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:6a:d2,bridge_name='br-int',has_traffic_filtering=True,id=05f23fee-4450-48d6-8b2f-6c1fcf308da6,network=Network(fc99abc0-f7ce-488e-b3d5-926973bb5e6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05f23fee-44')
Apr 11 15:33:49 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-ab0b4838-f153-4017-b2d5-46d26e4c0a25 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Deleting instance files /opt/stack/data/nova/instances/d534d17d-ba77-4447-8a63-7d6021ad7896_del
Apr 11 15:33:49 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-ab0b4838-f153-4017-b2d5-46d26e4c0a25 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Deletion of /opt/stack/data/nova/instances/d534d17d-ba77-4447-8a63-7d6021ad7896_del complete
Apr 11 15:33:49 user nova-compute[71229]: INFO nova.compute.manager [None req-ab0b4838-f153-4017-b2d5-46d26e4c0a25 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 11 15:33:49 user nova-compute[71229]: DEBUG oslo.service.loopingcall [None req-ab0b4838-f153-4017-b2d5-46d26e4c0a25 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71229) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 15:33:49 user nova-compute[71229]: DEBUG nova.compute.manager [-] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Deallocating network for instance {{(pid=71229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 15:33:49 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] deallocate_for_instance() {{(pid=71229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 15:33:50 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:33:50 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Took 0.46 seconds to deallocate network for instance.
Apr 11 15:33:50 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ab0b4838-f153-4017-b2d5-46d26e4c0a25 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:33:50 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ab0b4838-f153-4017-b2d5-46d26e4c0a25 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:33:50 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-ab0b4838-f153-4017-b2d5-46d26e4c0a25 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:33:50 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-ab0b4838-f153-4017-b2d5-46d26e4c0a25 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:33:50 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ab0b4838-f153-4017-b2d5-46d26e4c0a25 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.253s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:33:50 user nova-compute[71229]: INFO nova.scheduler.client.report [None req-ab0b4838-f153-4017-b2d5-46d26e4c0a25 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Deleted allocations for instance d534d17d-ba77-4447-8a63-7d6021ad7896
Apr 11 15:33:50 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ab0b4838-f153-4017-b2d5-46d26e4c0a25 tempest-SnapshotDataIntegrityTests-1684503145 tempest-SnapshotDataIntegrityTests-1684503145-project-member] Lock "d534d17d-ba77-4447-8a63-7d6021ad7896" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.747s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:33:51 user nova-compute[71229]: DEBUG nova.compute.manager [req-683a9f17-6699-4604-ba95-926871bf5d78 req-081dc9f0-3e58-4f87-97ae-cff19fd93a07 service nova] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Received event network-vif-plugged-05f23fee-4450-48d6-8b2f-6c1fcf308da6 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:33:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-683a9f17-6699-4604-ba95-926871bf5d78 req-081dc9f0-3e58-4f87-97ae-cff19fd93a07 service nova] Acquiring lock "d534d17d-ba77-4447-8a63-7d6021ad7896-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:33:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-683a9f17-6699-4604-ba95-926871bf5d78 req-081dc9f0-3e58-4f87-97ae-cff19fd93a07 service nova] Lock "d534d17d-ba77-4447-8a63-7d6021ad7896-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:33:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-683a9f17-6699-4604-ba95-926871bf5d78 req-081dc9f0-3e58-4f87-97ae-cff19fd93a07 service nova] Lock "d534d17d-ba77-4447-8a63-7d6021ad7896-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:33:51 user nova-compute[71229]: DEBUG nova.compute.manager [req-683a9f17-6699-4604-ba95-926871bf5d78 req-081dc9f0-3e58-4f87-97ae-cff19fd93a07 service nova] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] No waiting events found dispatching network-vif-plugged-05f23fee-4450-48d6-8b2f-6c1fcf308da6 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:33:51 user nova-compute[71229]: WARNING nova.compute.manager [req-683a9f17-6699-4604-ba95-926871bf5d78 req-081dc9f0-3e58-4f87-97ae-cff19fd93a07 service nova] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Received unexpected event network-vif-plugged-05f23fee-4450-48d6-8b2f-6c1fcf308da6 for instance with vm_state deleted and task_state None.
Apr 11 15:33:51 user nova-compute[71229]: DEBUG nova.compute.manager [req-683a9f17-6699-4604-ba95-926871bf5d78 req-081dc9f0-3e58-4f87-97ae-cff19fd93a07 service nova] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Received event network-vif-deleted-05f23fee-4450-48d6-8b2f-6c1fcf308da6 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:33:51 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:54 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:55 user nova-compute[71229]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681227220.9657009, e4555892-7abb-4a3c-a4ae-a27ad4902708 => Stopped> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:33:55 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] VM Stopped (Lifecycle Event)
Apr 11 15:33:55 user nova-compute[71229]: DEBUG nova.compute.manager [None req-097d1c14-7ab0-434c-ab6a-44772fdcbf2f None None] [instance: e4555892-7abb-4a3c-a4ae-a27ad4902708] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:33:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:58 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:33:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:33:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:33:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:33:58 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 15:33:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:33:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:33:59 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:33:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:33:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:33:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85658a44-9ff2-4553-b9fd-686bf35fd6ec/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85658a44-9ff2-4553-b9fd-686bf35fd6ec/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:33:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85658a44-9ff2-4553-b9fd-686bf35fd6ec/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85658a44-9ff2-4553-b9fd-686bf35fd6ec/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:33:59 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:33:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:59 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:33:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:33:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:33:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:33:59 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:34:00 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:34:00 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:34:00 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:34:00 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:34:00 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:34:00 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8088MB free_disk=26.110347747802734GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 15:34:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:34:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:34:00 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance de1a45fd-27be-4438-80a4-2f3a100643c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:34:00 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance b0d90fd2-6a95-43c4-8756-e82071d99154 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:34:00 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 7c4329ae-07cb-4f28-9fd6-29b398517d2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:34:00 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 6a805345-374c-4326-9e8f-39bfc7947a35 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:34:00 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 85658a44-9ff2-4553-b9fd-686bf35fd6ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:34:00 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance d09cda86-eca1-4c42-8654-758eb6cd30e0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:34:00 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:34:00 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 15:34:00 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 15:34:00 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:34:00 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:34:00 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 15:34:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.383s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:34:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:02 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:34:02 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:34:02 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:34:02 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:34:02 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:34:02 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:34:02 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 15:34:03 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:34:03 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 15:34:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "refresh_cache-b0d90fd2-6a95-43c4-8756-e82071d99154" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:34:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquired lock "refresh_cache-b0d90fd2-6a95-43c4-8756-e82071d99154" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:34:03 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Forcefully refreshing network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 15:34:04 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Updating instance_info_cache with network_info: [{"id": "4718fa68-0eb9-4592-8c43-981438e3d0b8", "address": "fa:16:3e:e4:28:3b", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4718fa68-0e", "ovs_interfaceid": "4718fa68-0eb9-4592-8c43-981438e3d0b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:34:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Releasing lock "refresh_cache-b0d90fd2-6a95-43c4-8756-e82071d99154" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:34:04 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Updated the network info_cache for instance {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 15:34:04 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:34:04 user nova-compute[71229]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681227229.7831464, d534d17d-ba77-4447-8a63-7d6021ad7896 => Stopped> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:34:04 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] VM Stopped (Lifecycle Event)
Apr 11 15:34:04 user nova-compute[71229]: DEBUG nova.compute.manager [None req-afd64998-88ec-4b7a-8f65-6b66b5d7da19 None None] [instance: d534d17d-ba77-4447-8a63-7d6021ad7896] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:34:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:09 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:34:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 15:34:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 15:34:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 15:34:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:17 user nova-compute[71229]: INFO nova.compute.manager [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Rescuing
Apr 11 15:34:17 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "refresh_cache-d09cda86-eca1-4c42-8654-758eb6cd30e0" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:34:17 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquired lock "refresh_cache-d09cda86-eca1-4c42-8654-758eb6cd30e0" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:34:17 user nova-compute[71229]: DEBUG nova.network.neutron [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:34:17 user nova-compute[71229]: DEBUG nova.network.neutron [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Updating instance_info_cache with network_info: [{"id": "27d62f09-c938-4a71-be1e-6dc1d6a47382", "address": "fa:16:3e:53:ab:3d", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d62f09-c9", "ovs_interfaceid": "27d62f09-c938-4a71-be1e-6dc1d6a47382", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:34:17 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Releasing lock "refresh_cache-d09cda86-eca1-4c42-8654-758eb6cd30e0" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:34:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:18 user nova-compute[71229]: DEBUG nova.compute.manager [req-86a87fdb-675d-4d30-8aa5-0e3a62cdcb2b req-e2d25adb-d495-4cde-a120-451c3addc660 service nova] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Received event network-vif-unplugged-27d62f09-c938-4a71-be1e-6dc1d6a47382 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:34:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-86a87fdb-675d-4d30-8aa5-0e3a62cdcb2b req-e2d25adb-d495-4cde-a120-451c3addc660 service nova] Acquiring lock "d09cda86-eca1-4c42-8654-758eb6cd30e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:34:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-86a87fdb-675d-4d30-8aa5-0e3a62cdcb2b req-e2d25adb-d495-4cde-a120-451c3addc660 service nova] Lock "d09cda86-eca1-4c42-8654-758eb6cd30e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:34:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-86a87fdb-675d-4d30-8aa5-0e3a62cdcb2b req-e2d25adb-d495-4cde-a120-451c3addc660 service nova] Lock "d09cda86-eca1-4c42-8654-758eb6cd30e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:34:18 user nova-compute[71229]: DEBUG nova.compute.manager [req-86a87fdb-675d-4d30-8aa5-0e3a62cdcb2b req-e2d25adb-d495-4cde-a120-451c3addc660 service nova] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] No waiting events found dispatching network-vif-unplugged-27d62f09-c938-4a71-be1e-6dc1d6a47382 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:34:18 user nova-compute[71229]: WARNING nova.compute.manager [req-86a87fdb-675d-4d30-8aa5-0e3a62cdcb2b req-e2d25adb-d495-4cde-a120-451c3addc660 service nova] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Received unexpected event network-vif-unplugged-27d62f09-c938-4a71-be1e-6dc1d6a47382 for instance with vm_state active and task_state rescuing.
Apr 11 15:34:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:18 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Instance destroyed successfully.
Apr 11 15:34:18 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Attempting a stable device rescue
Apr 11 15:34:18 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71229) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 11 15:34:18 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Instance directory exists: not creating {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 15:34:18 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Creating image(s)
Apr 11 15:34:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "/opt/stack/data/nova/instances/d09cda86-eca1-4c42-8654-758eb6cd30e0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:34:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "/opt/stack/data/nova/instances/d09cda86-eca1-4c42-8654-758eb6cd30e0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:34:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "/opt/stack/data/nova/instances/d09cda86-eca1-4c42-8654-758eb6cd30e0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:34:18 user nova-compute[71229]: DEBUG nova.objects.instance [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lazy-loading 'trusted_certs' on Instance uuid d09cda86-eca1-4c42-8654-758eb6cd30e0 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:34:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "2a43d9b15523ef3658db9e91fc56634e204b3f23" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:34:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "2a43d9b15523ef3658db9e91fc56634e204b3f23" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:34:19 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a43d9b15523ef3658db9e91fc56634e204b3f23.part --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:19 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a43d9b15523ef3658db9e91fc56634e204b3f23.part --force-share --output=json" returned: 0 in 0.137s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:19 user nova-compute[71229]: DEBUG nova.virt.images [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] efa37656-35d8-4725-8f33-96c342005b9e was qcow2, converting to raw {{(pid=71229) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 15:34:19 user nova-compute[71229]: DEBUG nova.privsep.utils [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71229) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 15:34:19 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2a43d9b15523ef3658db9e91fc56634e204b3f23.part /opt/stack/data/nova/instances/_base/2a43d9b15523ef3658db9e91fc56634e204b3f23.converted {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:19 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:19 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2a43d9b15523ef3658db9e91fc56634e204b3f23.part /opt/stack/data/nova/instances/_base/2a43d9b15523ef3658db9e91fc56634e204b3f23.converted" returned: 0 in 0.389s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:19 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a43d9b15523ef3658db9e91fc56634e204b3f23.converted --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a43d9b15523ef3658db9e91fc56634e204b3f23.converted --force-share --output=json" returned: 0 in 0.134s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "2a43d9b15523ef3658db9e91fc56634e204b3f23" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.437s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "2a43d9b15523ef3658db9e91fc56634e204b3f23" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "2a43d9b15523ef3658db9e91fc56634e204b3f23" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a43d9b15523ef3658db9e91fc56634e204b3f23 --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG nova.compute.manager [req-f69d19e1-df64-486e-8dc3-d348d746b5ab req-40509b61-cef5-4577-bfea-4999fff40c9d service nova] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Received event network-vif-plugged-27d62f09-c938-4a71-be1e-6dc1d6a47382 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-f69d19e1-df64-486e-8dc3-d348d746b5ab req-40509b61-cef5-4577-bfea-4999fff40c9d service nova] Acquiring lock "d09cda86-eca1-4c42-8654-758eb6cd30e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-f69d19e1-df64-486e-8dc3-d348d746b5ab req-40509b61-cef5-4577-bfea-4999fff40c9d service nova] Lock "d09cda86-eca1-4c42-8654-758eb6cd30e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-f69d19e1-df64-486e-8dc3-d348d746b5ab req-40509b61-cef5-4577-bfea-4999fff40c9d service nova] Lock "d09cda86-eca1-4c42-8654-758eb6cd30e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG nova.compute.manager [req-f69d19e1-df64-486e-8dc3-d348d746b5ab req-40509b61-cef5-4577-bfea-4999fff40c9d service nova] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] No waiting events found dispatching network-vif-plugged-27d62f09-c938-4a71-be1e-6dc1d6a47382 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:34:20 user nova-compute[71229]: WARNING nova.compute.manager [req-f69d19e1-df64-486e-8dc3-d348d746b5ab req-40509b61-cef5-4577-bfea-4999fff40c9d service nova] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Received unexpected event network-vif-plugged-27d62f09-c938-4a71-be1e-6dc1d6a47382 for instance with vm_state active and task_state rescuing.
Apr 11 15:34:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a43d9b15523ef3658db9e91fc56634e204b3f23 --force-share --output=json" returned: 0 in 0.135s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a43d9b15523ef3658db9e91fc56634e204b3f23,backing_fmt=raw /opt/stack/data/nova/instances/d09cda86-eca1-4c42-8654-758eb6cd30e0/disk.rescue {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a43d9b15523ef3658db9e91fc56634e204b3f23,backing_fmt=raw /opt/stack/data/nova/instances/d09cda86-eca1-4c42-8654-758eb6cd30e0/disk.rescue" returned: 0 in 0.049s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "2a43d9b15523ef3658db9e91fc56634e204b3f23" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG nova.objects.instance [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lazy-loading 'migration_context' on Instance uuid d09cda86-eca1-4c42-8654-758eb6cd30e0 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Created local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Start _get_guest_xml network_info=[{"id": "27d62f09-c938-4a71-be1e-6dc1d6a47382", "address": "fa:16:3e:53:ab:3d", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "vif_mac": "fa:16:3e:53:ab:3d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d62f09-c9", "ovs_interfaceid": "27d62f09-c938-4a71-be1e-6dc1d6a47382", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'efa37656-35d8-4725-8f33-96c342005b9e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kDmHLYlZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'd09cda86-eca1-4c42-8654-758eb6cd30e0', 'attached_at': '', 'detached_at': '', 'volume_id': 'd9ef701f-85e1-4a0a-84e9-73468c0792c4', 'serial': 'd9ef701f-85e1-4a0a-84e9-73468c0792c4'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '92c4e9b8-14a3-413a-9e09-06b54b585ceb', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG nova.objects.instance [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lazy-loading 'resources' on Instance uuid d09cda86-eca1-4c42-8654-758eb6cd30e0 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG nova.objects.instance [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lazy-loading 'numa_topology' on Instance uuid d09cda86-eca1-4c42-8654-758eb6cd30e0 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:34:20 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:34:20 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:34:20 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG nova.objects.instance [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lazy-loading 'vcpu_model' on Instance uuid d09cda86-eca1-4c42-8654-758eb6cd30e0 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kDmHLYlZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:34:20 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:34:20 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:34:20 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:34:20 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:34:20 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 15:34:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[035bf8d6-0ab6-4d87-ac39-b8acc376d2b9]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = kDmHLYlZ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 11 15:34:20 user nova-compute[71229]: node.name = iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4
Apr 11 15:34:20 user nova-compute[71229]: node.tpgt = -1
Apr 11 15:34:20 user nova-compute[71229]: node.startup = automatic
Apr 11 15:34:20 user nova-compute[71229]: node.leading_login = No
Apr 11 15:34:20 user nova-compute[71229]: iface.iscsi_ifacename = default
Apr 11 15:34:20 user nova-compute[71229]: iface.net_ifacename = <empty>
Apr 11 15:34:20 user nova-compute[71229]: iface.ipaddress = <empty>
Apr 11 15:34:20 user nova-compute[71229]: iface.prefix_len = 0
Apr 11 15:34:20 user nova-compute[71229]: iface.hwaddress = <empty>
Apr 11 15:34:20 user nova-compute[71229]: iface.transport_name = tcp
Apr 11 15:34:20 user nova-compute[71229]: iface.initiatorname = <empty>
Apr 11 15:34:20 user nova-compute[71229]: iface.state = <empty>
Apr 11 15:34:20 user nova-compute[71229]: iface.vlan_id = 0
Apr 11 15:34:20 user nova-compute[71229]: iface.vlan_priority = 0
Apr 11 15:34:20 user nova-compute[71229]: iface.vlan_state = <empty>
Apr 11 15:34:20 user nova-compute[71229]: iface.iface_num = 0
Apr 11 15:34:20 user nova-compute[71229]: iface.mtu = 0
Apr 11 15:34:20 user nova-compute[71229]: iface.port = 0
Apr 11 15:34:20 user nova-compute[71229]: iface.bootproto = <empty>
Apr 11 15:34:20 user nova-compute[71229]: iface.subnet_mask = <empty>
Apr 11 15:34:20 user nova-compute[71229]: iface.gateway = <empty>
Apr 11 15:34:20 user nova-compute[71229]: iface.dhcp_alt_client_id_state = <empty>
Apr 11 15:34:20 user nova-compute[71229]: iface.dhcp_alt_client_id = <empty>
Apr 11 15:34:20 user nova-compute[71229]: iface.dhcp_dns = <empty>
Apr 11 15:34:20 user nova-compute[71229]: iface.dhcp_learn_iqn = <empty>
Apr 11 15:34:20 user nova-compute[71229]: iface.dhcp_req_vendor_id_state = <empty>
Apr 11 15:34:20 user nova-compute[71229]: iface.dhcp_vendor_id_state = <empty>
Apr 11 15:34:20 user nova-compute[71229]: iface.dhcp_vendor_id = <empty>
Apr 11 15:34:20 user nova-compute[71229]: iface.dhcp_slp_da = <empty>
Apr 11 15:34:20 user nova-compute[71229]: iface.fragmentation = <empty>
Apr 11 15:34:20 user nova-compute[71229]: iface.gratuitous_arp = <empty>
Apr 11 15:34:20 user nova-compute[71229]: iface.incoming_forwarding = <empty>
Apr 11 15:34:20 user nova-compute[71229]: iface.tos_state = <empty>
Apr 11 15:34:20 user nova-compute[71229]: iface.tos = 0
Apr 11 15:34:20 user nova-compute[71229]: iface.ttl = 0
Apr 11 15:34:20 user nova-compute[71229]: iface.delayed_ack = <empty>
Apr 11 15:34:20 user nova-compute[71229]: iface.tcp_nagle = <empty>
Apr 11 15:34:20 user nova-compute[71229]: iface.tcp_wsf_state = <empty>
Apr 11 15:34:20 user nova-compute[71229]: iface.tcp_wsf = 0
Apr 11 15:34:20 user nova-compute[71229]: iface.tcp_timer_scale = 0
Apr 11 15:34:20 user nova-compute[71229]: iface.tcp_timestamp = <empty>
Apr 11 15:34:20 user nova-compute[71229]: iface.redirect = <empty>
Apr 11 15:34:20 user nova-compute[71229]: iface.def_task_mgmt_timeout = 0
Apr 11 15:34:20 user nova-compute[71229]: iface.header_digest = <empty>
Apr 11 15:34:20 user nova-compute[71229]: iface.data_digest = <empty>
Apr 11 15:34:20 user nova-compute[71229]: iface.immediate_data = <empty>
Apr 11 15:34:20 user nova-compute[71229]: iface.initial_r2t = <empty>
Apr 11 15:34:20 user nova-compute[71229]: iface.data_seq_inorder = <empty>
Apr 11 15:34:20 user nova-compute[71229]: iface.data_pdu_inorder = <empty>
Apr 11 15:34:20 user nova-compute[71229]: iface.erl = 0
Apr 11 15:34:20 user nova-compute[71229]: iface.max_receive_data_len = 0
Apr 11 15:34:20 user nova-compute[71229]: iface.first_burst_len = 0
Apr 11 15:34:20 user nova-compute[71229]: iface.max_outstanding_r2t = 0
Apr 11 15:34:20 user nova-compute[71229]: iface.max_burst_len = 0
Apr 11 15:34:20 user nova-compute[71229]: iface.chap_auth = <empty>
Apr 11 15:34:20 user nova-compute[71229]: iface.bidi_chap = <empty>
Apr 11 15:34:20 user nova-compute[71229]: iface.strict_login_compliance = <empty>
Apr 11 15:34:20 user nova-compute[71229]: iface.discovery_auth = <empty>
Apr 11 15:34:20 user nova-compute[71229]: iface.discovery_logout = <empty>
Apr 11 15:34:20 user nova-compute[71229]: node.discovery_address = <empty>
Apr 11 15:34:20 user nova-compute[71229]: node.discovery_port = 0
Apr 11 15:34:20 user nova-compute[71229]: node.discovery_type = static
Apr 11 15:34:20 user nova-compute[71229]: node.session.initial_cmdsn = 0
Apr 11 15:34:20 user nova-compute[71229]: node.session.initial_login_retry_max = 8
Apr 11 15:34:20 user nova-compute[71229]: node.session.xmit_thread_priority = -20
Apr 11 15:34:20 user nova-compute[71229]: node.session.cmds_max = 128
Apr 11 15:34:20 user nova-compute[71229]: node.session.queue_depth = 32
Apr 11 15:34:20 user nova-compute[71229]: node.session.nr_sessions = 1
Apr 11 15:34:20 user nova-compute[71229]: node.session.auth.authmethod = CHAP
Apr 11 15:34:20 user nova-compute[71229]: node.session.auth.username = kDmHLYlZ
Apr 11 15:34:20 user nova-compute[71229]: node.session.auth.password = ***
Apr 11 15:34:20 user nova-compute[71229]: node.session.auth.username_in = <empty>
Apr 11 15:34:20 user nova-compute[71229]: node.session.auth.password_in = <empty>
Apr 11 15:34:20 user nova-compute[71229]: node.session.auth.chap_algs = MD5
Apr 11 15:34:20 user nova-compute[71229]: node.session.timeo.replacement_timeout = 120
Apr 11 15:34:20 user nova-compute[71229]: node.session.err_timeo.abort_timeout = 15
Apr 11 15:34:20 user nova-compute[71229]: node.session.err_timeo.lu_reset_timeout = 30
Apr 11 15:34:20 user nova-compute[71229]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 11 15:34:20 user nova-compute[71229]: node.session.err_timeo.host_reset_timeout = 60
Apr 11 15:34:20 user nova-compute[71229]: node.session.iscsi.FastAbort = Yes
Apr 11 15:34:20 user nova-compute[71229]: node.session.iscsi.InitialR2T = No
Apr 11 15:34:20 user nova-compute[71229]: node.session.iscsi.ImmediateData = Yes
Apr 11 15:34:20 user nova-compute[71229]: node.session.iscsi.FirstBurstLength = 262144
Apr 11 15:34:20 user nova-compute[71229]: node.session.iscsi.MaxBurstLength = 16776192
Apr 11 15:34:20 user nova-compute[71229]: node.session.iscsi.DefaultTime2Retain = 0
Apr 11 15:34:20 user nova-compute[71229]: node.session.iscsi.DefaultTime2Wait = 2
Apr 11 15:34:20 user nova-compute[71229]: node.session.iscsi.MaxConnections = 1
Apr 11 15:34:20 user nova-compute[71229]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 11 15:34:20 user nova-compute[71229]: node.session.iscsi.ERL = 0
Apr 11 15:34:20 user nova-compute[71229]: node.session.scan = manual
Apr 11 15:34:20 user nova-compute[71229]: node.session.reopen_max = 0
Apr 11 15:34:20 user nova-compute[71229]: node.conn[0].address = 172.16.0.220
Apr 11 15:34:20 user nova-compute[71229]: node.conn[0].port = 3260
Apr 11 15:34:20 user nova-compute[71229]: node.conn[0].startup = manual
Apr 11 15:34:20 user nova-compute[71229]: node.conn[0].tcp.window_size = 524288
Apr 11 15:34:20 user nova-compute[71229]: node.conn[0].tcp.type_of_service = 0
Apr 11 15:34:20 user nova-compute[71229]: node.conn[0].timeo.logout_timeout = 15
Apr 11 15:34:20 user nova-compute[71229]: node.conn[0].timeo.login_timeout = 15
Apr 11 15:34:20 user nova-compute[71229]: node.conn[0].timeo.auth_timeout = 45
Apr 11 15:34:20 user nova-compute[71229]: node.conn[0].timeo.noop_out_interval = 5
Apr 11 15:34:20 user nova-compute[71229]: node.conn[0].timeo.noop_out_timeout = 5
Apr 11 15:34:20 user nova-compute[71229]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 11 15:34:20 user nova-compute[71229]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 11 15:34:20 user nova-compute[71229]: node.conn[0].iscsi.HeaderDigest = None
Apr 11 15:34:20 user nova-compute[71229]: node.conn[0].iscsi.DataDigest = None
Apr 11 15:34:20 user nova-compute[71229]: node.conn[0].iscsi.IFMarker = No
Apr 11 15:34:20 user nova-compute[71229]: node.conn[0].iscsi.OFMarker = No
Apr 11 15:34:20 user nova-compute[71229]: # END RECORD
Apr 11 15:34:20 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91c6299-0b64-43b6-a3c5-0c89e92b1a86]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff40f2a-61ef-46a4-b658-35ef7a9eb756]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kDmHLYlZ {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kDmHLYlZ" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d4162d-6ab7-41a2-8850-e26b9c709210]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kDmHLYlZ'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f223545e-8bcd-47c6-9de5-cf4b4ee99db7]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1013387-1f5d-489f-8ba1-cd18974affef]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:34:20 user nova-compute[71229]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:34:20 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:34:20 user nova-compute[71229]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 (non-flash)
Apr 11 15:34:20 user nova-compute[71229]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452 (non-flash)
Apr 11 15:34:20 user nova-compute[71229]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e (non-flash)
Apr 11 15:34:20 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:34:20 user nova-compute[71229]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:34:20 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:34:20 user nova-compute[71229]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 (non-flash)
Apr 11 15:34:20 user nova-compute[71229]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452 (non-flash)
Apr 11 15:34:20 user nova-compute[71229]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e (non-flash)
Apr 11 15:34:20 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.136s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] HCTL ('35', '0', '0', 0) found on session 26 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.013s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[89953ec0-4ccd-4a81-a228-ee21b3337fe1]: (4, ('0 0 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Searching for a device in session 26 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kDmHLYlZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.160s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] <== connect_volume: return (162ms) {'type': 'block', 'scsi_wwn': '23766393266616531', 'path': '/dev/sdd'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766393266616531', 'path': '/dev/sdd'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:32:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-315252386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-315252386',id=23,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:32:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ddc05e9bf5ab426982ccb3092ad596e4',ramdisk_id='',reservation_id='r-x2r0o2x4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1907753459',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:32:42Z,user_data=None,user_id='1d60ce27bfad4d7c9b976e834df35ad4',uuid=d09cda86-eca1-4c42-8654-758eb6cd30e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27d62f09-c938-4a71-be1e-6dc1d6a47382", "address": "fa:16:3e:53:ab:3d", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "vif_mac": "fa:16:3e:53:ab:3d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d62f09-c9", "ovs_interfaceid": "27d62f09-c938-4a71-be1e-6dc1d6a47382", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Converting VIF {"id": "27d62f09-c938-4a71-be1e-6dc1d6a47382", "address": "fa:16:3e:53:ab:3d", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "vif_mac": "fa:16:3e:53:ab:3d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d62f09-c9", "ovs_interfaceid": "27d62f09-c938-4a71-be1e-6dc1d6a47382", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:ab:3d,bridge_name='br-int',has_traffic_filtering=True,id=27d62f09-c938-4a71-be1e-6dc1d6a47382,network=Network(1cf4cec3-ff08-4320-89e4-aa7e8cf75eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27d62f09-c9') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG nova.objects.instance [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lazy-loading 'pci_devices' on Instance uuid d09cda86-eca1-4c42-8654-758eb6cd30e0 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:34:20 user nova-compute[71229]:   <uuid>d09cda86-eca1-4c42-8654-758eb6cd30e0</uuid>
Apr 11 15:34:20 user nova-compute[71229]:   <name>instance-00000017</name>
Apr 11 15:34:20 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:34:20 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:34:20 user nova-compute[71229]:   <metadata>
Apr 11 15:34:20 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:34:20 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:34:20 user nova-compute[71229]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-315252386</nova:name>
Apr 11 15:34:20 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:34:20</nova:creationTime>
Apr 11 15:34:20 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:34:20 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:34:20 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:34:20 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:34:20 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:34:20 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:34:20 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:34:20 user nova-compute[71229]:       <nova:owner>
Apr 11 15:34:20 user nova-compute[71229]:         <nova:user uuid="1d60ce27bfad4d7c9b976e834df35ad4">tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member</nova:user>
Apr 11 15:34:20 user nova-compute[71229]:         <nova:project uuid="ddc05e9bf5ab426982ccb3092ad596e4">tempest-ServerBootFromVolumeStableRescueTest-1907753459</nova:project>
Apr 11 15:34:20 user nova-compute[71229]:       </nova:owner>
Apr 11 15:34:20 user nova-compute[71229]:       <nova:root type="image" uuid="52fe638c-5ada-47d5-b376-233bfa808a37"/>
Apr 11 15:34:20 user nova-compute[71229]:       <nova:ports>
Apr 11 15:34:20 user nova-compute[71229]:         <nova:port uuid="27d62f09-c938-4a71-be1e-6dc1d6a47382">
Apr 11 15:34:20 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 11 15:34:20 user nova-compute[71229]:         </nova:port>
Apr 11 15:34:20 user nova-compute[71229]:       </nova:ports>
Apr 11 15:34:20 user nova-compute[71229]:     </nova:instance>
Apr 11 15:34:20 user nova-compute[71229]:   </metadata>
Apr 11 15:34:20 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:34:20 user nova-compute[71229]:     <system>
Apr 11 15:34:20 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:34:20 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:34:20 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:34:20 user nova-compute[71229]:       <entry name="serial">d09cda86-eca1-4c42-8654-758eb6cd30e0</entry>
Apr 11 15:34:20 user nova-compute[71229]:       <entry name="uuid">d09cda86-eca1-4c42-8654-758eb6cd30e0</entry>
Apr 11 15:34:20 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:34:20 user nova-compute[71229]:     </system>
Apr 11 15:34:20 user nova-compute[71229]:   </sysinfo>
Apr 11 15:34:20 user nova-compute[71229]:   <os>
Apr 11 15:34:20 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:34:20 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:34:20 user nova-compute[71229]:   </os>
Apr 11 15:34:20 user nova-compute[71229]:   <features>
Apr 11 15:34:20 user nova-compute[71229]:     <acpi/>
Apr 11 15:34:20 user nova-compute[71229]:     <apic/>
Apr 11 15:34:20 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:34:20 user nova-compute[71229]:   </features>
Apr 11 15:34:20 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:34:20 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:34:20 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:34:20 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:34:20 user nova-compute[71229]:   </clock>
Apr 11 15:34:20 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:34:20 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:34:20 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:34:20 user nova-compute[71229]:   </cpu>
Apr 11 15:34:20 user nova-compute[71229]:   <devices>
Apr 11 15:34:20 user nova-compute[71229]:     <disk type="block" device="disk">
Apr 11 15:34:20 user nova-compute[71229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:34:20 user nova-compute[71229]:       <source dev="/dev/sdd"/>
Apr 11 15:34:20 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:34:20 user nova-compute[71229]:       <serial>d9ef701f-85e1-4a0a-84e9-73468c0792c4</serial>
Apr 11 15:34:20 user nova-compute[71229]:     </disk>
Apr 11 15:34:20 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 15:34:20 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 15:34:20 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/d09cda86-eca1-4c42-8654-758eb6cd30e0/disk.rescue"/>
Apr 11 15:34:20 user nova-compute[71229]:       <target dev="vdb" bus="virtio"/>
Apr 11 15:34:20 user nova-compute[71229]:       <boot order="1"/>
Apr 11 15:34:20 user nova-compute[71229]:     </disk>
Apr 11 15:34:20 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:34:20 user nova-compute[71229]:       <mac address="fa:16:3e:53:ab:3d"/>
Apr 11 15:34:20 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:34:20 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:34:20 user nova-compute[71229]:       <target dev="tap27d62f09-c9"/>
Apr 11 15:34:20 user nova-compute[71229]:     </interface>
Apr 11 15:34:20 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:34:20 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/d09cda86-eca1-4c42-8654-758eb6cd30e0/console.log" append="off"/>
Apr 11 15:34:20 user nova-compute[71229]:     </serial>
Apr 11 15:34:20 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:34:20 user nova-compute[71229]:     <video>
Apr 11 15:34:20 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:34:20 user nova-compute[71229]:     </video>
Apr 11 15:34:20 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:34:20 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:34:20 user nova-compute[71229]:     </rng>
Apr 11 15:34:20 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:34:20 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:34:20 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:34:20 user nova-compute[71229]:     </memballoon>
Apr 11 15:34:20 user nova-compute[71229]:   </devices>
Apr 11 15:34:20 user nova-compute[71229]: </domain>
Apr 11 15:34:20 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:34:20 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Instance destroyed successfully.
Apr 11 15:34:20 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:34:20 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] No VIF found with MAC fa:16:3e:53:ab:3d, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:34:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:22 user nova-compute[71229]: DEBUG nova.compute.manager [req-22d9a45b-92f0-48ce-b0d9-c20f0996eae1 req-d32f5303-a003-4634-8ce7-10fb00f996a0 service nova] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Received event network-vif-plugged-27d62f09-c938-4a71-be1e-6dc1d6a47382 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:34:22 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-22d9a45b-92f0-48ce-b0d9-c20f0996eae1 req-d32f5303-a003-4634-8ce7-10fb00f996a0 service nova] Acquiring lock "d09cda86-eca1-4c42-8654-758eb6cd30e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:34:22 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-22d9a45b-92f0-48ce-b0d9-c20f0996eae1 req-d32f5303-a003-4634-8ce7-10fb00f996a0 service nova] Lock "d09cda86-eca1-4c42-8654-758eb6cd30e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:34:22 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-22d9a45b-92f0-48ce-b0d9-c20f0996eae1 req-d32f5303-a003-4634-8ce7-10fb00f996a0 service nova] Lock "d09cda86-eca1-4c42-8654-758eb6cd30e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:34:22 user nova-compute[71229]: DEBUG nova.compute.manager [req-22d9a45b-92f0-48ce-b0d9-c20f0996eae1 req-d32f5303-a003-4634-8ce7-10fb00f996a0 service nova] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] No waiting events found dispatching network-vif-plugged-27d62f09-c938-4a71-be1e-6dc1d6a47382 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:34:22 user nova-compute[71229]: WARNING nova.compute.manager [req-22d9a45b-92f0-48ce-b0d9-c20f0996eae1 req-d32f5303-a003-4634-8ce7-10fb00f996a0 service nova] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Received unexpected event network-vif-plugged-27d62f09-c938-4a71-be1e-6dc1d6a47382 for instance with vm_state active and task_state rescuing.
Apr 11 15:34:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:24 user nova-compute[71229]: DEBUG nova.compute.manager [req-ac512ba4-dedd-4596-98e6-632e1f4f2d16 req-84ae1c53-b8bc-4e05-be57-9f4cdacfe20d service nova] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Received event network-vif-plugged-27d62f09-c938-4a71-be1e-6dc1d6a47382 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:34:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-ac512ba4-dedd-4596-98e6-632e1f4f2d16 req-84ae1c53-b8bc-4e05-be57-9f4cdacfe20d service nova] Acquiring lock "d09cda86-eca1-4c42-8654-758eb6cd30e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:34:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-ac512ba4-dedd-4596-98e6-632e1f4f2d16 req-84ae1c53-b8bc-4e05-be57-9f4cdacfe20d service nova] Lock "d09cda86-eca1-4c42-8654-758eb6cd30e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:34:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-ac512ba4-dedd-4596-98e6-632e1f4f2d16 req-84ae1c53-b8bc-4e05-be57-9f4cdacfe20d service nova] Lock "d09cda86-eca1-4c42-8654-758eb6cd30e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:34:24 user nova-compute[71229]: DEBUG nova.compute.manager [req-ac512ba4-dedd-4596-98e6-632e1f4f2d16 req-84ae1c53-b8bc-4e05-be57-9f4cdacfe20d service nova] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] No waiting events found dispatching network-vif-plugged-27d62f09-c938-4a71-be1e-6dc1d6a47382 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:34:24 user nova-compute[71229]: WARNING nova.compute.manager [req-ac512ba4-dedd-4596-98e6-632e1f4f2d16 req-84ae1c53-b8bc-4e05-be57-9f4cdacfe20d service nova] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Received unexpected event network-vif-plugged-27d62f09-c938-4a71-be1e-6dc1d6a47382 for instance with vm_state active and task_state rescuing.
Apr 11 15:34:24 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Removed pending event for d09cda86-eca1-4c42-8654-758eb6cd30e0 due to event {{(pid=71229) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 15:34:24 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227264.4972663, d09cda86-eca1-4c42-8654-758eb6cd30e0 => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:34:24 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] VM Resumed (Lifecycle Event)
Apr 11 15:34:24 user nova-compute[71229]: DEBUG nova.compute.manager [None req-d169d802-d87c-4318-a299-df858dee8f09 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:34:24 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:34:24 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:34:24 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 11 15:34:24 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227264.4985063, d09cda86-eca1-4c42-8654-758eb6cd30e0 => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:34:24 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] VM Started (Lifecycle Event)
Apr 11 15:34:24 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:34:24 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:34:24 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:25 user nova-compute[71229]: DEBUG nova.compute.manager [None req-45e261d9-ac8a-4dfd-88f8-a8799c3caa80 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:34:25 user nova-compute[71229]: INFO nova.compute.manager [None req-45e261d9-ac8a-4dfd-88f8-a8799c3caa80 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] instance snapshotting
Apr 11 15:34:25 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-45e261d9-ac8a-4dfd-88f8-a8799c3caa80 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Beginning live snapshot process
Apr 11 15:34:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-45e261d9-ac8a-4dfd-88f8-a8799c3caa80 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85658a44-9ff2-4553-b9fd-686bf35fd6ec/disk --force-share --output=json -f qcow2 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-45e261d9-ac8a-4dfd-88f8-a8799c3caa80 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85658a44-9ff2-4553-b9fd-686bf35fd6ec/disk --force-share --output=json -f qcow2" returned: 0 in 0.143s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-45e261d9-ac8a-4dfd-88f8-a8799c3caa80 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85658a44-9ff2-4553-b9fd-686bf35fd6ec/disk --force-share --output=json -f qcow2 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-45e261d9-ac8a-4dfd-88f8-a8799c3caa80 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85658a44-9ff2-4553-b9fd-686bf35fd6ec/disk --force-share --output=json -f qcow2" returned: 0 in 0.136s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-45e261d9-ac8a-4dfd-88f8-a8799c3caa80 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-45e261d9-ac8a-4dfd-88f8-a8799c3caa80 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.144s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-45e261d9-ac8a-4dfd-88f8-a8799c3caa80 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpp51dvusu/0026b271343a48b2a2a1427557fa6bcc.delta 1073741824 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-45e261d9-ac8a-4dfd-88f8-a8799c3caa80 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpp51dvusu/0026b271343a48b2a2a1427557fa6bcc.delta 1073741824" returned: 0 in 0.055s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:25 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-45e261d9-ac8a-4dfd-88f8-a8799c3caa80 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 11 15:34:26 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-45e261d9-ac8a-4dfd-88f8-a8799c3caa80 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] COPY block job progress, current cursor: 0 final cursor: 43843584 {{(pid=71229) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 15:34:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:27 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-45e261d9-ac8a-4dfd-88f8-a8799c3caa80 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] COPY block job progress, current cursor: 43843584 final cursor: 43843584 {{(pid=71229) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 15:34:27 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-45e261d9-ac8a-4dfd-88f8-a8799c3caa80 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 11 15:34:27 user nova-compute[71229]: DEBUG nova.privsep.utils [None req-45e261d9-ac8a-4dfd-88f8-a8799c3caa80 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71229) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 15:34:27 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-45e261d9-ac8a-4dfd-88f8-a8799c3caa80 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpp51dvusu/0026b271343a48b2a2a1427557fa6bcc.delta /opt/stack/data/nova/instances/snapshots/tmpp51dvusu/0026b271343a48b2a2a1427557fa6bcc {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:27 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-45e261d9-ac8a-4dfd-88f8-a8799c3caa80 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpp51dvusu/0026b271343a48b2a2a1427557fa6bcc.delta /opt/stack/data/nova/instances/snapshots/tmpp51dvusu/0026b271343a48b2a2a1427557fa6bcc" returned: 0 in 0.385s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:27 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-45e261d9-ac8a-4dfd-88f8-a8799c3caa80 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Snapshot extracted, beginning image upload
Apr 11 15:34:29 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:29 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-45e261d9-ac8a-4dfd-88f8-a8799c3caa80 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Snapshot image upload complete
Apr 11 15:34:29 user nova-compute[71229]: INFO nova.compute.manager [None req-45e261d9-ac8a-4dfd-88f8-a8799c3caa80 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Took 4.76 seconds to snapshot the instance on the hypervisor.
Apr 11 15:34:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "6a805345-374c-4326-9e8f-39bfc7947a35" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:34:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "6a805345-374c-4326-9e8f-39bfc7947a35" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:34:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:34:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:34:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:34:32 user nova-compute[71229]: INFO nova.compute.manager [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Terminating instance
Apr 11 15:34:32 user nova-compute[71229]: DEBUG nova.compute.manager [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Start destroying the instance on the hypervisor. {{(pid=71229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 15:34:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "f34c2249-840e-4475-87e6-648d173bc7ed" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "f34c2249-840e-4475-87e6-648d173bc7ed" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG nova.compute.manager [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Starting instance... {{(pid=71229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 15:34:33 user nova-compute[71229]: INFO nova.compute.claims [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Claim successful on node user
Apr 11 15:34:33 user nova-compute[71229]: DEBUG nova.compute.manager [req-361c12b1-0c7e-4e41-868b-27a88adb6709 req-ebd668b2-78e6-405a-af63-1f18151042a7 service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Received event network-vif-unplugged-d8c64197-b034-4f38-821d-ba030f1fca6b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-361c12b1-0c7e-4e41-868b-27a88adb6709 req-ebd668b2-78e6-405a-af63-1f18151042a7 service nova] Acquiring lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-361c12b1-0c7e-4e41-868b-27a88adb6709 req-ebd668b2-78e6-405a-af63-1f18151042a7 service nova] Lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-361c12b1-0c7e-4e41-868b-27a88adb6709 req-ebd668b2-78e6-405a-af63-1f18151042a7 service nova] Lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG nova.compute.manager [req-361c12b1-0c7e-4e41-868b-27a88adb6709 req-ebd668b2-78e6-405a-af63-1f18151042a7 service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] No waiting events found dispatching network-vif-unplugged-d8c64197-b034-4f38-821d-ba030f1fca6b {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG nova.compute.manager [req-361c12b1-0c7e-4e41-868b-27a88adb6709 req-ebd668b2-78e6-405a-af63-1f18151042a7 service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Received event network-vif-unplugged-d8c64197-b034-4f38-821d-ba030f1fca6b for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:33 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Instance destroyed successfully.
Apr 11 15:34:33 user nova-compute[71229]: DEBUG nova.objects.instance [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lazy-loading 'resources' on Instance uuid 6a805345-374c-4326-9e8f-39bfc7947a35 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T15:21:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1386574519',display_name='tempest-ServerActionsTestJSON-server-252985182',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1386574519',id=3,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfAJGQ+GOa8zW+jlKgD9Kz6/k6iEv9pZIOIjICzcstJ92AAS94+47mc3fRsqyx5FaTMV9P4lTsW4Fy7tKIAtMpRx0Sl7sa6ttQnPbPhlcYqfbdWbTqmmKi6+BuZpqSknA==',key_name='tempest-keypair-1137963694',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:31:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bb7660e8f76b471487136806ee9eec62',ramdisk_id='',reservation_id='r-hmn5p3xn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1659503440',owner_user_name='tempest-ServerActionsTestJSON-1659503440-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:31:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10720df0ac4f4e62a0a5c9883d600add',uuid=6a805345-374c-4326-9e8f-39bfc7947a35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8c64197-b034-4f38-821d-ba030f1fca6b", "address": "fa:16:3e:0f:f8:cb", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c64197-b0", "ovs_interfaceid": "d8c64197-b034-4f38-821d-ba030f1fca6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Converting VIF {"id": "d8c64197-b034-4f38-821d-ba030f1fca6b", "address": "fa:16:3e:0f:f8:cb", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8c64197-b0", "ovs_interfaceid": "d8c64197-b034-4f38-821d-ba030f1fca6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:f8:cb,bridge_name='br-int',has_traffic_filtering=True,id=d8c64197-b034-4f38-821d-ba030f1fca6b,network=Network(1bd215e8-0459-4dd2-893b-096b6e31ac08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c64197-b0') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG os_vif [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:f8:cb,bridge_name='br-int',has_traffic_filtering=True,id=d8c64197-b034-4f38-821d-ba030f1fca6b,network=Network(1bd215e8-0459-4dd2-893b-096b6e31ac08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c64197-b0') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd8c64197-b0, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:34:33 user nova-compute[71229]: INFO os_vif [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:f8:cb,bridge_name='br-int',has_traffic_filtering=True,id=d8c64197-b034-4f38-821d-ba030f1fca6b,network=Network(1bd215e8-0459-4dd2-893b-096b6e31ac08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8c64197-b0')
Apr 11 15:34:33 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XapmTvFn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:34:33 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:34:33 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d369ee1-e933-4f6e-b8e3-a5f124bb5513]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 15:34:33 user nova-compute[71229]: No targets found.
Apr 11 15:34:33 user nova-compute[71229]: iSNS:
Apr 11 15:34:33 user nova-compute[71229]: No targets found.
Apr 11 15:34:33 user nova-compute[71229]: STATIC:
Apr 11 15:34:33 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb
Apr 11 15:34:33 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:34:33 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:34:33 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2
Apr 11 15:34:33 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:34:33 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:34:33 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452
Apr 11 15:34:33 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:34:33 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:34:33 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532
Apr 11 15:34:33 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:34:33 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:34:33 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4
Apr 11 15:34:33 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:34:33 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:34:33 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e
Apr 11 15:34:33 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:34:33 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:34:33 user nova-compute[71229]: FIRMWARE:
Apr 11 15:34:33 user nova-compute[71229]: No targets found.
Apr 11 15:34:33 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 15:34:33 user nova-compute[71229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 15:34:33 user nova-compute[71229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71229) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2', 0)] {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc56b342-38ad-45a9-a295-b29ff6c4779e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[420c0b7c-e396-48ca-bca9-6fc282880fb5]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:34:33 user nova-compute[71229]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:34:33 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:34:33 user nova-compute[71229]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 (non-flash)
Apr 11 15:34:33 user nova-compute[71229]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452 (non-flash)
Apr 11 15:34:33 user nova-compute[71229]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e (non-flash)
Apr 11 15:34:33 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:34:33 user nova-compute[71229]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 (non-flash)
Apr 11 15:34:33 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:34:33 user nova-compute[71229]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 (non-flash)
Apr 11 15:34:33 user nova-compute[71229]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452 (non-flash)
Apr 11 15:34:33 user nova-compute[71229]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e (non-flash)
Apr 11 15:34:33 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb5c27fd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2'): ({'sdc'}, set())}) {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Removing single pathed devices sdc {{(pid=71229) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b389dcf-915a-4ff9-9a65-451be0c6d807]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d0ac74-2f3a-4af6-9495-92462b94dce8]: (4, ('ok\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Flushing IO for device /dev/sdc {{(pid=71229) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[255fccd6-ee8f-4165-bee7-a753620b1789]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71229) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd2d2c5-d2eb-4cc0-b4bb-164e79a00ad5]: (4, ('1', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.523s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG nova.compute.manager [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Start building networks asynchronously for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] SCSI volumes sdc have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2')] {{(pid=71229) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 15:34:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:34 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.307s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:34 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a50e76-4897-4ed0-a3e5-8fbaf5b00b06]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:34:34 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:34:34 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --logout {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:34 user nova-compute[71229]: DEBUG nova.compute.manager [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Allocating IP information in the background. {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 15:34:34 user nova-compute[71229]: DEBUG nova.network.neutron [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] allocate_for_instance() {{(pid=71229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 15:34:34 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 15:34:34 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:34 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f4d869-2ee8-4c70-9982-6a1daa412eb7]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:34:34 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2, portal: 172.16.0.220,3260]
Apr 11 15:34:34 user nova-compute[71229]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2, portal: 172.16.0.220,3260] successful.
Apr 11 15:34:34 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:34:34 user nova-compute[71229]: DEBUG nova.compute.manager [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Start building block device mappings for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 15:34:34 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --op delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:34 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e168e446-1ecb-4f58-bc6c-0f488fa989a2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:34 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e717a12-0c64-4d4f-8f53-b4510038bdbb]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:34:34 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:34:34 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.681s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:34:34 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] <== disconnect_volume: return (682ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:34:34 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 15:34:34 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Deleting instance files /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35_del
Apr 11 15:34:34 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Deletion of /opt/stack/data/nova/instances/6a805345-374c-4326-9e8f-39bfc7947a35_del complete
Apr 11 15:34:34 user nova-compute[71229]: DEBUG nova.policy [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '402ec212c8a64a559f82c166070a92ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f7abe5e3144c7ab354ffaba1748616', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71229) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 15:34:34 user nova-compute[71229]: INFO nova.compute.manager [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Took 1.63 seconds to destroy the instance on the hypervisor.
Apr 11 15:34:34 user nova-compute[71229]: DEBUG oslo.service.loopingcall [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71229) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 15:34:34 user nova-compute[71229]: DEBUG nova.compute.manager [-] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Deallocating network for instance {{(pid=71229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 15:34:34 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] deallocate_for_instance() {{(pid=71229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 15:34:34 user nova-compute[71229]: DEBUG nova.compute.manager [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Start spawning the instance on the hypervisor. {{(pid=71229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 15:34:34 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Creating instance directory {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 15:34:34 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Creating image(s)
Apr 11 15:34:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "/opt/stack/data/nova/instances/f34c2249-840e-4475-87e6-648d173bc7ed/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:34:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "/opt/stack/data/nova/instances/f34c2249-840e-4475-87e6-648d173bc7ed/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:34:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "/opt/stack/data/nova/instances/f34c2249-840e-4475-87e6-648d173bc7ed/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:34:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "2a6c856c397ddcbd7b785bdd35b8b0e4215b5a23" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:34:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "2a6c856c397ddcbd7b785bdd35b8b0e4215b5a23" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:34:35 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a6c856c397ddcbd7b785bdd35b8b0e4215b5a23.part --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:35 user nova-compute[71229]: DEBUG nova.compute.manager [req-5bd1fd99-df41-4d11-89a4-8f3b9ab8f0af req-fac8790c-b89b-4114-aba2-a9f131632c96 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received event network-changed-7485c140-3c08-4191-9929-3c41cb6fd725 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:34:35 user nova-compute[71229]: DEBUG nova.compute.manager [req-5bd1fd99-df41-4d11-89a4-8f3b9ab8f0af req-fac8790c-b89b-4114-aba2-a9f131632c96 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Refreshing instance network info cache due to event network-changed-7485c140-3c08-4191-9929-3c41cb6fd725. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:34:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-5bd1fd99-df41-4d11-89a4-8f3b9ab8f0af req-fac8790c-b89b-4114-aba2-a9f131632c96 service nova] Acquiring lock "refresh_cache-fa6dc9c1-6786-4c17-a23e-f71c21ac08a7" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:34:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-5bd1fd99-df41-4d11-89a4-8f3b9ab8f0af req-fac8790c-b89b-4114-aba2-a9f131632c96 service nova] Acquired lock "refresh_cache-fa6dc9c1-6786-4c17-a23e-f71c21ac08a7" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:34:35 user nova-compute[71229]: DEBUG nova.network.neutron [req-5bd1fd99-df41-4d11-89a4-8f3b9ab8f0af req-fac8790c-b89b-4114-aba2-a9f131632c96 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Refreshing network info cache for port 7485c140-3c08-4191-9929-3c41cb6fd725 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:34:35 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a6c856c397ddcbd7b785bdd35b8b0e4215b5a23.part --force-share --output=json" returned: 0 in 0.159s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:35 user nova-compute[71229]: DEBUG nova.virt.images [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] acf06024-4378-482a-bbf6-6ff8213c4958 was qcow2, converting to raw {{(pid=71229) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 15:34:35 user nova-compute[71229]: DEBUG nova.privsep.utils [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71229) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 15:34:35 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2a6c856c397ddcbd7b785bdd35b8b0e4215b5a23.part /opt/stack/data/nova/instances/_base/2a6c856c397ddcbd7b785bdd35b8b0e4215b5a23.converted {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:35 user nova-compute[71229]: DEBUG nova.network.neutron [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Successfully created port: dc2a981c-9e15-473f-8bd6-c4c312b107d1 {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 15:34:35 user nova-compute[71229]: DEBUG nova.compute.manager [req-dde7f617-dee3-45c9-9dc3-10c587014d14 req-35b852de-b8f1-40c3-a727-e5d4bb5b1a0b service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Received event network-vif-plugged-d8c64197-b034-4f38-821d-ba030f1fca6b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:34:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-dde7f617-dee3-45c9-9dc3-10c587014d14 req-35b852de-b8f1-40c3-a727-e5d4bb5b1a0b service nova] Acquiring lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:34:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-dde7f617-dee3-45c9-9dc3-10c587014d14 req-35b852de-b8f1-40c3-a727-e5d4bb5b1a0b service nova] Lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:34:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-dde7f617-dee3-45c9-9dc3-10c587014d14 req-35b852de-b8f1-40c3-a727-e5d4bb5b1a0b service nova] Lock "6a805345-374c-4326-9e8f-39bfc7947a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:34:35 user nova-compute[71229]: DEBUG nova.compute.manager [req-dde7f617-dee3-45c9-9dc3-10c587014d14 req-35b852de-b8f1-40c3-a727-e5d4bb5b1a0b service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] No waiting events found dispatching network-vif-plugged-d8c64197-b034-4f38-821d-ba030f1fca6b {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:34:35 user nova-compute[71229]: WARNING nova.compute.manager [req-dde7f617-dee3-45c9-9dc3-10c587014d14 req-35b852de-b8f1-40c3-a727-e5d4bb5b1a0b service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Received unexpected event network-vif-plugged-d8c64197-b034-4f38-821d-ba030f1fca6b for instance with vm_state active and task_state deleting.
Apr 11 15:34:35 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2a6c856c397ddcbd7b785bdd35b8b0e4215b5a23.part /opt/stack/data/nova/instances/_base/2a6c856c397ddcbd7b785bdd35b8b0e4215b5a23.converted" returned: 0 in 0.552s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:35 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a6c856c397ddcbd7b785bdd35b8b0e4215b5a23.converted --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:35 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a6c856c397ddcbd7b785bdd35b8b0e4215b5a23.converted --force-share --output=json" returned: 0 in 0.134s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "2a6c856c397ddcbd7b785bdd35b8b0e4215b5a23" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.695s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:34:35 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a6c856c397ddcbd7b785bdd35b8b0e4215b5a23 --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:36 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a6c856c397ddcbd7b785bdd35b8b0e4215b5a23 --force-share --output=json" returned: 0 in 0.151s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "2a6c856c397ddcbd7b785bdd35b8b0e4215b5a23" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:34:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "2a6c856c397ddcbd7b785bdd35b8b0e4215b5a23" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:34:36 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a6c856c397ddcbd7b785bdd35b8b0e4215b5a23 --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:36 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a6c856c397ddcbd7b785bdd35b8b0e4215b5a23 --force-share --output=json" returned: 0 in 0.190s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:36 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a6c856c397ddcbd7b785bdd35b8b0e4215b5a23,backing_fmt=raw /opt/stack/data/nova/instances/f34c2249-840e-4475-87e6-648d173bc7ed/disk 1073741824 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:36 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:34:36 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a6c856c397ddcbd7b785bdd35b8b0e4215b5a23,backing_fmt=raw /opt/stack/data/nova/instances/f34c2249-840e-4475-87e6-648d173bc7ed/disk 1073741824" returned: 0 in 0.062s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "2a6c856c397ddcbd7b785bdd35b8b0e4215b5a23" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:34:36 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a6c856c397ddcbd7b785bdd35b8b0e4215b5a23 --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:36 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Took 2.21 seconds to deallocate network for instance.
Apr 11 15:34:36 user nova-compute[71229]: DEBUG nova.network.neutron [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Successfully updated port: dc2a981c-9e15-473f-8bd6-c4c312b107d1 {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:34:36 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a6c856c397ddcbd7b785bdd35b8b0e4215b5a23 --force-share --output=json" returned: 0 in 0.139s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:36 user nova-compute[71229]: DEBUG nova.objects.instance [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lazy-loading 'migration_context' on Instance uuid f34c2249-840e-4475-87e6-648d173bc7ed {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:34:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "refresh_cache-f34c2249-840e-4475-87e6-648d173bc7ed" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:34:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquired lock "refresh_cache-f34c2249-840e-4475-87e6-648d173bc7ed" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:34:36 user nova-compute[71229]: DEBUG nova.network.neutron [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:34:36 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Created local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 15:34:36 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Ensure instance console log exists: /opt/stack/data/nova/instances/f34c2249-840e-4475-87e6-648d173bc7ed/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 15:34:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:34:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:34:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:34:36 user nova-compute[71229]: DEBUG nova.compute.manager [req-78f29be7-1e19-4a6f-9d48-6dfd7a6e0f68 req-7df32988-7cce-4f06-b547-bb97a4814ad8 service nova] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Received event network-changed-dc2a981c-9e15-473f-8bd6-c4c312b107d1 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:34:36 user nova-compute[71229]: DEBUG nova.compute.manager [req-78f29be7-1e19-4a6f-9d48-6dfd7a6e0f68 req-7df32988-7cce-4f06-b547-bb97a4814ad8 service nova] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Refreshing instance network info cache due to event network-changed-dc2a981c-9e15-473f-8bd6-c4c312b107d1. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:34:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-78f29be7-1e19-4a6f-9d48-6dfd7a6e0f68 req-7df32988-7cce-4f06-b547-bb97a4814ad8 service nova] Acquiring lock "refresh_cache-f34c2249-840e-4475-87e6-648d173bc7ed" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:34:36 user nova-compute[71229]: DEBUG nova.network.neutron [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:34:36 user nova-compute[71229]: DEBUG nova.network.neutron [req-5bd1fd99-df41-4d11-89a4-8f3b9ab8f0af req-fac8790c-b89b-4114-aba2-a9f131632c96 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Updated VIF entry in instance network info cache for port 7485c140-3c08-4191-9929-3c41cb6fd725. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:34:36 user nova-compute[71229]: DEBUG nova.network.neutron [req-5bd1fd99-df41-4d11-89a4-8f3b9ab8f0af req-fac8790c-b89b-4114-aba2-a9f131632c96 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Updating instance_info_cache with network_info: [{"id": "7485c140-3c08-4191-9929-3c41cb6fd725", "address": "fa:16:3e:3a:3c:8e", "network": {"id": "e4b9e2d9-6b8e-4857-bd3e-19c5d7c80f69", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2926051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7485c140-3c", "ovs_interfaceid": "7485c140-3c08-4191-9929-3c41cb6fd725", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b7d90fa1-965a-4cc7-bc48-64a43041af23", "address": "fa:16:3e:b2:3b:c0", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d90fa1-96", "ovs_interfaceid": "b7d90fa1-965a-4cc7-bc48-64a43041af23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fafe4f73-4fc5-401b-a2bf-542bea23915f", "address": "fa:16:3e:e2:5f:81", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfafe4f73-4f", "ovs_interfaceid": "fafe4f73-4fc5-401b-a2bf-542bea23915f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "44becdbc-fa86-4dbe-ac1a-e0e01648513b", "address": "fa:16:3e:ed:b8:03", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44becdbc-fa", "ovs_interfaceid": "44becdbc-fa86-4dbe-ac1a-e0e01648513b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bf63f34a-3145-4251-a036-a35bd08ef45f", "address": "fa:16:3e:4a:ce:66", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf63f34a-31", "ovs_interfaceid": "bf63f34a-3145-4251-a036-a35bd08ef45f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e5066fdb-ea6f-4df5-b185-56f1a0dbe539", "address": "fa:16:3e:5f:b5:3e", "network": {"id": "a08657fa-cfdb-4f36-b464-53fe53b857af", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819766267", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5066fdb-ea", "ovs_interfaceid": "e5066fdb-ea6f-4df5-b185-56f1a0dbe539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f", "address": "fa:16:3e:e7:ca:1c", "network": {"id": "a08657fa-cfdb-4f36-b464-53fe53b857af", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819766267", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00381a8-f9", "ovs_interfaceid": "b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:34:36 user nova-compute[71229]: DEBUG nova.compute.manager [req-9981651e-85bf-4852-91d8-df86a249a897 req-b0451a3a-ec0a-4975-985c-70893b1bfcbe service nova] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Received event network-vif-deleted-d8c64197-b034-4f38-821d-ba030f1fca6b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:34:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-5bd1fd99-df41-4d11-89a4-8f3b9ab8f0af req-fac8790c-b89b-4114-aba2-a9f131632c96 service nova] Releasing lock "refresh_cache-fa6dc9c1-6786-4c17-a23e-f71c21ac08a7" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:34:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:36 user nova-compute[71229]: DEBUG nova.network.neutron [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Updating instance_info_cache with network_info: [{"id": "dc2a981c-9e15-473f-8bd6-c4c312b107d1", "address": "fa:16:3e:68:02:4d", "network": {"id": "8dd93667-4f8b-4d89-b7be-056f5f39bffe", "bridge": "br-int", "label": "tempest-TestStampPattern-1555823894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0f7abe5e3144c7ab354ffaba1748616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc2a981c-9e", "ovs_interfaceid": "dc2a981c-9e15-473f-8bd6-c4c312b107d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:34:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Releasing lock "refresh_cache-f34c2249-840e-4475-87e6-648d173bc7ed" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:34:36 user nova-compute[71229]: DEBUG nova.compute.manager [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Instance network_info: |[{"id": "dc2a981c-9e15-473f-8bd6-c4c312b107d1", "address": "fa:16:3e:68:02:4d", "network": {"id": "8dd93667-4f8b-4d89-b7be-056f5f39bffe", "bridge": "br-int", "label": "tempest-TestStampPattern-1555823894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0f7abe5e3144c7ab354ffaba1748616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc2a981c-9e", "ovs_interfaceid": "dc2a981c-9e15-473f-8bd6-c4c312b107d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 15:34:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-78f29be7-1e19-4a6f-9d48-6dfd7a6e0f68 req-7df32988-7cce-4f06-b547-bb97a4814ad8 service nova] Acquired lock "refresh_cache-f34c2249-840e-4475-87e6-648d173bc7ed" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:34:36 user nova-compute[71229]: DEBUG nova.network.neutron [req-78f29be7-1e19-4a6f-9d48-6dfd7a6e0f68 req-7df32988-7cce-4f06-b547-bb97a4814ad8 service nova] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Refreshing network info cache for port dc2a981c-9e15-473f-8bd6-c4c312b107d1 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:34:36 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Start _get_guest_xml network_info=[{"id": "dc2a981c-9e15-473f-8bd6-c4c312b107d1", "address": "fa:16:3e:68:02:4d", "network": {"id": "8dd93667-4f8b-4d89-b7be-056f5f39bffe", "bridge": "br-int", "label": "tempest-TestStampPattern-1555823894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0f7abe5e3144c7ab354ffaba1748616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc2a981c-9e", "ovs_interfaceid": "dc2a981c-9e15-473f-8bd6-c4c312b107d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='79fe0301ee0c4b39f2bb1ebfbda8939e',container_format='bare',created_at=2023-04-11T15:34:25Z,direct_url=<?>,disk_format='qcow2',id=acf06024-4378-482a-bbf6-6ff8213c4958,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-123167437',owner='f0f7abe5e3144c7ab354ffaba1748616',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-11T15:34:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': 'acf06024-4378-482a-bbf6-6ff8213c4958'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:34:36 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:34:36 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:34:36 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:34:36 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='79fe0301ee0c4b39f2bb1ebfbda8939e',container_format='bare',created_at=2023-04-11T15:34:25Z,direct_url=<?>,disk_format='qcow2',id=acf06024-4378-482a-bbf6-6ff8213c4958,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-123167437',owner='f0f7abe5e3144c7ab354ffaba1748616',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-11T15:34:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:34:36 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:34:36 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:34:36 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:34:36 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:34:36 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:34:36 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:34:36 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:34:36 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:34:36 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:34:36 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:34:37 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:34:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1403839106',display_name='tempest-TestStampPattern-server-1403839106',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1403839106',id=25,image_ref='acf06024-4378-482a-bbf6-6ff8213c4958',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3FSQFz663lRbqzNxmPBbu9uJ3msIEfoeqvzCwilWtgPX+8lEdFmI1HaDVmQnOzGM0qsSCbXPgFMVYIHe6QVLQ+qXsBEhvf3WHKTsTkVBdGgOn/xo5dIBdvrA6jCgt/VA==',key_name='tempest-TestStampPattern-416277054',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0f7abe5e3144c7ab354ffaba1748616',ramdisk_id='',reservation_id='r-g0b4x1ow',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='85658a44-9ff2-4553-b9fd-686bf35fd6ec',image_min_disk='1',image_min_ram='0',image_owner_id='f0f7abe5e3144c7ab354ffaba1748616',image_owner_project_name='tempest-TestStampPattern-344874523',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-344874523-project-member',image_user_id='402ec212c8a64a559f82c166070a92ef',network_allocated='True',owner_project_name='tempest-TestStampPattern-344874523',owner_user_name='tempest-TestStampPattern-344874523-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:34:34Z,user_data=None,user_id='402ec212c8a64a559f82c166070a92ef',uuid=f34c2249-840e-4475-87e6-648d173bc7ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc2a981c-9e15-473f-8bd6-c4c312b107d1", "address": "fa:16:3e:68:02:4d", "network": {"id": "8dd93667-4f8b-4d89-b7be-056f5f39bffe", "bridge": "br-int", "label": "tempest-TestStampPattern-1555823894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0f7abe5e3144c7ab354ffaba1748616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc2a981c-9e", "ovs_interfaceid": "dc2a981c-9e15-473f-8bd6-c4c312b107d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:34:37 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Converting VIF {"id": "dc2a981c-9e15-473f-8bd6-c4c312b107d1", "address": "fa:16:3e:68:02:4d", "network": {"id": "8dd93667-4f8b-4d89-b7be-056f5f39bffe", "bridge": "br-int", "label": "tempest-TestStampPattern-1555823894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0f7abe5e3144c7ab354ffaba1748616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc2a981c-9e", "ovs_interfaceid": "dc2a981c-9e15-473f-8bd6-c4c312b107d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:34:37 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:02:4d,bridge_name='br-int',has_traffic_filtering=True,id=dc2a981c-9e15-473f-8bd6-c4c312b107d1,network=Network(8dd93667-4f8b-4d89-b7be-056f5f39bffe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc2a981c-9e') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:34:37 user nova-compute[71229]: DEBUG nova.objects.instance [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lazy-loading 'pci_devices' on Instance uuid f34c2249-840e-4475-87e6-648d173bc7ed {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:34:37 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:34:37 user nova-compute[71229]:   <uuid>f34c2249-840e-4475-87e6-648d173bc7ed</uuid>
Apr 11 15:34:37 user nova-compute[71229]:   <name>instance-00000019</name>
Apr 11 15:34:37 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:34:37 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:34:37 user nova-compute[71229]:   <metadata>
Apr 11 15:34:37 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:34:37 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:34:37 user nova-compute[71229]:       <nova:name>tempest-TestStampPattern-server-1403839106</nova:name>
Apr 11 15:34:37 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:34:36</nova:creationTime>
Apr 11 15:34:37 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:34:37 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:34:37 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:34:37 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:34:37 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:34:37 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:34:37 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:34:37 user nova-compute[71229]:       <nova:owner>
Apr 11 15:34:37 user nova-compute[71229]:         <nova:user uuid="402ec212c8a64a559f82c166070a92ef">tempest-TestStampPattern-344874523-project-member</nova:user>
Apr 11 15:34:37 user nova-compute[71229]:         <nova:project uuid="f0f7abe5e3144c7ab354ffaba1748616">tempest-TestStampPattern-344874523</nova:project>
Apr 11 15:34:37 user nova-compute[71229]:       </nova:owner>
Apr 11 15:34:37 user nova-compute[71229]:       <nova:root type="image" uuid="acf06024-4378-482a-bbf6-6ff8213c4958"/>
Apr 11 15:34:37 user nova-compute[71229]:       <nova:ports>
Apr 11 15:34:37 user nova-compute[71229]:         <nova:port uuid="dc2a981c-9e15-473f-8bd6-c4c312b107d1">
Apr 11 15:34:37 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 11 15:34:37 user nova-compute[71229]:         </nova:port>
Apr 11 15:34:37 user nova-compute[71229]:       </nova:ports>
Apr 11 15:34:37 user nova-compute[71229]:     </nova:instance>
Apr 11 15:34:37 user nova-compute[71229]:   </metadata>
Apr 11 15:34:37 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:34:37 user nova-compute[71229]:     <system>
Apr 11 15:34:37 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:34:37 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:34:37 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:34:37 user nova-compute[71229]:       <entry name="serial">f34c2249-840e-4475-87e6-648d173bc7ed</entry>
Apr 11 15:34:37 user nova-compute[71229]:       <entry name="uuid">f34c2249-840e-4475-87e6-648d173bc7ed</entry>
Apr 11 15:34:37 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:34:37 user nova-compute[71229]:     </system>
Apr 11 15:34:37 user nova-compute[71229]:   </sysinfo>
Apr 11 15:34:37 user nova-compute[71229]:   <os>
Apr 11 15:34:37 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:34:37 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 15:34:37 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:34:37 user nova-compute[71229]:   </os>
Apr 11 15:34:37 user nova-compute[71229]:   <features>
Apr 11 15:34:37 user nova-compute[71229]:     <acpi/>
Apr 11 15:34:37 user nova-compute[71229]:     <apic/>
Apr 11 15:34:37 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:34:37 user nova-compute[71229]:   </features>
Apr 11 15:34:37 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:34:37 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:34:37 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:34:37 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:34:37 user nova-compute[71229]:   </clock>
Apr 11 15:34:37 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:34:37 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:34:37 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:34:37 user nova-compute[71229]:   </cpu>
Apr 11 15:34:37 user nova-compute[71229]:   <devices>
Apr 11 15:34:37 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 15:34:37 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 15:34:37 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/f34c2249-840e-4475-87e6-648d173bc7ed/disk"/>
Apr 11 15:34:37 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:34:37 user nova-compute[71229]:     </disk>
Apr 11 15:34:37 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:34:37 user nova-compute[71229]:       <mac address="fa:16:3e:68:02:4d"/>
Apr 11 15:34:37 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:34:37 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:34:37 user nova-compute[71229]:       <target dev="tapdc2a981c-9e"/>
Apr 11 15:34:37 user nova-compute[71229]:     </interface>
Apr 11 15:34:37 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:34:37 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/f34c2249-840e-4475-87e6-648d173bc7ed/console.log" append="off"/>
Apr 11 15:34:37 user nova-compute[71229]:     </serial>
Apr 11 15:34:37 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:34:37 user nova-compute[71229]:     <video>
Apr 11 15:34:37 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:34:37 user nova-compute[71229]:     </video>
Apr 11 15:34:37 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:34:37 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:34:37 user nova-compute[71229]:     </rng>
Apr 11 15:34:37 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:34:37 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:34:37 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:34:37 user nova-compute[71229]:     </memballoon>
Apr 11 15:34:37 user nova-compute[71229]:   </devices>
Apr 11 15:34:37 user nova-compute[71229]: </domain>
Apr 11 15:34:37 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:34:37 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:34:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1403839106',display_name='tempest-TestStampPattern-server-1403839106',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1403839106',id=25,image_ref='acf06024-4378-482a-bbf6-6ff8213c4958',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3FSQFz663lRbqzNxmPBbu9uJ3msIEfoeqvzCwilWtgPX+8lEdFmI1HaDVmQnOzGM0qsSCbXPgFMVYIHe6QVLQ+qXsBEhvf3WHKTsTkVBdGgOn/xo5dIBdvrA6jCgt/VA==',key_name='tempest-TestStampPattern-416277054',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0f7abe5e3144c7ab354ffaba1748616',ramdisk_id='',reservation_id='r-g0b4x1ow',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='85658a44-9ff2-4553-b9fd-686bf35fd6ec',image_min_disk='1',image_min_ram='0',image_owner_id='f0f7abe5e3144c7ab354ffaba1748616',image_owner_project_name='tempest-TestStampPattern-344874523',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-344874523-project-member',image_user_id='402ec212c8a64a559f82c166070a92ef',network_allocated='True',owner_project_name='tempest-TestStampPattern-344874523',owner_user_name='tempest-TestStampPattern-344874523-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:34:34Z,user_data=None,user_id='402ec212c8a64a559f82c166070a92ef',uuid=f34c2249-840e-4475-87e6-648d173bc7ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc2a981c-9e15-473f-8bd6-c4c312b107d1", "address": "fa:16:3e:68:02:4d", "network": {"id": "8dd93667-4f8b-4d89-b7be-056f5f39bffe", "bridge": "br-int", "label": "tempest-TestStampPattern-1555823894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0f7abe5e3144c7ab354ffaba1748616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc2a981c-9e", "ovs_interfaceid": "dc2a981c-9e15-473f-8bd6-c4c312b107d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:34:37 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Converting VIF {"id": "dc2a981c-9e15-473f-8bd6-c4c312b107d1", "address": "fa:16:3e:68:02:4d", "network": {"id": "8dd93667-4f8b-4d89-b7be-056f5f39bffe", "bridge": "br-int", "label": "tempest-TestStampPattern-1555823894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0f7abe5e3144c7ab354ffaba1748616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc2a981c-9e", "ovs_interfaceid": "dc2a981c-9e15-473f-8bd6-c4c312b107d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:34:37 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:02:4d,bridge_name='br-int',has_traffic_filtering=True,id=dc2a981c-9e15-473f-8bd6-c4c312b107d1,network=Network(8dd93667-4f8b-4d89-b7be-056f5f39bffe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc2a981c-9e') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:34:37 user nova-compute[71229]: DEBUG os_vif [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:02:4d,bridge_name='br-int',has_traffic_filtering=True,id=dc2a981c-9e15-473f-8bd6-c4c312b107d1,network=Network(8dd93667-4f8b-4d89-b7be-056f5f39bffe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc2a981c-9e') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:34:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:34:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:34:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Acquiring lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:34:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:34:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Acquiring lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:34:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:34:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:34:37 user nova-compute[71229]: INFO nova.compute.manager [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Terminating instance
Apr 11 15:34:37 user nova-compute[71229]: DEBUG nova.compute.manager [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Start destroying the instance on the hypervisor. {{(pid=71229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 15:34:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc2a981c-9e, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:34:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdc2a981c-9e, col_values=(('external_ids', {'iface-id': 'dc2a981c-9e15-473f-8bd6-c4c312b107d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:02:4d', 'vm-uuid': 'f34c2249-840e-4475-87e6-648d173bc7ed'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:34:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:34:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:37 user nova-compute[71229]: INFO os_vif [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:02:4d,bridge_name='br-int',has_traffic_filtering=True,id=dc2a981c-9e15-473f-8bd6-c4c312b107d1,network=Network(8dd93667-4f8b-4d89-b7be-056f5f39bffe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc2a981c-9e')
Apr 11 15:34:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:37 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:34:37 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] No VIF found with MAC fa:16:3e:68:02:4d, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:34:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:37 user nova-compute[71229]: INFO nova.compute.manager [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Took 0.95 seconds to detach 1 volumes for instance.
Apr 11 15:34:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:34:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.008s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:34:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:37 user nova-compute[71229]: DEBUG nova.network.neutron [req-78f29be7-1e19-4a6f-9d48-6dfd7a6e0f68 req-7df32988-7cce-4f06-b547-bb97a4814ad8 service nova] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Updated VIF entry in instance network info cache for port dc2a981c-9e15-473f-8bd6-c4c312b107d1. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:34:37 user nova-compute[71229]: DEBUG nova.network.neutron [req-78f29be7-1e19-4a6f-9d48-6dfd7a6e0f68 req-7df32988-7cce-4f06-b547-bb97a4814ad8 service nova] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Updating instance_info_cache with network_info: [{"id": "dc2a981c-9e15-473f-8bd6-c4c312b107d1", "address": "fa:16:3e:68:02:4d", "network": {"id": "8dd93667-4f8b-4d89-b7be-056f5f39bffe", "bridge": "br-int", "label": "tempest-TestStampPattern-1555823894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0f7abe5e3144c7ab354ffaba1748616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc2a981c-9e", "ovs_interfaceid": "dc2a981c-9e15-473f-8bd6-c4c312b107d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:34:37 user nova-compute[71229]: DEBUG nova.compute.manager [req-02196c7d-c74e-4f75-ae63-4c7a3b59cd04 req-760fa015-0cce-4be1-ba11-76fb79dee745 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received event network-vif-unplugged-b7d90fa1-965a-4cc7-bc48-64a43041af23 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:34:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-02196c7d-c74e-4f75-ae63-4c7a3b59cd04 req-760fa015-0cce-4be1-ba11-76fb79dee745 service nova] Acquiring lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:34:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-02196c7d-c74e-4f75-ae63-4c7a3b59cd04 req-760fa015-0cce-4be1-ba11-76fb79dee745 service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:34:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-02196c7d-c74e-4f75-ae63-4c7a3b59cd04 req-760fa015-0cce-4be1-ba11-76fb79dee745 service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:34:37 user nova-compute[71229]: DEBUG nova.compute.manager [req-02196c7d-c74e-4f75-ae63-4c7a3b59cd04 req-760fa015-0cce-4be1-ba11-76fb79dee745 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] No waiting events found dispatching network-vif-unplugged-b7d90fa1-965a-4cc7-bc48-64a43041af23 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:34:37 user nova-compute[71229]: DEBUG nova.compute.manager [req-02196c7d-c74e-4f75-ae63-4c7a3b59cd04 req-760fa015-0cce-4be1-ba11-76fb79dee745 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received event network-vif-unplugged-b7d90fa1-965a-4cc7-bc48-64a43041af23 for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 15:34:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-78f29be7-1e19-4a6f-9d48-6dfd7a6e0f68 req-7df32988-7cce-4f06-b547-bb97a4814ad8 service nova] Releasing lock "refresh_cache-f34c2249-840e-4475-87e6-648d173bc7ed" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:34:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:37 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:34:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:37 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:34:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.565s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:34:38 user nova-compute[71229]: INFO nova.scheduler.client.report [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Deleted allocations for instance 6a805345-374c-4326-9e8f-39bfc7947a35
Apr 11 15:34:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c9bb1247-18e4-4e33-beae-fee60edb66ad tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "6a805345-374c-4326-9e8f-39bfc7947a35" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.670s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:34:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:38 user nova-compute[71229]: DEBUG nova.compute.manager [req-dc2d76d1-6a73-4adb-848c-3477e0f227f4 req-5e44b3ef-3e05-4cb8-b5b7-655cc87e25de service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received event network-vif-unplugged-fafe4f73-4fc5-401b-a2bf-542bea23915f {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:34:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-dc2d76d1-6a73-4adb-848c-3477e0f227f4 req-5e44b3ef-3e05-4cb8-b5b7-655cc87e25de service nova] Acquiring lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:34:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-dc2d76d1-6a73-4adb-848c-3477e0f227f4 req-5e44b3ef-3e05-4cb8-b5b7-655cc87e25de service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:34:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-dc2d76d1-6a73-4adb-848c-3477e0f227f4 req-5e44b3ef-3e05-4cb8-b5b7-655cc87e25de service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:34:38 user nova-compute[71229]: DEBUG nova.compute.manager [req-dc2d76d1-6a73-4adb-848c-3477e0f227f4 req-5e44b3ef-3e05-4cb8-b5b7-655cc87e25de service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] No waiting events found dispatching network-vif-unplugged-fafe4f73-4fc5-401b-a2bf-542bea23915f {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:34:38 user nova-compute[71229]: DEBUG nova.compute.manager [req-dc2d76d1-6a73-4adb-848c-3477e0f227f4 req-5e44b3ef-3e05-4cb8-b5b7-655cc87e25de service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received event network-vif-unplugged-fafe4f73-4fc5-401b-a2bf-542bea23915f for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 15:34:38 user nova-compute[71229]: DEBUG nova.compute.manager [req-dc2d76d1-6a73-4adb-848c-3477e0f227f4 req-5e44b3ef-3e05-4cb8-b5b7-655cc87e25de service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received event network-vif-plugged-fafe4f73-4fc5-401b-a2bf-542bea23915f {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:34:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-dc2d76d1-6a73-4adb-848c-3477e0f227f4 req-5e44b3ef-3e05-4cb8-b5b7-655cc87e25de service nova] Acquiring lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:34:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-dc2d76d1-6a73-4adb-848c-3477e0f227f4 req-5e44b3ef-3e05-4cb8-b5b7-655cc87e25de service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:34:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-dc2d76d1-6a73-4adb-848c-3477e0f227f4 req-5e44b3ef-3e05-4cb8-b5b7-655cc87e25de service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:34:38 user nova-compute[71229]: DEBUG nova.compute.manager [req-dc2d76d1-6a73-4adb-848c-3477e0f227f4 req-5e44b3ef-3e05-4cb8-b5b7-655cc87e25de service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] No waiting events found dispatching network-vif-plugged-fafe4f73-4fc5-401b-a2bf-542bea23915f {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:34:38 user nova-compute[71229]: WARNING nova.compute.manager [req-dc2d76d1-6a73-4adb-848c-3477e0f227f4 req-5e44b3ef-3e05-4cb8-b5b7-655cc87e25de service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received unexpected event network-vif-plugged-fafe4f73-4fc5-401b-a2bf-542bea23915f for instance with vm_state active and task_state deleting.
Apr 11 15:34:38 user nova-compute[71229]: DEBUG nova.compute.manager [req-2e34405e-8ca3-4002-be0f-0a3c9ce594b8 req-e75ac03f-67b4-4f12-bd69-3af60c4f8d4b service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received event network-vif-unplugged-7485c140-3c08-4191-9929-3c41cb6fd725 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:34:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2e34405e-8ca3-4002-be0f-0a3c9ce594b8 req-e75ac03f-67b4-4f12-bd69-3af60c4f8d4b service nova] Acquiring lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:34:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2e34405e-8ca3-4002-be0f-0a3c9ce594b8 req-e75ac03f-67b4-4f12-bd69-3af60c4f8d4b service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:34:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2e34405e-8ca3-4002-be0f-0a3c9ce594b8 req-e75ac03f-67b4-4f12-bd69-3af60c4f8d4b service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:34:38 user nova-compute[71229]: DEBUG nova.compute.manager [req-2e34405e-8ca3-4002-be0f-0a3c9ce594b8 req-e75ac03f-67b4-4f12-bd69-3af60c4f8d4b service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] No waiting events found dispatching network-vif-unplugged-7485c140-3c08-4191-9929-3c41cb6fd725 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:34:38 user nova-compute[71229]: DEBUG nova.compute.manager [req-2e34405e-8ca3-4002-be0f-0a3c9ce594b8 req-e75ac03f-67b4-4f12-bd69-3af60c4f8d4b service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received event network-vif-unplugged-7485c140-3c08-4191-9929-3c41cb6fd725 for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 15:34:38 user nova-compute[71229]: DEBUG nova.compute.manager [req-2e34405e-8ca3-4002-be0f-0a3c9ce594b8 req-e75ac03f-67b4-4f12-bd69-3af60c4f8d4b service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received event network-vif-plugged-7485c140-3c08-4191-9929-3c41cb6fd725 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:34:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2e34405e-8ca3-4002-be0f-0a3c9ce594b8 req-e75ac03f-67b4-4f12-bd69-3af60c4f8d4b service nova] Acquiring lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:34:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2e34405e-8ca3-4002-be0f-0a3c9ce594b8 req-e75ac03f-67b4-4f12-bd69-3af60c4f8d4b service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:34:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2e34405e-8ca3-4002-be0f-0a3c9ce594b8 req-e75ac03f-67b4-4f12-bd69-3af60c4f8d4b service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:34:38 user nova-compute[71229]: DEBUG nova.compute.manager [req-2e34405e-8ca3-4002-be0f-0a3c9ce594b8 req-e75ac03f-67b4-4f12-bd69-3af60c4f8d4b service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] No waiting events found dispatching network-vif-plugged-7485c140-3c08-4191-9929-3c41cb6fd725 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:34:38 user nova-compute[71229]: WARNING nova.compute.manager [req-2e34405e-8ca3-4002-be0f-0a3c9ce594b8 req-e75ac03f-67b4-4f12-bd69-3af60c4f8d4b service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received unexpected event network-vif-plugged-7485c140-3c08-4191-9929-3c41cb6fd725 for instance with vm_state active and task_state deleting.
Apr 11 15:34:38 user nova-compute[71229]: DEBUG nova.compute.manager [req-2e34405e-8ca3-4002-be0f-0a3c9ce594b8 req-e75ac03f-67b4-4f12-bd69-3af60c4f8d4b service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received event network-vif-unplugged-bf63f34a-3145-4251-a036-a35bd08ef45f {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:34:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2e34405e-8ca3-4002-be0f-0a3c9ce594b8 req-e75ac03f-67b4-4f12-bd69-3af60c4f8d4b service nova] Acquiring lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:34:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2e34405e-8ca3-4002-be0f-0a3c9ce594b8 req-e75ac03f-67b4-4f12-bd69-3af60c4f8d4b service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:34:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2e34405e-8ca3-4002-be0f-0a3c9ce594b8 req-e75ac03f-67b4-4f12-bd69-3af60c4f8d4b service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:34:38 user nova-compute[71229]: DEBUG nova.compute.manager [req-2e34405e-8ca3-4002-be0f-0a3c9ce594b8 req-e75ac03f-67b4-4f12-bd69-3af60c4f8d4b service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] No waiting events found dispatching network-vif-unplugged-bf63f34a-3145-4251-a036-a35bd08ef45f {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:34:38 user nova-compute[71229]: DEBUG nova.compute.manager [req-2e34405e-8ca3-4002-be0f-0a3c9ce594b8 req-e75ac03f-67b4-4f12-bd69-3af60c4f8d4b service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received event network-vif-unplugged-bf63f34a-3145-4251-a036-a35bd08ef45f for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 15:34:38 user nova-compute[71229]: DEBUG nova.compute.manager [req-2e34405e-8ca3-4002-be0f-0a3c9ce594b8 req-e75ac03f-67b4-4f12-bd69-3af60c4f8d4b service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received event network-vif-plugged-bf63f34a-3145-4251-a036-a35bd08ef45f {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:34:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2e34405e-8ca3-4002-be0f-0a3c9ce594b8 req-e75ac03f-67b4-4f12-bd69-3af60c4f8d4b service nova] Acquiring lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:34:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2e34405e-8ca3-4002-be0f-0a3c9ce594b8 req-e75ac03f-67b4-4f12-bd69-3af60c4f8d4b service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:34:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2e34405e-8ca3-4002-be0f-0a3c9ce594b8 req-e75ac03f-67b4-4f12-bd69-3af60c4f8d4b service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:34:38 user nova-compute[71229]: DEBUG nova.compute.manager [req-2e34405e-8ca3-4002-be0f-0a3c9ce594b8 req-e75ac03f-67b4-4f12-bd69-3af60c4f8d4b service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] No waiting events found dispatching network-vif-plugged-bf63f34a-3145-4251-a036-a35bd08ef45f {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:34:38 user nova-compute[71229]: WARNING nova.compute.manager [req-2e34405e-8ca3-4002-be0f-0a3c9ce594b8 req-e75ac03f-67b4-4f12-bd69-3af60c4f8d4b service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received unexpected event network-vif-plugged-bf63f34a-3145-4251-a036-a35bd08ef45f for instance with vm_state active and task_state deleting.
Apr 11 15:34:38 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Instance destroyed successfully.
Apr 11 15:34:38 user nova-compute[71229]: DEBUG nova.objects.instance [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lazy-loading 'resources' on Instance uuid fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T15:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1266828186',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1266828186',id=24,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrVMNOfvpNw0WxXnYb9GHoGjkGsVckNGNNSEeB0ystk/UW+bmvyI9JyrkIyp1aWJMJE8lx1rxmssoUoMpwQTPTewIcUxPaAcoIQfMD8tyeIllleUvA0Rxy5zvvcCtrC3Q==',key_name='tempest-keypair-1319177828',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:33:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7df6e56783b84282be0ca425358015dd',ramdisk_id='',reservation_id='r-w3y72isf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-341576311',owner_user_name='tempest-TaggedBootDevicesTest-341576311-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:33:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='645eeb4fbb2a46d09fd18eaf7de500d0',uuid=fa6dc9c1-6786-4c17-a23e-f71c21ac08a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7485c140-3c08-4191-9929-3c41cb6fd725", "address": "fa:16:3e:3a:3c:8e", "network": {"id": "e4b9e2d9-6b8e-4857-bd3e-19c5d7c80f69", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2926051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7485c140-3c", "ovs_interfaceid": "7485c140-3c08-4191-9929-3c41cb6fd725", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Converting VIF {"id": "7485c140-3c08-4191-9929-3c41cb6fd725", "address": "fa:16:3e:3a:3c:8e", "network": {"id": "e4b9e2d9-6b8e-4857-bd3e-19c5d7c80f69", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2926051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7485c140-3c", "ovs_interfaceid": "7485c140-3c08-4191-9929-3c41cb6fd725", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:3c:8e,bridge_name='br-int',has_traffic_filtering=True,id=7485c140-3c08-4191-9929-3c41cb6fd725,network=Network(e4b9e2d9-6b8e-4857-bd3e-19c5d7c80f69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7485c140-3c') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG os_vif [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:3c:8e,bridge_name='br-int',has_traffic_filtering=True,id=7485c140-3c08-4191-9929-3c41cb6fd725,network=Network(e4b9e2d9-6b8e-4857-bd3e-19c5d7c80f69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7485c140-3c') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7485c140-3c, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:39 user nova-compute[71229]: INFO os_vif [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:3c:8e,bridge_name='br-int',has_traffic_filtering=True,id=7485c140-3c08-4191-9929-3c41cb6fd725,network=Network(e4b9e2d9-6b8e-4857-bd3e-19c5d7c80f69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7485c140-3c')
Apr 11 15:34:39 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T15:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1266828186',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1266828186',id=24,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrVMNOfvpNw0WxXnYb9GHoGjkGsVckNGNNSEeB0ystk/UW+bmvyI9JyrkIyp1aWJMJE8lx1rxmssoUoMpwQTPTewIcUxPaAcoIQfMD8tyeIllleUvA0Rxy5zvvcCtrC3Q==',key_name='tempest-keypair-1319177828',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:33:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7df6e56783b84282be0ca425358015dd',ramdisk_id='',reservation_id='r-w3y72isf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-341576311',owner_user_name='tempest-TaggedBootDevicesTest-341576311-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:33:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='645eeb4fbb2a46d09fd18eaf7de500d0',uuid=fa6dc9c1-6786-4c17-a23e-f71c21ac08a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7d90fa1-965a-4cc7-bc48-64a43041af23", "address": "fa:16:3e:b2:3b:c0", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d90fa1-96", "ovs_interfaceid": "b7d90fa1-965a-4cc7-bc48-64a43041af23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Converting VIF {"id": "b7d90fa1-965a-4cc7-bc48-64a43041af23", "address": "fa:16:3e:b2:3b:c0", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d90fa1-96", "ovs_interfaceid": "b7d90fa1-965a-4cc7-bc48-64a43041af23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:3b:c0,bridge_name='br-int',has_traffic_filtering=True,id=b7d90fa1-965a-4cc7-bc48-64a43041af23,network=Network(69f124ac-e977-41ac-8d55-e156f042bab8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb7d90fa1-96') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG os_vif [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:3b:c0,bridge_name='br-int',has_traffic_filtering=True,id=b7d90fa1-965a-4cc7-bc48-64a43041af23,network=Network(69f124ac-e977-41ac-8d55-e156f042bab8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb7d90fa1-96') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7d90fa1-96, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:39 user nova-compute[71229]: INFO os_vif [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:3b:c0,bridge_name='br-int',has_traffic_filtering=True,id=b7d90fa1-965a-4cc7-bc48-64a43041af23,network=Network(69f124ac-e977-41ac-8d55-e156f042bab8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb7d90fa1-96')
Apr 11 15:34:39 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T15:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1266828186',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1266828186',id=24,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrVMNOfvpNw0WxXnYb9GHoGjkGsVckNGNNSEeB0ystk/UW+bmvyI9JyrkIyp1aWJMJE8lx1rxmssoUoMpwQTPTewIcUxPaAcoIQfMD8tyeIllleUvA0Rxy5zvvcCtrC3Q==',key_name='tempest-keypair-1319177828',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:33:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7df6e56783b84282be0ca425358015dd',ramdisk_id='',reservation_id='r-w3y72isf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-341576311',owner_user_name='tempest-TaggedBootDevicesTest-341576311-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:33:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='645eeb4fbb2a46d09fd18eaf7de500d0',uuid=fa6dc9c1-6786-4c17-a23e-f71c21ac08a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fafe4f73-4fc5-401b-a2bf-542bea23915f", "address": "fa:16:3e:e2:5f:81", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfafe4f73-4f", "ovs_interfaceid": "fafe4f73-4fc5-401b-a2bf-542bea23915f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Converting VIF {"id": "fafe4f73-4fc5-401b-a2bf-542bea23915f", "address": "fa:16:3e:e2:5f:81", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfafe4f73-4f", "ovs_interfaceid": "fafe4f73-4fc5-401b-a2bf-542bea23915f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:5f:81,bridge_name='br-int',has_traffic_filtering=True,id=fafe4f73-4fc5-401b-a2bf-542bea23915f,network=Network(69f124ac-e977-41ac-8d55-e156f042bab8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfafe4f73-4f') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG os_vif [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:5f:81,bridge_name='br-int',has_traffic_filtering=True,id=fafe4f73-4fc5-401b-a2bf-542bea23915f,network=Network(69f124ac-e977-41ac-8d55-e156f042bab8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfafe4f73-4f') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfafe4f73-4f, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:39 user nova-compute[71229]: INFO os_vif [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:5f:81,bridge_name='br-int',has_traffic_filtering=True,id=fafe4f73-4fc5-401b-a2bf-542bea23915f,network=Network(69f124ac-e977-41ac-8d55-e156f042bab8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfafe4f73-4f')
Apr 11 15:34:39 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T15:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1266828186',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1266828186',id=24,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrVMNOfvpNw0WxXnYb9GHoGjkGsVckNGNNSEeB0ystk/UW+bmvyI9JyrkIyp1aWJMJE8lx1rxmssoUoMpwQTPTewIcUxPaAcoIQfMD8tyeIllleUvA0Rxy5zvvcCtrC3Q==',key_name='tempest-keypair-1319177828',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:33:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7df6e56783b84282be0ca425358015dd',ramdisk_id='',reservation_id='r-w3y72isf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-341576311',owner_user_name='tempest-TaggedBootDevicesTest-341576311-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:33:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='645eeb4fbb2a46d09fd18eaf7de500d0',uuid=fa6dc9c1-6786-4c17-a23e-f71c21ac08a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "44becdbc-fa86-4dbe-ac1a-e0e01648513b", "address": "fa:16:3e:ed:b8:03", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44becdbc-fa", "ovs_interfaceid": "44becdbc-fa86-4dbe-ac1a-e0e01648513b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Converting VIF {"id": "44becdbc-fa86-4dbe-ac1a-e0e01648513b", "address": "fa:16:3e:ed:b8:03", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44becdbc-fa", "ovs_interfaceid": "44becdbc-fa86-4dbe-ac1a-e0e01648513b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:b8:03,bridge_name='br-int',has_traffic_filtering=True,id=44becdbc-fa86-4dbe-ac1a-e0e01648513b,network=Network(69f124ac-e977-41ac-8d55-e156f042bab8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44becdbc-fa') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG os_vif [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:b8:03,bridge_name='br-int',has_traffic_filtering=True,id=44becdbc-fa86-4dbe-ac1a-e0e01648513b,network=Network(69f124ac-e977-41ac-8d55-e156f042bab8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44becdbc-fa') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap44becdbc-fa, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:39 user nova-compute[71229]: INFO os_vif [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:b8:03,bridge_name='br-int',has_traffic_filtering=True,id=44becdbc-fa86-4dbe-ac1a-e0e01648513b,network=Network(69f124ac-e977-41ac-8d55-e156f042bab8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44becdbc-fa')
Apr 11 15:34:39 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T15:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1266828186',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1266828186',id=24,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrVMNOfvpNw0WxXnYb9GHoGjkGsVckNGNNSEeB0ystk/UW+bmvyI9JyrkIyp1aWJMJE8lx1rxmssoUoMpwQTPTewIcUxPaAcoIQfMD8tyeIllleUvA0Rxy5zvvcCtrC3Q==',key_name='tempest-keypair-1319177828',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:33:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7df6e56783b84282be0ca425358015dd',ramdisk_id='',reservation_id='r-w3y72isf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-341576311',owner_user_name='tempest-TaggedBootDevicesTest-341576311-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:33:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='645eeb4fbb2a46d09fd18eaf7de500d0',uuid=fa6dc9c1-6786-4c17-a23e-f71c21ac08a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf63f34a-3145-4251-a036-a35bd08ef45f", "address": "fa:16:3e:4a:ce:66", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf63f34a-31", "ovs_interfaceid": "bf63f34a-3145-4251-a036-a35bd08ef45f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Converting VIF {"id": "bf63f34a-3145-4251-a036-a35bd08ef45f", "address": "fa:16:3e:4a:ce:66", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf63f34a-31", "ovs_interfaceid": "bf63f34a-3145-4251-a036-a35bd08ef45f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:ce:66,bridge_name='br-int',has_traffic_filtering=True,id=bf63f34a-3145-4251-a036-a35bd08ef45f,network=Network(69f124ac-e977-41ac-8d55-e156f042bab8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf63f34a-31') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG os_vif [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:ce:66,bridge_name='br-int',has_traffic_filtering=True,id=bf63f34a-3145-4251-a036-a35bd08ef45f,network=Network(69f124ac-e977-41ac-8d55-e156f042bab8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf63f34a-31') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf63f34a-31, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:39 user nova-compute[71229]: INFO os_vif [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:ce:66,bridge_name='br-int',has_traffic_filtering=True,id=bf63f34a-3145-4251-a036-a35bd08ef45f,network=Network(69f124ac-e977-41ac-8d55-e156f042bab8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf63f34a-31')
Apr 11 15:34:39 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T15:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1266828186',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1266828186',id=24,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrVMNOfvpNw0WxXnYb9GHoGjkGsVckNGNNSEeB0ystk/UW+bmvyI9JyrkIyp1aWJMJE8lx1rxmssoUoMpwQTPTewIcUxPaAcoIQfMD8tyeIllleUvA0Rxy5zvvcCtrC3Q==',key_name='tempest-keypair-1319177828',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:33:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7df6e56783b84282be0ca425358015dd',ramdisk_id='',reservation_id='r-w3y72isf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-341576311',owner_user_name='tempest-TaggedBootDevicesTest-341576311-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:33:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='645eeb4fbb2a46d09fd18eaf7de500d0',uuid=fa6dc9c1-6786-4c17-a23e-f71c21ac08a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e5066fdb-ea6f-4df5-b185-56f1a0dbe539", "address": "fa:16:3e:5f:b5:3e", "network": {"id": "a08657fa-cfdb-4f36-b464-53fe53b857af", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819766267", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5066fdb-ea", "ovs_interfaceid": "e5066fdb-ea6f-4df5-b185-56f1a0dbe539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Converting VIF {"id": "e5066fdb-ea6f-4df5-b185-56f1a0dbe539", "address": "fa:16:3e:5f:b5:3e", "network": {"id": "a08657fa-cfdb-4f36-b464-53fe53b857af", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819766267", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5066fdb-ea", "ovs_interfaceid": "e5066fdb-ea6f-4df5-b185-56f1a0dbe539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:b5:3e,bridge_name='br-int',has_traffic_filtering=True,id=e5066fdb-ea6f-4df5-b185-56f1a0dbe539,network=Network(a08657fa-cfdb-4f36-b464-53fe53b857af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5066fdb-ea') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG os_vif [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:b5:3e,bridge_name='br-int',has_traffic_filtering=True,id=e5066fdb-ea6f-4df5-b185-56f1a0dbe539,network=Network(a08657fa-cfdb-4f36-b464-53fe53b857af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5066fdb-ea') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape5066fdb-ea, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:39 user nova-compute[71229]: INFO os_vif [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:b5:3e,bridge_name='br-int',has_traffic_filtering=True,id=e5066fdb-ea6f-4df5-b185-56f1a0dbe539,network=Network(a08657fa-cfdb-4f36-b464-53fe53b857af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5066fdb-ea')
Apr 11 15:34:39 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T15:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1266828186',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1266828186',id=24,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrVMNOfvpNw0WxXnYb9GHoGjkGsVckNGNNSEeB0ystk/UW+bmvyI9JyrkIyp1aWJMJE8lx1rxmssoUoMpwQTPTewIcUxPaAcoIQfMD8tyeIllleUvA0Rxy5zvvcCtrC3Q==',key_name='tempest-keypair-1319177828',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:33:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7df6e56783b84282be0ca425358015dd',ramdisk_id='',reservation_id='r-w3y72isf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-341576311',owner_user_name='tempest-TaggedBootDevicesTest-341576311-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:33:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='645eeb4fbb2a46d09fd18eaf7de500d0',uuid=fa6dc9c1-6786-4c17-a23e-f71c21ac08a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f", "address": "fa:16:3e:e7:ca:1c", "network": {"id": "a08657fa-cfdb-4f36-b464-53fe53b857af", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819766267", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00381a8-f9", "ovs_interfaceid": "b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Converting VIF {"id": "b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f", "address": "fa:16:3e:e7:ca:1c", "network": {"id": "a08657fa-cfdb-4f36-b464-53fe53b857af", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819766267", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00381a8-f9", "ovs_interfaceid": "b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ca:1c,bridge_name='br-int',has_traffic_filtering=True,id=b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f,network=Network(a08657fa-cfdb-4f36-b464-53fe53b857af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb00381a8-f9') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG os_vif [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ca:1c,bridge_name='br-int',has_traffic_filtering=True,id=b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f,network=Network(a08657fa-cfdb-4f36-b464-53fe53b857af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb00381a8-f9') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb00381a8-f9, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:34:39 user nova-compute[71229]: INFO os_vif [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ca:1c,bridge_name='br-int',has_traffic_filtering=True,id=b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f,network=Network(a08657fa-cfdb-4f36-b464-53fe53b857af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb00381a8-f9')
Apr 11 15:34:39 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GHxnRMyi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:34:39 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:34:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9ce944-4f45-484f-bafc-abce8f0aa21d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 15:34:39 user nova-compute[71229]: No targets found.
Apr 11 15:34:39 user nova-compute[71229]: iSNS:
Apr 11 15:34:39 user nova-compute[71229]: No targets found.
Apr 11 15:34:39 user nova-compute[71229]: STATIC:
Apr 11 15:34:39 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb
Apr 11 15:34:39 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:34:39 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:34:39 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452
Apr 11 15:34:39 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:34:39 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:34:39 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532
Apr 11 15:34:39 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:34:39 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:34:39 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4
Apr 11 15:34:39 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:34:39 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:34:39 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e
Apr 11 15:34:39 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:34:39 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:34:39 user nova-compute[71229]: FIRMWARE:
Apr 11 15:34:39 user nova-compute[71229]: No targets found.
Apr 11 15:34:39 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 15:34:39 user nova-compute[71229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 15:34:39 user nova-compute[71229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71229) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532', 0)] {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d70fdb-26a8-4542-aeb2-d3d677176bdc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[614732ca-bd79-48d4-ba63-fcc5a00a8a97]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:34:39 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:34:39 user nova-compute[71229]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 (non-flash)
Apr 11 15:34:39 user nova-compute[71229]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452 (non-flash)
Apr 11 15:34:39 user nova-compute[71229]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e (non-flash)
Apr 11 15:34:39 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:34:39 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:34:39 user nova-compute[71229]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 (non-flash)
Apr 11 15:34:39 user nova-compute[71229]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452 (non-flash)
Apr 11 15:34:39 user nova-compute[71229]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e (non-flash)
Apr 11 15:34:39 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb641be710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532'): ({'sde'}, set())}) {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Removing single pathed devices sde {{(pid=71229) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55b59df-f42f-4947-8540-08afd777f07b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ea0f67-6c8d-4a61-bde9-4ae5ad9c7067]: (4, ('ok\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Flushing IO for device /dev/sde {{(pid=71229) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[961c991c-aa91-430e-8e2a-ecba23555813]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71229) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG nova.compute.manager [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received event network-vif-plugged-b7d90fa1-965a-4cc7-bc48-64a43041af23 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] Acquiring lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG nova.compute.manager [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] No waiting events found dispatching network-vif-plugged-b7d90fa1-965a-4cc7-bc48-64a43041af23 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:34:39 user nova-compute[71229]: WARNING nova.compute.manager [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received unexpected event network-vif-plugged-b7d90fa1-965a-4cc7-bc48-64a43041af23 for instance with vm_state active and task_state deleting.
Apr 11 15:34:39 user nova-compute[71229]: DEBUG nova.compute.manager [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received event network-vif-unplugged-44becdbc-fa86-4dbe-ac1a-e0e01648513b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] Acquiring lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG nova.compute.manager [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] No waiting events found dispatching network-vif-unplugged-44becdbc-fa86-4dbe-ac1a-e0e01648513b {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG nova.compute.manager [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received event network-vif-unplugged-44becdbc-fa86-4dbe-ac1a-e0e01648513b for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG nova.compute.manager [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received event network-vif-plugged-44becdbc-fa86-4dbe-ac1a-e0e01648513b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] Acquiring lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG nova.compute.manager [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] No waiting events found dispatching network-vif-plugged-44becdbc-fa86-4dbe-ac1a-e0e01648513b {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:34:39 user nova-compute[71229]: WARNING nova.compute.manager [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received unexpected event network-vif-plugged-44becdbc-fa86-4dbe-ac1a-e0e01648513b for instance with vm_state active and task_state deleting.
Apr 11 15:34:39 user nova-compute[71229]: DEBUG nova.compute.manager [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received event network-vif-unplugged-e5066fdb-ea6f-4df5-b185-56f1a0dbe539 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] Acquiring lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG nova.compute.manager [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] No waiting events found dispatching network-vif-unplugged-e5066fdb-ea6f-4df5-b185-56f1a0dbe539 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG nova.compute.manager [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received event network-vif-unplugged-e5066fdb-ea6f-4df5-b185-56f1a0dbe539 for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG nova.compute.manager [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received event network-vif-plugged-e5066fdb-ea6f-4df5-b185-56f1a0dbe539 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] Acquiring lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG nova.compute.manager [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] No waiting events found dispatching network-vif-plugged-e5066fdb-ea6f-4df5-b185-56f1a0dbe539 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:34:39 user nova-compute[71229]: WARNING nova.compute.manager [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received unexpected event network-vif-plugged-e5066fdb-ea6f-4df5-b185-56f1a0dbe539 for instance with vm_state active and task_state deleting.
Apr 11 15:34:39 user nova-compute[71229]: DEBUG nova.compute.manager [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received event network-vif-unplugged-b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] Acquiring lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG nova.compute.manager [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] No waiting events found dispatching network-vif-unplugged-b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG nova.compute.manager [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received event network-vif-unplugged-b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG nova.compute.manager [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received event network-vif-plugged-b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] Acquiring lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG nova.compute.manager [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] No waiting events found dispatching network-vif-plugged-b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:34:39 user nova-compute[71229]: WARNING nova.compute.manager [req-e4a2884f-7eac-4c4a-a42b-e616408bef02 req-e8917b4b-5a03-492e-bc17-e86b05565be5 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received unexpected event network-vif-plugged-b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f for instance with vm_state active and task_state deleting.
Apr 11 15:34:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.127s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3877d4-48fd-4899-85c8-6bb8340a79af]: (4, ('1', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] SCSI volumes sde have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532')] {{(pid=71229) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.096s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a29a3b-3ad9-4dd9-874e-68ea1f728da5]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 -p 172.16.0.220:3260 --logout {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af733af-7090-4b1f-bc77-f5b36055a946]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532, portal: 172.16.0.220,3260]
Apr 11 15:34:39 user nova-compute[71229]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532, portal: 172.16.0.220,3260] successful.
Apr 11 15:34:39 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 -p 172.16.0.220:3260 --op delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08362a1c-0e13-45ed-84c9-e9bcb01bf532 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e26c010-695f-4a7b-b73e-3770ea197080]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.521s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] <== disconnect_volume: return (523ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:34:39 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xEbTZiPX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:34:40 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:34:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d79b6b1-0fbc-48bd-aabb-205d11830331]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 15:34:40 user nova-compute[71229]: No targets found.
Apr 11 15:34:40 user nova-compute[71229]: iSNS:
Apr 11 15:34:40 user nova-compute[71229]: No targets found.
Apr 11 15:34:40 user nova-compute[71229]: STATIC:
Apr 11 15:34:40 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb
Apr 11 15:34:40 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:34:40 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:34:40 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452
Apr 11 15:34:40 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:34:40 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:34:40 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4
Apr 11 15:34:40 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:34:40 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:34:40 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e
Apr 11 15:34:40 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:34:40 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:34:40 user nova-compute[71229]: FIRMWARE:
Apr 11 15:34:40 user nova-compute[71229]: No targets found.
Apr 11 15:34:40 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 15:34:40 user nova-compute[71229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 15:34:40 user nova-compute[71229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71229) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452', 0)] {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f3d4c8-db5f-4278-9eb6-fc9b2603309b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e19b26-ccfa-48cd-9dca-e8edaed2caad]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:34:40 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:34:40 user nova-compute[71229]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452 (non-flash)
Apr 11 15:34:40 user nova-compute[71229]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e (non-flash)
Apr 11 15:34:40 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:34:40 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:34:40 user nova-compute[71229]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452 (non-flash)
Apr 11 15:34:40 user nova-compute[71229]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e (non-flash)
Apr 11 15:34:40 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb641bf2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452'): ({'sdf'}, set())}) {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Removing single pathed devices sdf {{(pid=71229) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc7fd3a-3f5e-49d3-aeda-50f6ea340f6d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[334d9c28-f763-4a0d-a64b-08029803a37e]: (4, ('ok\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Flushing IO for device /dev/sdf {{(pid=71229) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[05bb9c5f-7801-4a9a-8bc3-ce1398f97df7]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71229) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.047s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8adec54-64f9-4540-b521-f99c5b114f6a]: (4, ('1', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] SCSI volumes sdf have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452')] {{(pid=71229) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25f6ead-4963-403d-9ea2-e148a8c77944]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452 -p 172.16.0.220:3260 --logout {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e591ad-3404-47fa-98b4-b2f30946be33]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452, portal: 172.16.0.220,3260]
Apr 11 15:34:40 user nova-compute[71229]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452, portal: 172.16.0.220,3260] successful.
Apr 11 15:34:40 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452 -p 172.16.0.220:3260 --op delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19a0b36e-cc56-4f19-904a-03c416d6a452 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b67165d-c9cd-4eaa-9a39-9e9f8f223408]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] <== disconnect_volume: return (324ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WJRPsMZd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:34:40 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:34:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ac1545-b90b-4257-8d8b-77139496a98d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 15:34:40 user nova-compute[71229]: No targets found.
Apr 11 15:34:40 user nova-compute[71229]: iSNS:
Apr 11 15:34:40 user nova-compute[71229]: No targets found.
Apr 11 15:34:40 user nova-compute[71229]: STATIC:
Apr 11 15:34:40 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb
Apr 11 15:34:40 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:34:40 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:34:40 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4
Apr 11 15:34:40 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:34:40 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:34:40 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e
Apr 11 15:34:40 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:34:40 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:34:40 user nova-compute[71229]: FIRMWARE:
Apr 11 15:34:40 user nova-compute[71229]: No targets found.
Apr 11 15:34:40 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 15:34:40 user nova-compute[71229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 15:34:40 user nova-compute[71229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71229) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e', 0)] {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e638239-9dc2-416c-bd56-4baf069e02e9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ff6c70-0463-4dcd-8b87-76938302c8bf]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:34:40 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:34:40 user nova-compute[71229]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e (non-flash)
Apr 11 15:34:40 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:34:40 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:34:40 user nova-compute[71229]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e (non-flash)
Apr 11 15:34:40 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb641bf2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e'): ({'sdg'}, set())}) {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Removing single pathed devices sdg {{(pid=71229) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb53bc9-5df1-4f36-ba5d-5eb1f9fda60e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9615d6-7b00-41d9-babc-4c4ebfa4686b]: (4, ('ok\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Flushing IO for device /dev/sdg {{(pid=71229) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e90e81-ca9e-4f05-ad76-904edd516f41]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71229) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.039s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[96bdbadd-04b3-4a92-8fb5-ed46bdf0c536]: (4, ('1', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] SCSI volumes sdg have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e')] {{(pid=71229) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d360e0a-c376-46ce-b168-412d3a2d8e38]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e -p 172.16.0.220:3260 --logout {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27d7b04-814d-4f7b-bee4-f9ed59821f5d]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e, portal: 172.16.0.220,3260]
Apr 11 15:34:40 user nova-compute[71229]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e, portal: 172.16.0.220,3260] successful.
Apr 11 15:34:40 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e -p 172.16.0.220:3260 --op delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0acddd31-7aa7-4ce3-8628-e562af3c393e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd343e5-a765-4c3e-9424-b647932369b7]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] <== disconnect_volume: return (304ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 15:34:40 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Deleting instance files /opt/stack/data/nova/instances/fa6dc9c1-6786-4c17-a23e-f71c21ac08a7_del
Apr 11 15:34:40 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Deletion of /opt/stack/data/nova/instances/fa6dc9c1-6786-4c17-a23e-f71c21ac08a7_del complete
Apr 11 15:34:40 user nova-compute[71229]: DEBUG nova.compute.manager [req-5e339efe-695b-49e5-a387-f903dd366800 req-7e312ad9-0d9a-438e-ad85-ec5b9fdc541b service nova] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Received event network-vif-plugged-dc2a981c-9e15-473f-8bd6-c4c312b107d1 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-5e339efe-695b-49e5-a387-f903dd366800 req-7e312ad9-0d9a-438e-ad85-ec5b9fdc541b service nova] Acquiring lock "f34c2249-840e-4475-87e6-648d173bc7ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-5e339efe-695b-49e5-a387-f903dd366800 req-7e312ad9-0d9a-438e-ad85-ec5b9fdc541b service nova] Lock "f34c2249-840e-4475-87e6-648d173bc7ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-5e339efe-695b-49e5-a387-f903dd366800 req-7e312ad9-0d9a-438e-ad85-ec5b9fdc541b service nova] Lock "f34c2249-840e-4475-87e6-648d173bc7ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG nova.compute.manager [req-5e339efe-695b-49e5-a387-f903dd366800 req-7e312ad9-0d9a-438e-ad85-ec5b9fdc541b service nova] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] No waiting events found dispatching network-vif-plugged-dc2a981c-9e15-473f-8bd6-c4c312b107d1 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:34:40 user nova-compute[71229]: WARNING nova.compute.manager [req-5e339efe-695b-49e5-a387-f903dd366800 req-7e312ad9-0d9a-438e-ad85-ec5b9fdc541b service nova] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Received unexpected event network-vif-plugged-dc2a981c-9e15-473f-8bd6-c4c312b107d1 for instance with vm_state building and task_state spawning.
Apr 11 15:34:40 user nova-compute[71229]: DEBUG nova.compute.manager [req-5e339efe-695b-49e5-a387-f903dd366800 req-7e312ad9-0d9a-438e-ad85-ec5b9fdc541b service nova] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Received event network-vif-plugged-dc2a981c-9e15-473f-8bd6-c4c312b107d1 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-5e339efe-695b-49e5-a387-f903dd366800 req-7e312ad9-0d9a-438e-ad85-ec5b9fdc541b service nova] Acquiring lock "f34c2249-840e-4475-87e6-648d173bc7ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-5e339efe-695b-49e5-a387-f903dd366800 req-7e312ad9-0d9a-438e-ad85-ec5b9fdc541b service nova] Lock "f34c2249-840e-4475-87e6-648d173bc7ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-5e339efe-695b-49e5-a387-f903dd366800 req-7e312ad9-0d9a-438e-ad85-ec5b9fdc541b service nova] Lock "f34c2249-840e-4475-87e6-648d173bc7ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG nova.compute.manager [req-5e339efe-695b-49e5-a387-f903dd366800 req-7e312ad9-0d9a-438e-ad85-ec5b9fdc541b service nova] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] No waiting events found dispatching network-vif-plugged-dc2a981c-9e15-473f-8bd6-c4c312b107d1 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:34:40 user nova-compute[71229]: WARNING nova.compute.manager [req-5e339efe-695b-49e5-a387-f903dd366800 req-7e312ad9-0d9a-438e-ad85-ec5b9fdc541b service nova] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Received unexpected event network-vif-plugged-dc2a981c-9e15-473f-8bd6-c4c312b107d1 for instance with vm_state building and task_state spawning.
Apr 11 15:34:40 user nova-compute[71229]: INFO nova.compute.manager [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Took 3.66 seconds to destroy the instance on the hypervisor.
Apr 11 15:34:40 user nova-compute[71229]: DEBUG oslo.service.loopingcall [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71229) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG nova.compute.manager [-] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Deallocating network for instance {{(pid=71229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 15:34:40 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] deallocate_for_instance() {{(pid=71229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 15:34:41 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227281.4986691, f34c2249-840e-4475-87e6-648d173bc7ed => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:34:41 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] VM Resumed (Lifecycle Event)
Apr 11 15:34:41 user nova-compute[71229]: DEBUG nova.compute.manager [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 15:34:41 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Guest created on hypervisor {{(pid=71229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 15:34:41 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:34:41 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Instance spawned successfully.
Apr 11 15:34:41 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 15:34:41 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:34:41 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Found default for hw_input_bus of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:34:41 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Found default for hw_pointer_model of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:34:41 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:34:41 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227281.499064, f34c2249-840e-4475-87e6-648d173bc7ed => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:34:41 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] VM Started (Lifecycle Event)
Apr 11 15:34:41 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:34:41 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:34:41 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:34:41 user nova-compute[71229]: INFO nova.compute.manager [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Took 7.38 seconds to spawn the instance on the hypervisor.
Apr 11 15:34:41 user nova-compute[71229]: DEBUG nova.compute.manager [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:34:41 user nova-compute[71229]: INFO nova.compute.manager [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Took 8.61 seconds to build instance.
Apr 11 15:34:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-69a12e99-d02c-49cc-bbb7-6383df903a18 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "f34c2249-840e-4475-87e6-648d173bc7ed" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.735s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:34:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:43 user nova-compute[71229]: DEBUG nova.compute.manager [req-84f758ad-bedc-4844-a0cf-c5b2e633036b req-c5dbdbbe-2e31-4e04-9753-003dd561b90d service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received event network-vif-deleted-b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:34:43 user nova-compute[71229]: INFO nova.compute.manager [req-84f758ad-bedc-4844-a0cf-c5b2e633036b req-c5dbdbbe-2e31-4e04-9753-003dd561b90d service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Neutron deleted interface b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f; detaching it from the instance and deleting it from the info cache
Apr 11 15:34:43 user nova-compute[71229]: DEBUG nova.network.neutron [req-84f758ad-bedc-4844-a0cf-c5b2e633036b req-c5dbdbbe-2e31-4e04-9753-003dd561b90d service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Updating instance_info_cache with network_info: [{"id": "7485c140-3c08-4191-9929-3c41cb6fd725", "address": "fa:16:3e:3a:3c:8e", "network": {"id": "e4b9e2d9-6b8e-4857-bd3e-19c5d7c80f69", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2926051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7485c140-3c", "ovs_interfaceid": "7485c140-3c08-4191-9929-3c41cb6fd725", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b7d90fa1-965a-4cc7-bc48-64a43041af23", "address": "fa:16:3e:b2:3b:c0", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d90fa1-96", "ovs_interfaceid": "b7d90fa1-965a-4cc7-bc48-64a43041af23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fafe4f73-4fc5-401b-a2bf-542bea23915f", "address": "fa:16:3e:e2:5f:81", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfafe4f73-4f", "ovs_interfaceid": "fafe4f73-4fc5-401b-a2bf-542bea23915f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "44becdbc-fa86-4dbe-ac1a-e0e01648513b", "address": "fa:16:3e:ed:b8:03", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44becdbc-fa", "ovs_interfaceid": "44becdbc-fa86-4dbe-ac1a-e0e01648513b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bf63f34a-3145-4251-a036-a35bd08ef45f", "address": "fa:16:3e:4a:ce:66", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf63f34a-31", "ovs_interfaceid": "bf63f34a-3145-4251-a036-a35bd08ef45f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e5066fdb-ea6f-4df5-b185-56f1a0dbe539", "address": "fa:16:3e:5f:b5:3e", "network": {"id": "a08657fa-cfdb-4f36-b464-53fe53b857af", "bridge": "br-int", "label": "tempest-device-tagging-net2-1819766267", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5066fdb-ea", "ovs_interfaceid": "e5066fdb-ea6f-4df5-b185-56f1a0dbe539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:34:43 user nova-compute[71229]: DEBUG nova.compute.manager [req-84f758ad-bedc-4844-a0cf-c5b2e633036b req-c5dbdbbe-2e31-4e04-9753-003dd561b90d service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Detach interface failed, port_id=b00381a8-f94c-4ce6-a7f0-1e32f8ff3c1f, reason: Instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 could not be found. {{(pid=71229) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 15:34:43 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:44 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:45 user nova-compute[71229]: DEBUG nova.compute.manager [req-1b013d06-8606-445b-9ea5-a26a49e95035 req-31889860-bdb1-4f16-9fdd-dbafc5db4a70 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received event network-vif-deleted-e5066fdb-ea6f-4df5-b185-56f1a0dbe539 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:34:45 user nova-compute[71229]: INFO nova.compute.manager [req-1b013d06-8606-445b-9ea5-a26a49e95035 req-31889860-bdb1-4f16-9fdd-dbafc5db4a70 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Neutron deleted interface e5066fdb-ea6f-4df5-b185-56f1a0dbe539; detaching it from the instance and deleting it from the info cache
Apr 11 15:34:45 user nova-compute[71229]: DEBUG nova.network.neutron [req-1b013d06-8606-445b-9ea5-a26a49e95035 req-31889860-bdb1-4f16-9fdd-dbafc5db4a70 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Updating instance_info_cache with network_info: [{"id": "7485c140-3c08-4191-9929-3c41cb6fd725", "address": "fa:16:3e:3a:3c:8e", "network": {"id": "e4b9e2d9-6b8e-4857-bd3e-19c5d7c80f69", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2926051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7485c140-3c", "ovs_interfaceid": "7485c140-3c08-4191-9929-3c41cb6fd725", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b7d90fa1-965a-4cc7-bc48-64a43041af23", "address": "fa:16:3e:b2:3b:c0", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d90fa1-96", "ovs_interfaceid": "b7d90fa1-965a-4cc7-bc48-64a43041af23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fafe4f73-4fc5-401b-a2bf-542bea23915f", "address": "fa:16:3e:e2:5f:81", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfafe4f73-4f", "ovs_interfaceid": "fafe4f73-4fc5-401b-a2bf-542bea23915f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "44becdbc-fa86-4dbe-ac1a-e0e01648513b", "address": "fa:16:3e:ed:b8:03", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44becdbc-fa", "ovs_interfaceid": "44becdbc-fa86-4dbe-ac1a-e0e01648513b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bf63f34a-3145-4251-a036-a35bd08ef45f", "address": "fa:16:3e:4a:ce:66", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf63f34a-31", "ovs_interfaceid": "bf63f34a-3145-4251-a036-a35bd08ef45f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:34:45 user nova-compute[71229]: DEBUG nova.compute.manager [req-1b013d06-8606-445b-9ea5-a26a49e95035 req-31889860-bdb1-4f16-9fdd-dbafc5db4a70 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Detach interface failed, port_id=e5066fdb-ea6f-4df5-b185-56f1a0dbe539, reason: Instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 could not be found. {{(pid=71229) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 15:34:45 user nova-compute[71229]: DEBUG nova.compute.manager [req-1b013d06-8606-445b-9ea5-a26a49e95035 req-31889860-bdb1-4f16-9fdd-dbafc5db4a70 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received event network-vif-deleted-7485c140-3c08-4191-9929-3c41cb6fd725 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:34:45 user nova-compute[71229]: INFO nova.compute.manager [req-1b013d06-8606-445b-9ea5-a26a49e95035 req-31889860-bdb1-4f16-9fdd-dbafc5db4a70 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Neutron deleted interface 7485c140-3c08-4191-9929-3c41cb6fd725; detaching it from the instance and deleting it from the info cache
Apr 11 15:34:45 user nova-compute[71229]: DEBUG nova.network.neutron [req-1b013d06-8606-445b-9ea5-a26a49e95035 req-31889860-bdb1-4f16-9fdd-dbafc5db4a70 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Updating instance_info_cache with network_info: [{"id": "b7d90fa1-965a-4cc7-bc48-64a43041af23", "address": "fa:16:3e:b2:3b:c0", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d90fa1-96", "ovs_interfaceid": "b7d90fa1-965a-4cc7-bc48-64a43041af23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fafe4f73-4fc5-401b-a2bf-542bea23915f", "address": "fa:16:3e:e2:5f:81", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfafe4f73-4f", "ovs_interfaceid": "fafe4f73-4fc5-401b-a2bf-542bea23915f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "44becdbc-fa86-4dbe-ac1a-e0e01648513b", "address": "fa:16:3e:ed:b8:03", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44becdbc-fa", "ovs_interfaceid": "44becdbc-fa86-4dbe-ac1a-e0e01648513b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bf63f34a-3145-4251-a036-a35bd08ef45f", "address": "fa:16:3e:4a:ce:66", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf63f34a-31", "ovs_interfaceid": "bf63f34a-3145-4251-a036-a35bd08ef45f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:34:45 user nova-compute[71229]: DEBUG nova.compute.manager [req-1b013d06-8606-445b-9ea5-a26a49e95035 req-31889860-bdb1-4f16-9fdd-dbafc5db4a70 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Detach interface failed, port_id=7485c140-3c08-4191-9929-3c41cb6fd725, reason: Instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 could not be found. {{(pid=71229) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 15:34:45 user nova-compute[71229]: DEBUG nova.compute.manager [req-1b013d06-8606-445b-9ea5-a26a49e95035 req-31889860-bdb1-4f16-9fdd-dbafc5db4a70 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received event network-vif-deleted-bf63f34a-3145-4251-a036-a35bd08ef45f {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:34:45 user nova-compute[71229]: INFO nova.compute.manager [req-1b013d06-8606-445b-9ea5-a26a49e95035 req-31889860-bdb1-4f16-9fdd-dbafc5db4a70 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Neutron deleted interface bf63f34a-3145-4251-a036-a35bd08ef45f; detaching it from the instance and deleting it from the info cache
Apr 11 15:34:45 user nova-compute[71229]: DEBUG nova.network.neutron [req-1b013d06-8606-445b-9ea5-a26a49e95035 req-31889860-bdb1-4f16-9fdd-dbafc5db4a70 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Updating instance_info_cache with network_info: [{"id": "b7d90fa1-965a-4cc7-bc48-64a43041af23", "address": "fa:16:3e:b2:3b:c0", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d90fa1-96", "ovs_interfaceid": "b7d90fa1-965a-4cc7-bc48-64a43041af23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fafe4f73-4fc5-401b-a2bf-542bea23915f", "address": "fa:16:3e:e2:5f:81", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfafe4f73-4f", "ovs_interfaceid": "fafe4f73-4fc5-401b-a2bf-542bea23915f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "44becdbc-fa86-4dbe-ac1a-e0e01648513b", "address": "fa:16:3e:ed:b8:03", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44becdbc-fa", "ovs_interfaceid": "44becdbc-fa86-4dbe-ac1a-e0e01648513b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:34:45 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:34:45 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Took 4.53 seconds to deallocate network for instance.
Apr 11 15:34:45 user nova-compute[71229]: DEBUG nova.compute.manager [req-1b013d06-8606-445b-9ea5-a26a49e95035 req-31889860-bdb1-4f16-9fdd-dbafc5db4a70 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Detach interface failed, port_id=bf63f34a-3145-4251-a036-a35bd08ef45f, reason: Instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 could not be found. {{(pid=71229) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 15:34:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:47 user nova-compute[71229]: DEBUG nova.compute.manager [req-7e10fd6c-c446-47a8-9f28-b52ad9d3b89e req-0d3f5f64-b1e5-4e07-9721-fd63011d2129 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Received event network-vif-deleted-44becdbc-fa86-4dbe-ac1a-e0e01648513b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:34:47 user nova-compute[71229]: INFO nova.compute.manager [req-7e10fd6c-c446-47a8-9f28-b52ad9d3b89e req-0d3f5f64-b1e5-4e07-9721-fd63011d2129 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Neutron deleted interface 44becdbc-fa86-4dbe-ac1a-e0e01648513b; detaching it from the instance and deleting it from the info cache
Apr 11 15:34:47 user nova-compute[71229]: DEBUG nova.network.neutron [req-7e10fd6c-c446-47a8-9f28-b52ad9d3b89e req-0d3f5f64-b1e5-4e07-9721-fd63011d2129 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Updating instance_info_cache with network_info: [{"id": "b7d90fa1-965a-4cc7-bc48-64a43041af23", "address": "fa:16:3e:b2:3b:c0", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d90fa1-96", "ovs_interfaceid": "b7d90fa1-965a-4cc7-bc48-64a43041af23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fafe4f73-4fc5-401b-a2bf-542bea23915f", "address": "fa:16:3e:e2:5f:81", "network": {"id": "69f124ac-e977-41ac-8d55-e156f042bab8", "bridge": "br-int", "label": "tempest-device-tagging-net1-662958692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7df6e56783b84282be0ca425358015dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfafe4f73-4f", "ovs_interfaceid": "fafe4f73-4fc5-401b-a2bf-542bea23915f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:34:47 user nova-compute[71229]: DEBUG nova.compute.manager [req-7e10fd6c-c446-47a8-9f28-b52ad9d3b89e req-0d3f5f64-b1e5-4e07-9721-fd63011d2129 service nova] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Detach interface failed, port_id=44becdbc-fa86-4dbe-ac1a-e0e01648513b, reason: Instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 could not be found. {{(pid=71229) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 15:34:47 user nova-compute[71229]: INFO nova.compute.manager [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Took 2.59 seconds to detach 3 volumes for instance.
Apr 11 15:34:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:34:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:34:48 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:34:48 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:34:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.288s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:34:48 user nova-compute[71229]: INFO nova.scheduler.client.report [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Deleted allocations for instance fa6dc9c1-6786-4c17-a23e-f71c21ac08a7
Apr 11 15:34:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-79e448b2-0d38-4588-bdf7-1294cedcbcaf tempest-TaggedBootDevicesTest-341576311 tempest-TaggedBootDevicesTest-341576311-project-member] Lock "fa6dc9c1-6786-4c17-a23e-f71c21ac08a7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.282s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:34:48 user nova-compute[71229]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681227273.3753467, 6a805345-374c-4326-9e8f-39bfc7947a35 => Stopped> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:34:48 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] VM Stopped (Lifecycle Event)
Apr 11 15:34:48 user nova-compute[71229]: DEBUG nova.compute.manager [None req-82b2b0f7-d3ad-4fcb-928e-95c69ec381f0 None None] [instance: 6a805345-374c-4326-9e8f-39bfc7947a35] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:34:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:51 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:53 user nova-compute[71229]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681227278.9888399, fa6dc9c1-6786-4c17-a23e-f71c21ac08a7 => Stopped> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:34:53 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] VM Stopped (Lifecycle Event)
Apr 11 15:34:54 user nova-compute[71229]: DEBUG nova.compute.manager [None req-7cbe499a-8976-4153-abd6-811ee6b60d73 None None] [instance: fa6dc9c1-6786-4c17-a23e-f71c21ac08a7] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:34:54 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:58 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:34:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:34:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:34:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:34:58 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 15:34:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:59 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:34:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:59 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:34:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85658a44-9ff2-4553-b9fd-686bf35fd6ec/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85658a44-9ff2-4553-b9fd-686bf35fd6ec/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85658a44-9ff2-4553-b9fd-686bf35fd6ec/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85658a44-9ff2-4553-b9fd-686bf35fd6ec/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f34c2249-840e-4475-87e6-648d173bc7ed/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:34:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f34c2249-840e-4475-87e6-648d173bc7ed/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:34:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f34c2249-840e-4475-87e6-648d173bc7ed/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:35:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f34c2249-840e-4475-87e6-648d173bc7ed/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:35:00 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:35:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d09cda86-eca1-4c42-8654-758eb6cd30e0/disk.rescue --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:35:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d09cda86-eca1-4c42-8654-758eb6cd30e0/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:35:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d09cda86-eca1-4c42-8654-758eb6cd30e0/disk.rescue --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:35:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d09cda86-eca1-4c42-8654-758eb6cd30e0/disk.rescue --force-share --output=json" returned: 0 in 0.153s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:35:00 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:35:00 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:35:00 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8243MB free_disk=25.942035675048828GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 15:35:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:35:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:35:00 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance de1a45fd-27be-4438-80a4-2f3a100643c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:35:00 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance b0d90fd2-6a95-43c4-8756-e82071d99154 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:35:00 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 7c4329ae-07cb-4f28-9fd6-29b398517d2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:35:00 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 85658a44-9ff2-4553-b9fd-686bf35fd6ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:35:00 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance d09cda86-eca1-4c42-8654-758eb6cd30e0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:35:00 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance f34c2249-840e-4475-87e6-648d173bc7ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:35:00 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 15:35:00 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=1280MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 15:35:01 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:35:01 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:35:01 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 15:35:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.370s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:35:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:04 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:35:04 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:35:04 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:35:04 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:35:04 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:35:04 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:35:04 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:35:04 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 15:35:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:04 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:35:04 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 15:35:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "refresh_cache-7c4329ae-07cb-4f28-9fd6-29b398517d2b" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:35:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquired lock "refresh_cache-7c4329ae-07cb-4f28-9fd6-29b398517d2b" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:35:04 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Forcefully refreshing network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 15:35:05 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Updating instance_info_cache with network_info: [{"id": "37d248cb-99ae-4dcd-adfe-46bce9920d3e", "address": "fa:16:3e:c2:89:8a", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d248cb-99", "ovs_interfaceid": "37d248cb-99ae-4dcd-adfe-46bce9920d3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:35:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Releasing lock "refresh_cache-7c4329ae-07cb-4f28-9fd6-29b398517d2b" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:35:05 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Updated the network info_cache for instance {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 15:35:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:08 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:35:09 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:11 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ffc25fc1-e59f-42c8-a371-b4b12e17fd59" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:35:11 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ffc25fc1-e59f-42c8-a371-b4b12e17fd59" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:35:11 user nova-compute[71229]: INFO nova.compute.manager [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Unshelving
Apr 11 15:35:11 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:35:11 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:35:11 user nova-compute[71229]: DEBUG nova.objects.instance [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lazy-loading 'pci_requests' on Instance uuid ffc25fc1-e59f-42c8-a371-b4b12e17fd59 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:35:11 user nova-compute[71229]: DEBUG nova.objects.instance [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lazy-loading 'numa_topology' on Instance uuid ffc25fc1-e59f-42c8-a371-b4b12e17fd59 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:35:11 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 15:35:11 user nova-compute[71229]: INFO nova.compute.claims [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Claim successful on node user
Apr 11 15:35:11 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:35:11 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:35:11 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.349s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:35:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:11 user nova-compute[71229]: INFO nova.network.neutron [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Updating port 3ae0cd28-c459-47b7-be17-133b69773f9c with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 11 15:35:12 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "refresh_cache-ffc25fc1-e59f-42c8-a371-b4b12e17fd59" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:35:12 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquired lock "refresh_cache-ffc25fc1-e59f-42c8-a371-b4b12e17fd59" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:35:12 user nova-compute[71229]: DEBUG nova.network.neutron [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:35:12 user nova-compute[71229]: DEBUG nova.compute.manager [req-8e7cfb3c-cd70-424f-a619-9df113476345 req-a463f2db-a5a9-4df2-bc24-dc1b7bf9cc21 service nova] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Received event network-changed-3ae0cd28-c459-47b7-be17-133b69773f9c {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:35:12 user nova-compute[71229]: DEBUG nova.compute.manager [req-8e7cfb3c-cd70-424f-a619-9df113476345 req-a463f2db-a5a9-4df2-bc24-dc1b7bf9cc21 service nova] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Refreshing instance network info cache due to event network-changed-3ae0cd28-c459-47b7-be17-133b69773f9c. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:35:12 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-8e7cfb3c-cd70-424f-a619-9df113476345 req-a463f2db-a5a9-4df2-bc24-dc1b7bf9cc21 service nova] Acquiring lock "refresh_cache-ffc25fc1-e59f-42c8-a371-b4b12e17fd59" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:35:13 user nova-compute[71229]: DEBUG nova.network.neutron [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Updating instance_info_cache with network_info: [{"id": "3ae0cd28-c459-47b7-be17-133b69773f9c", "address": "fa:16:3e:b9:69:19", "network": {"id": "15a1a586-0100-4057-8501-5c5a282d4063", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834988552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b9b79fb98441fd9f1b5df54471f0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae0cd28-c4", "ovs_interfaceid": "3ae0cd28-c459-47b7-be17-133b69773f9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:35:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Releasing lock "refresh_cache-ffc25fc1-e59f-42c8-a371-b4b12e17fd59" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:35:13 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Creating instance directory {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 15:35:13 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Creating image(s)
Apr 11 15:35:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "/opt/stack/data/nova/instances/ffc25fc1-e59f-42c8-a371-b4b12e17fd59/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:35:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "/opt/stack/data/nova/instances/ffc25fc1-e59f-42c8-a371-b4b12e17fd59/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:35:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "/opt/stack/data/nova/instances/ffc25fc1-e59f-42c8-a371-b4b12e17fd59/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:35:13 user nova-compute[71229]: DEBUG nova.objects.instance [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lazy-loading 'trusted_certs' on Instance uuid ffc25fc1-e59f-42c8-a371-b4b12e17fd59 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:35:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-8e7cfb3c-cd70-424f-a619-9df113476345 req-a463f2db-a5a9-4df2-bc24-dc1b7bf9cc21 service nova] Acquired lock "refresh_cache-ffc25fc1-e59f-42c8-a371-b4b12e17fd59" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:35:13 user nova-compute[71229]: DEBUG nova.network.neutron [req-8e7cfb3c-cd70-424f-a619-9df113476345 req-a463f2db-a5a9-4df2-bc24-dc1b7bf9cc21 service nova] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Refreshing network info cache for port 3ae0cd28-c459-47b7-be17-133b69773f9c {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:35:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "38c584cca3c5ffb4989f409824cec94a15e6f5da" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:35:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "38c584cca3c5ffb4989f409824cec94a15e6f5da" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:35:14 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38c584cca3c5ffb4989f409824cec94a15e6f5da.part --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:35:14 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38c584cca3c5ffb4989f409824cec94a15e6f5da.part --force-share --output=json" returned: 0 in 0.140s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:35:14 user nova-compute[71229]: DEBUG nova.virt.images [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] 37770c03-60d7-4c48-b5b9-8b5fb0e7e81c was qcow2, converting to raw {{(pid=71229) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 15:35:14 user nova-compute[71229]: DEBUG nova.privsep.utils [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71229) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 15:35:14 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/38c584cca3c5ffb4989f409824cec94a15e6f5da.part /opt/stack/data/nova/instances/_base/38c584cca3c5ffb4989f409824cec94a15e6f5da.converted {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:35:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:14 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/38c584cca3c5ffb4989f409824cec94a15e6f5da.part /opt/stack/data/nova/instances/_base/38c584cca3c5ffb4989f409824cec94a15e6f5da.converted" returned: 0 in 0.260s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:35:14 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38c584cca3c5ffb4989f409824cec94a15e6f5da.converted --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:35:14 user nova-compute[71229]: DEBUG nova.network.neutron [req-8e7cfb3c-cd70-424f-a619-9df113476345 req-a463f2db-a5a9-4df2-bc24-dc1b7bf9cc21 service nova] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Updated VIF entry in instance network info cache for port 3ae0cd28-c459-47b7-be17-133b69773f9c. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:35:14 user nova-compute[71229]: DEBUG nova.network.neutron [req-8e7cfb3c-cd70-424f-a619-9df113476345 req-a463f2db-a5a9-4df2-bc24-dc1b7bf9cc21 service nova] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Updating instance_info_cache with network_info: [{"id": "3ae0cd28-c459-47b7-be17-133b69773f9c", "address": "fa:16:3e:b9:69:19", "network": {"id": "15a1a586-0100-4057-8501-5c5a282d4063", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834988552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b9b79fb98441fd9f1b5df54471f0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae0cd28-c4", "ovs_interfaceid": "3ae0cd28-c459-47b7-be17-133b69773f9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:35:14 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-8e7cfb3c-cd70-424f-a619-9df113476345 req-a463f2db-a5a9-4df2-bc24-dc1b7bf9cc21 service nova] Releasing lock "refresh_cache-ffc25fc1-e59f-42c8-a371-b4b12e17fd59" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:35:14 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38c584cca3c5ffb4989f409824cec94a15e6f5da.converted --force-share --output=json" returned: 0 in 0.147s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:35:14 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "38c584cca3c5ffb4989f409824cec94a15e6f5da" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.359s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:35:14 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38c584cca3c5ffb4989f409824cec94a15e6f5da --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:35:14 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38c584cca3c5ffb4989f409824cec94a15e6f5da --force-share --output=json" returned: 0 in 0.142s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:35:14 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "38c584cca3c5ffb4989f409824cec94a15e6f5da" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:35:14 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "38c584cca3c5ffb4989f409824cec94a15e6f5da" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:35:14 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38c584cca3c5ffb4989f409824cec94a15e6f5da --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:35:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38c584cca3c5ffb4989f409824cec94a15e6f5da --force-share --output=json" returned: 0 in 0.134s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:35:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38c584cca3c5ffb4989f409824cec94a15e6f5da,backing_fmt=raw /opt/stack/data/nova/instances/ffc25fc1-e59f-42c8-a371-b4b12e17fd59/disk 1073741824 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:35:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38c584cca3c5ffb4989f409824cec94a15e6f5da,backing_fmt=raw /opt/stack/data/nova/instances/ffc25fc1-e59f-42c8-a371-b4b12e17fd59/disk 1073741824" returned: 0 in 0.055s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:35:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "38c584cca3c5ffb4989f409824cec94a15e6f5da" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:35:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38c584cca3c5ffb4989f409824cec94a15e6f5da --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:35:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38c584cca3c5ffb4989f409824cec94a15e6f5da --force-share --output=json" returned: 0 in 0.142s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:35:15 user nova-compute[71229]: DEBUG nova.objects.instance [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lazy-loading 'migration_context' on Instance uuid ffc25fc1-e59f-42c8-a371-b4b12e17fd59 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:35:15 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Rebasing disk image.
Apr 11 15:35:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:35:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.130s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:35:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a -F raw /opt/stack/data/nova/instances/ffc25fc1-e59f-42c8-a371-b4b12e17fd59/disk {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:35:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a -F raw /opt/stack/data/nova/instances/ffc25fc1-e59f-42c8-a371-b4b12e17fd59/disk" returned: 0 in 2.069s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:35:17 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Created local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 15:35:17 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Ensure instance console log exists: /opt/stack/data/nova/instances/ffc25fc1-e59f-42c8-a371-b4b12e17fd59/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 15:35:17 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:35:17 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:35:17 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:35:17 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Start _get_guest_xml network_info=[{"id": "3ae0cd28-c459-47b7-be17-133b69773f9c", "address": "fa:16:3e:b9:69:19", "network": {"id": "15a1a586-0100-4057-8501-5c5a282d4063", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834988552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b9b79fb98441fd9f1b5df54471f0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae0cd28-c4", "ovs_interfaceid": "3ae0cd28-c459-47b7-be17-133b69773f9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='89e04bcdaffcdc497feac9c7ed5ec710',container_format='bare',created_at=2023-04-11T15:33:19Z,direct_url=<?>,disk_format='qcow2',id=37770c03-60d7-4c48-b5b9-8b5fb0e7e81c,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1714025063-shelved',owner='63b9b79fb98441fd9f1b5df54471f0bd',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-11T15:33:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '52fe638c-5ada-47d5-b376-233bfa808a37'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:35:17 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:35:17 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:35:17 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:35:17 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='89e04bcdaffcdc497feac9c7ed5ec710',container_format='bare',created_at=2023-04-11T15:33:19Z,direct_url=<?>,disk_format='qcow2',id=37770c03-60d7-4c48-b5b9-8b5fb0e7e81c,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1714025063-shelved',owner='63b9b79fb98441fd9f1b5df54471f0bd',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-11T15:33:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:35:17 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:35:17 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:35:17 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:35:17 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:35:17 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:35:17 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:35:17 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:35:17 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:35:17 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:35:17 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:35:17 user nova-compute[71229]: DEBUG nova.objects.instance [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lazy-loading 'vcpu_model' on Instance uuid ffc25fc1-e59f-42c8-a371-b4b12e17fd59 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:35:17 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T15:31:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1714025063',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1714025063',id=21,image_ref='37770c03-60d7-4c48-b5b9-8b5fb0e7e81c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1917410281',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:31:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='63b9b79fb98441fd9f1b5df54471f0bd',ramdisk_id='',reservation_id='r-kzb2xrpd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1785499036',owner_user_name='tempest-AttachVolumeShelveTestJSON-1785499036-project-member',shelved_at='2023-04-11T15:33:22.236297',shelved_host='user',shelved_image_id='37770c03-60d7-4c48-b5b9-8b5fb0e7e81c'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:35:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88d988d9ce0a41669b7c487ac07b4cfe',uuid=ffc25fc1-e59f-42c8-a371-b4b12e17fd59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3ae0cd28-c459-47b7-be17-133b69773f9c", "address": "fa:16:3e:b9:69:19", "network": {"id": "15a1a586-0100-4057-8501-5c5a282d4063", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834988552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b9b79fb98441fd9f1b5df54471f0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae0cd28-c4", "ovs_interfaceid": "3ae0cd28-c459-47b7-be17-133b69773f9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:35:17 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Converting VIF {"id": "3ae0cd28-c459-47b7-be17-133b69773f9c", "address": "fa:16:3e:b9:69:19", "network": {"id": "15a1a586-0100-4057-8501-5c5a282d4063", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834988552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b9b79fb98441fd9f1b5df54471f0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae0cd28-c4", "ovs_interfaceid": "3ae0cd28-c459-47b7-be17-133b69773f9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:35:17 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:69:19,bridge_name='br-int',has_traffic_filtering=True,id=3ae0cd28-c459-47b7-be17-133b69773f9c,network=Network(15a1a586-0100-4057-8501-5c5a282d4063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ae0cd28-c4') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:35:17 user nova-compute[71229]: DEBUG nova.objects.instance [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lazy-loading 'pci_devices' on Instance uuid ffc25fc1-e59f-42c8-a371-b4b12e17fd59 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:35:17 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:35:17 user nova-compute[71229]:   <uuid>ffc25fc1-e59f-42c8-a371-b4b12e17fd59</uuid>
Apr 11 15:35:17 user nova-compute[71229]:   <name>instance-00000015</name>
Apr 11 15:35:17 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:35:17 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:35:17 user nova-compute[71229]:   <metadata>
Apr 11 15:35:17 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:35:17 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:35:17 user nova-compute[71229]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1714025063</nova:name>
Apr 11 15:35:17 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:35:17</nova:creationTime>
Apr 11 15:35:17 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:35:17 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:35:17 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:35:17 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:35:17 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:35:17 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:35:17 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:35:17 user nova-compute[71229]:       <nova:owner>
Apr 11 15:35:17 user nova-compute[71229]:         <nova:user uuid="88d988d9ce0a41669b7c487ac07b4cfe">tempest-AttachVolumeShelveTestJSON-1785499036-project-member</nova:user>
Apr 11 15:35:17 user nova-compute[71229]:         <nova:project uuid="63b9b79fb98441fd9f1b5df54471f0bd">tempest-AttachVolumeShelveTestJSON-1785499036</nova:project>
Apr 11 15:35:17 user nova-compute[71229]:       </nova:owner>
Apr 11 15:35:17 user nova-compute[71229]:       <nova:root type="image" uuid="37770c03-60d7-4c48-b5b9-8b5fb0e7e81c"/>
Apr 11 15:35:17 user nova-compute[71229]:       <nova:ports>
Apr 11 15:35:17 user nova-compute[71229]:         <nova:port uuid="3ae0cd28-c459-47b7-be17-133b69773f9c">
Apr 11 15:35:17 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 11 15:35:17 user nova-compute[71229]:         </nova:port>
Apr 11 15:35:17 user nova-compute[71229]:       </nova:ports>
Apr 11 15:35:17 user nova-compute[71229]:     </nova:instance>
Apr 11 15:35:17 user nova-compute[71229]:   </metadata>
Apr 11 15:35:17 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:35:17 user nova-compute[71229]:     <system>
Apr 11 15:35:17 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:35:17 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:35:17 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:35:17 user nova-compute[71229]:       <entry name="serial">ffc25fc1-e59f-42c8-a371-b4b12e17fd59</entry>
Apr 11 15:35:17 user nova-compute[71229]:       <entry name="uuid">ffc25fc1-e59f-42c8-a371-b4b12e17fd59</entry>
Apr 11 15:35:17 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:35:17 user nova-compute[71229]:     </system>
Apr 11 15:35:17 user nova-compute[71229]:   </sysinfo>
Apr 11 15:35:17 user nova-compute[71229]:   <os>
Apr 11 15:35:17 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:35:17 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 15:35:17 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:35:17 user nova-compute[71229]:   </os>
Apr 11 15:35:17 user nova-compute[71229]:   <features>
Apr 11 15:35:17 user nova-compute[71229]:     <acpi/>
Apr 11 15:35:17 user nova-compute[71229]:     <apic/>
Apr 11 15:35:17 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:35:17 user nova-compute[71229]:   </features>
Apr 11 15:35:17 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:35:17 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:35:17 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:35:17 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:35:17 user nova-compute[71229]:   </clock>
Apr 11 15:35:17 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:35:17 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:35:17 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:35:17 user nova-compute[71229]:   </cpu>
Apr 11 15:35:17 user nova-compute[71229]:   <devices>
Apr 11 15:35:17 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 15:35:17 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 15:35:17 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/ffc25fc1-e59f-42c8-a371-b4b12e17fd59/disk"/>
Apr 11 15:35:17 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:35:17 user nova-compute[71229]:     </disk>
Apr 11 15:35:17 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:35:17 user nova-compute[71229]:       <mac address="fa:16:3e:b9:69:19"/>
Apr 11 15:35:17 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:35:17 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:35:17 user nova-compute[71229]:       <target dev="tap3ae0cd28-c4"/>
Apr 11 15:35:17 user nova-compute[71229]:     </interface>
Apr 11 15:35:17 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:35:17 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/ffc25fc1-e59f-42c8-a371-b4b12e17fd59/console.log" append="off"/>
Apr 11 15:35:17 user nova-compute[71229]:     </serial>
Apr 11 15:35:17 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:35:17 user nova-compute[71229]:     <video>
Apr 11 15:35:17 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:35:17 user nova-compute[71229]:     </video>
Apr 11 15:35:17 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:35:17 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:35:17 user nova-compute[71229]:     </rng>
Apr 11 15:35:17 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:35:17 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:35:17 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:35:17 user nova-compute[71229]:     </memballoon>
Apr 11 15:35:17 user nova-compute[71229]:   </devices>
Apr 11 15:35:17 user nova-compute[71229]: </domain>
Apr 11 15:35:17 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:35:17 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T15:31:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1714025063',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1714025063',id=21,image_ref='37770c03-60d7-4c48-b5b9-8b5fb0e7e81c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1917410281',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:31:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='63b9b79fb98441fd9f1b5df54471f0bd',ramdisk_id='',reservation_id='r-kzb2xrpd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1785499036',owner_user_name='tempest-AttachVolumeShelveTestJSON-1785499036-project-member',shelved_at='2023-04-11T15:33:22.236297',shelved_host='user',shelved_image_id='37770c03-60d7-4c48-b5b9-8b5fb0e7e81c'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:35:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88d988d9ce0a41669b7c487ac07b4cfe',uuid=ffc25fc1-e59f-42c8-a371-b4b12e17fd59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3ae0cd28-c459-47b7-be17-133b69773f9c", "address": "fa:16:3e:b9:69:19", "network": {"id": "15a1a586-0100-4057-8501-5c5a282d4063", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834988552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b9b79fb98441fd9f1b5df54471f0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae0cd28-c4", "ovs_interfaceid": "3ae0cd28-c459-47b7-be17-133b69773f9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:35:17 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Converting VIF {"id": "3ae0cd28-c459-47b7-be17-133b69773f9c", "address": "fa:16:3e:b9:69:19", "network": {"id": "15a1a586-0100-4057-8501-5c5a282d4063", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834988552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b9b79fb98441fd9f1b5df54471f0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae0cd28-c4", "ovs_interfaceid": "3ae0cd28-c459-47b7-be17-133b69773f9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:35:17 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:69:19,bridge_name='br-int',has_traffic_filtering=True,id=3ae0cd28-c459-47b7-be17-133b69773f9c,network=Network(15a1a586-0100-4057-8501-5c5a282d4063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ae0cd28-c4') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:35:17 user nova-compute[71229]: DEBUG os_vif [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:69:19,bridge_name='br-int',has_traffic_filtering=True,id=3ae0cd28-c459-47b7-be17-133b69773f9c,network=Network(15a1a586-0100-4057-8501-5c5a282d4063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ae0cd28-c4') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:35:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:35:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:35:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ae0cd28-c4, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:35:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3ae0cd28-c4, col_values=(('external_ids', {'iface-id': '3ae0cd28-c459-47b7-be17-133b69773f9c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:69:19', 'vm-uuid': 'ffc25fc1-e59f-42c8-a371-b4b12e17fd59'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:35:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:35:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:17 user nova-compute[71229]: INFO os_vif [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:69:19,bridge_name='br-int',has_traffic_filtering=True,id=3ae0cd28-c459-47b7-be17-133b69773f9c,network=Network(15a1a586-0100-4057-8501-5c5a282d4063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ae0cd28-c4')
Apr 11 15:35:17 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:35:17 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] No VIF found with MAC fa:16:3e:b9:69:19, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:35:19 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:19 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:19 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:19 user nova-compute[71229]: DEBUG nova.compute.manager [req-4082546e-4ffe-455e-bbaf-855421264ac5 req-b4ab5d79-677d-4478-a53b-8abd617ef06c service nova] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Received event network-vif-plugged-3ae0cd28-c459-47b7-be17-133b69773f9c {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:35:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4082546e-4ffe-455e-bbaf-855421264ac5 req-b4ab5d79-677d-4478-a53b-8abd617ef06c service nova] Acquiring lock "ffc25fc1-e59f-42c8-a371-b4b12e17fd59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:35:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4082546e-4ffe-455e-bbaf-855421264ac5 req-b4ab5d79-677d-4478-a53b-8abd617ef06c service nova] Lock "ffc25fc1-e59f-42c8-a371-b4b12e17fd59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:35:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4082546e-4ffe-455e-bbaf-855421264ac5 req-b4ab5d79-677d-4478-a53b-8abd617ef06c service nova] Lock "ffc25fc1-e59f-42c8-a371-b4b12e17fd59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:35:19 user nova-compute[71229]: DEBUG nova.compute.manager [req-4082546e-4ffe-455e-bbaf-855421264ac5 req-b4ab5d79-677d-4478-a53b-8abd617ef06c service nova] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] No waiting events found dispatching network-vif-plugged-3ae0cd28-c459-47b7-be17-133b69773f9c {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:35:19 user nova-compute[71229]: WARNING nova.compute.manager [req-4082546e-4ffe-455e-bbaf-855421264ac5 req-b4ab5d79-677d-4478-a53b-8abd617ef06c service nova] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Received unexpected event network-vif-plugged-3ae0cd28-c459-47b7-be17-133b69773f9c for instance with vm_state shelved_offloaded and task_state spawning.
Apr 11 15:35:19 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:19 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:19 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:21 user nova-compute[71229]: DEBUG nova.compute.manager [req-ac9280e7-05b2-41f8-9c2e-60b5e0a65651 req-ded65ac9-b634-4373-8e56-fb836f67b22f service nova] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Received event network-vif-plugged-3ae0cd28-c459-47b7-be17-133b69773f9c {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:35:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-ac9280e7-05b2-41f8-9c2e-60b5e0a65651 req-ded65ac9-b634-4373-8e56-fb836f67b22f service nova] Acquiring lock "ffc25fc1-e59f-42c8-a371-b4b12e17fd59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:35:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-ac9280e7-05b2-41f8-9c2e-60b5e0a65651 req-ded65ac9-b634-4373-8e56-fb836f67b22f service nova] Lock "ffc25fc1-e59f-42c8-a371-b4b12e17fd59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:35:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-ac9280e7-05b2-41f8-9c2e-60b5e0a65651 req-ded65ac9-b634-4373-8e56-fb836f67b22f service nova] Lock "ffc25fc1-e59f-42c8-a371-b4b12e17fd59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:35:21 user nova-compute[71229]: DEBUG nova.compute.manager [req-ac9280e7-05b2-41f8-9c2e-60b5e0a65651 req-ded65ac9-b634-4373-8e56-fb836f67b22f service nova] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] No waiting events found dispatching network-vif-plugged-3ae0cd28-c459-47b7-be17-133b69773f9c {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:35:21 user nova-compute[71229]: WARNING nova.compute.manager [req-ac9280e7-05b2-41f8-9c2e-60b5e0a65651 req-ded65ac9-b634-4373-8e56-fb836f67b22f service nova] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Received unexpected event network-vif-plugged-3ae0cd28-c459-47b7-be17-133b69773f9c for instance with vm_state shelved_offloaded and task_state spawning.
Apr 11 15:35:21 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227321.7371755, ffc25fc1-e59f-42c8-a371-b4b12e17fd59 => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:35:21 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] VM Resumed (Lifecycle Event)
Apr 11 15:35:21 user nova-compute[71229]: DEBUG nova.compute.manager [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 15:35:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Guest created on hypervisor {{(pid=71229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 15:35:21 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Instance spawned successfully.
Apr 11 15:35:21 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:35:21 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:35:21 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:35:21 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227321.7390914, ffc25fc1-e59f-42c8-a371-b4b12e17fd59 => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:35:21 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] VM Started (Lifecycle Event)
Apr 11 15:35:21 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:35:21 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:35:22 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:35:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:22 user nova-compute[71229]: DEBUG nova.compute.manager [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:35:22 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f33cb7fa-9c52-44f5-a4c5-b2b1faf9aa1c tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ffc25fc1-e59f-42c8-a371-b4b12e17fd59" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.066s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:35:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "dcbfcbfd-7e96-4271-94ee-60ef937e3b7e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:35:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "dcbfcbfd-7e96-4271-94ee-60ef937e3b7e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:35:24 user nova-compute[71229]: DEBUG nova.compute.manager [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Starting instance... {{(pid=71229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 15:35:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:35:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:35:24 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 15:35:24 user nova-compute[71229]: INFO nova.compute.claims [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Claim successful on node user
Apr 11 15:35:24 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:35:24 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:35:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.445s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:35:24 user nova-compute[71229]: DEBUG nova.compute.manager [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Start building networks asynchronously for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 15:35:24 user nova-compute[71229]: DEBUG nova.compute.manager [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Allocating IP information in the background. {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 15:35:24 user nova-compute[71229]: DEBUG nova.network.neutron [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] allocate_for_instance() {{(pid=71229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 15:35:24 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 15:35:24 user nova-compute[71229]: DEBUG nova.compute.manager [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Start building block device mappings for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 15:35:25 user nova-compute[71229]: DEBUG nova.compute.manager [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Start spawning the instance on the hypervisor. {{(pid=71229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 15:35:25 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Creating instance directory {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 15:35:25 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Creating image(s)
Apr 11 15:35:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "/opt/stack/data/nova/instances/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:35:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "/opt/stack/data/nova/instances/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:35:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "/opt/stack/data/nova/instances/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:35:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:35:25 user nova-compute[71229]: DEBUG nova.policy [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '10720df0ac4f4e62a0a5c9883d600add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7660e8f76b471487136806ee9eec62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71229) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 15:35:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.142s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:35:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:35:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:35:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:35:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.137s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:35:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e/disk 1073741824 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:35:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e/disk 1073741824" returned: 0 in 0.056s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:35:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:35:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:35:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.155s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:35:25 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e/disk. size=1073741824 {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 15:35:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:35:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:35:25 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Cannot resize image /opt/stack/data/nova/instances/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e/disk to a smaller size. {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 15:35:25 user nova-compute[71229]: DEBUG nova.objects.instance [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lazy-loading 'migration_context' on Instance uuid dcbfcbfd-7e96-4271-94ee-60ef937e3b7e {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:35:25 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Created local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 15:35:25 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Ensure instance console log exists: /opt/stack/data/nova/instances/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 15:35:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:35:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:35:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:35:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:26 user nova-compute[71229]: DEBUG nova.network.neutron [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Successfully created port: 32c006ee-14e2-47d8-b999-bafc729aa67a {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 15:35:27 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:27 user nova-compute[71229]: DEBUG nova.network.neutron [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Successfully updated port: 32c006ee-14e2-47d8-b999-bafc729aa67a {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:35:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "refresh_cache-dcbfcbfd-7e96-4271-94ee-60ef937e3b7e" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:35:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquired lock "refresh_cache-dcbfcbfd-7e96-4271-94ee-60ef937e3b7e" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:35:27 user nova-compute[71229]: DEBUG nova.network.neutron [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:35:27 user nova-compute[71229]: DEBUG nova.compute.manager [req-0643ee65-d2c3-4992-ad33-0cc75273ae8d req-fbb5f463-49fd-4527-ab1a-0be80c003a82 service nova] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Received event network-changed-32c006ee-14e2-47d8-b999-bafc729aa67a {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:35:27 user nova-compute[71229]: DEBUG nova.compute.manager [req-0643ee65-d2c3-4992-ad33-0cc75273ae8d req-fbb5f463-49fd-4527-ab1a-0be80c003a82 service nova] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Refreshing instance network info cache due to event network-changed-32c006ee-14e2-47d8-b999-bafc729aa67a. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:35:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-0643ee65-d2c3-4992-ad33-0cc75273ae8d req-fbb5f463-49fd-4527-ab1a-0be80c003a82 service nova] Acquiring lock "refresh_cache-dcbfcbfd-7e96-4271-94ee-60ef937e3b7e" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:35:27 user nova-compute[71229]: DEBUG nova.network.neutron [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:35:28 user nova-compute[71229]: DEBUG nova.network.neutron [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Updating instance_info_cache with network_info: [{"id": "32c006ee-14e2-47d8-b999-bafc729aa67a", "address": "fa:16:3e:1a:bd:54", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c006ee-14", "ovs_interfaceid": "32c006ee-14e2-47d8-b999-bafc729aa67a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:35:28 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Releasing lock "refresh_cache-dcbfcbfd-7e96-4271-94ee-60ef937e3b7e" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:35:28 user nova-compute[71229]: DEBUG nova.compute.manager [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Instance network_info: |[{"id": "32c006ee-14e2-47d8-b999-bafc729aa67a", "address": "fa:16:3e:1a:bd:54", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c006ee-14", "ovs_interfaceid": "32c006ee-14e2-47d8-b999-bafc729aa67a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 15:35:28 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-0643ee65-d2c3-4992-ad33-0cc75273ae8d req-fbb5f463-49fd-4527-ab1a-0be80c003a82 service nova] Acquired lock "refresh_cache-dcbfcbfd-7e96-4271-94ee-60ef937e3b7e" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:35:28 user nova-compute[71229]: DEBUG nova.network.neutron [req-0643ee65-d2c3-4992-ad33-0cc75273ae8d req-fbb5f463-49fd-4527-ab1a-0be80c003a82 service nova] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Refreshing network info cache for port 32c006ee-14e2-47d8-b999-bafc729aa67a {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:35:28 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Start _get_guest_xml network_info=[{"id": "32c006ee-14e2-47d8-b999-bafc729aa67a", "address": "fa:16:3e:1a:bd:54", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c006ee-14", "ovs_interfaceid": "32c006ee-14e2-47d8-b999-bafc729aa67a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '52fe638c-5ada-47d5-b376-233bfa808a37'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:35:28 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:35:28 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:35:28 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:35:28 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:35:28 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:35:28 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:35:28 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:35:28 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:35:28 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:35:28 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:35:28 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:35:28 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:35:28 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:35:28 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:35:28 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:35:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1108207278',display_name='tempest-ServerActionsTestJSON-server-1108207278',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1108207278',id=26,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfAJGQ+GOa8zW+jlKgD9Kz6/k6iEv9pZIOIjICzcstJ92AAS94+47mc3fRsqyx5FaTMV9P4lTsW4Fy7tKIAtMpRx0Sl7sa6ttQnPbPhlcYqfbdWbTqmmKi6+BuZpqSknA==',key_name='tempest-keypair-1137963694',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb7660e8f76b471487136806ee9eec62',ramdisk_id='',reservation_id='r-k9tu04rs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1659503440',owner_user_name='tempest-ServerActionsTestJSON-1659503440-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:35:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10720df0ac4f4e62a0a5c9883d600add',uuid=dcbfcbfd-7e96-4271-94ee-60ef937e3b7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32c006ee-14e2-47d8-b999-bafc729aa67a", "address": "fa:16:3e:1a:bd:54", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c006ee-14", "ovs_interfaceid": "32c006ee-14e2-47d8-b999-bafc729aa67a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:35:28 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Converting VIF {"id": "32c006ee-14e2-47d8-b999-bafc729aa67a", "address": "fa:16:3e:1a:bd:54", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c006ee-14", "ovs_interfaceid": "32c006ee-14e2-47d8-b999-bafc729aa67a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:35:28 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:bd:54,bridge_name='br-int',has_traffic_filtering=True,id=32c006ee-14e2-47d8-b999-bafc729aa67a,network=Network(1bd215e8-0459-4dd2-893b-096b6e31ac08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c006ee-14') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:35:28 user nova-compute[71229]: DEBUG nova.objects.instance [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lazy-loading 'pci_devices' on Instance uuid dcbfcbfd-7e96-4271-94ee-60ef937e3b7e {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:35:28 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:35:28 user nova-compute[71229]:   <uuid>dcbfcbfd-7e96-4271-94ee-60ef937e3b7e</uuid>
Apr 11 15:35:28 user nova-compute[71229]:   <name>instance-0000001a</name>
Apr 11 15:35:28 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:35:28 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:35:28 user nova-compute[71229]:   <metadata>
Apr 11 15:35:28 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:35:28 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:35:28 user nova-compute[71229]:       <nova:name>tempest-ServerActionsTestJSON-server-1108207278</nova:name>
Apr 11 15:35:28 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:35:28</nova:creationTime>
Apr 11 15:35:28 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:35:28 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:35:28 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:35:28 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:35:28 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:35:28 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:35:28 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:35:28 user nova-compute[71229]:       <nova:owner>
Apr 11 15:35:28 user nova-compute[71229]:         <nova:user uuid="10720df0ac4f4e62a0a5c9883d600add">tempest-ServerActionsTestJSON-1659503440-project-member</nova:user>
Apr 11 15:35:28 user nova-compute[71229]:         <nova:project uuid="bb7660e8f76b471487136806ee9eec62">tempest-ServerActionsTestJSON-1659503440</nova:project>
Apr 11 15:35:28 user nova-compute[71229]:       </nova:owner>
Apr 11 15:35:28 user nova-compute[71229]:       <nova:root type="image" uuid="52fe638c-5ada-47d5-b376-233bfa808a37"/>
Apr 11 15:35:28 user nova-compute[71229]:       <nova:ports>
Apr 11 15:35:28 user nova-compute[71229]:         <nova:port uuid="32c006ee-14e2-47d8-b999-bafc729aa67a">
Apr 11 15:35:28 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 11 15:35:28 user nova-compute[71229]:         </nova:port>
Apr 11 15:35:28 user nova-compute[71229]:       </nova:ports>
Apr 11 15:35:28 user nova-compute[71229]:     </nova:instance>
Apr 11 15:35:28 user nova-compute[71229]:   </metadata>
Apr 11 15:35:28 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:35:28 user nova-compute[71229]:     <system>
Apr 11 15:35:28 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:35:28 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:35:28 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:35:28 user nova-compute[71229]:       <entry name="serial">dcbfcbfd-7e96-4271-94ee-60ef937e3b7e</entry>
Apr 11 15:35:28 user nova-compute[71229]:       <entry name="uuid">dcbfcbfd-7e96-4271-94ee-60ef937e3b7e</entry>
Apr 11 15:35:28 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:35:28 user nova-compute[71229]:     </system>
Apr 11 15:35:28 user nova-compute[71229]:   </sysinfo>
Apr 11 15:35:28 user nova-compute[71229]:   <os>
Apr 11 15:35:28 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:35:28 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 15:35:28 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:35:28 user nova-compute[71229]:   </os>
Apr 11 15:35:28 user nova-compute[71229]:   <features>
Apr 11 15:35:28 user nova-compute[71229]:     <acpi/>
Apr 11 15:35:28 user nova-compute[71229]:     <apic/>
Apr 11 15:35:28 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:35:28 user nova-compute[71229]:   </features>
Apr 11 15:35:28 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:35:28 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:35:28 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:35:28 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:35:28 user nova-compute[71229]:   </clock>
Apr 11 15:35:28 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:35:28 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:35:28 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:35:28 user nova-compute[71229]:   </cpu>
Apr 11 15:35:28 user nova-compute[71229]:   <devices>
Apr 11 15:35:28 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 15:35:28 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 15:35:28 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e/disk"/>
Apr 11 15:35:28 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:35:28 user nova-compute[71229]:     </disk>
Apr 11 15:35:28 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:35:28 user nova-compute[71229]:       <mac address="fa:16:3e:1a:bd:54"/>
Apr 11 15:35:28 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:35:28 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:35:28 user nova-compute[71229]:       <target dev="tap32c006ee-14"/>
Apr 11 15:35:28 user nova-compute[71229]:     </interface>
Apr 11 15:35:28 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:35:28 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e/console.log" append="off"/>
Apr 11 15:35:28 user nova-compute[71229]:     </serial>
Apr 11 15:35:28 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:35:28 user nova-compute[71229]:     <video>
Apr 11 15:35:28 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:35:28 user nova-compute[71229]:     </video>
Apr 11 15:35:28 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:35:28 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:35:28 user nova-compute[71229]:     </rng>
Apr 11 15:35:28 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:35:28 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:35:28 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:35:28 user nova-compute[71229]:     </memballoon>
Apr 11 15:35:28 user nova-compute[71229]:   </devices>
Apr 11 15:35:28 user nova-compute[71229]: </domain>
Apr 11 15:35:28 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:35:28 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:35:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1108207278',display_name='tempest-ServerActionsTestJSON-server-1108207278',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1108207278',id=26,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfAJGQ+GOa8zW+jlKgD9Kz6/k6iEv9pZIOIjICzcstJ92AAS94+47mc3fRsqyx5FaTMV9P4lTsW4Fy7tKIAtMpRx0Sl7sa6ttQnPbPhlcYqfbdWbTqmmKi6+BuZpqSknA==',key_name='tempest-keypair-1137963694',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb7660e8f76b471487136806ee9eec62',ramdisk_id='',reservation_id='r-k9tu04rs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1659503440',owner_user_name='tempest-ServerActionsTestJSON-1659503440-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:35:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10720df0ac4f4e62a0a5c9883d600add',uuid=dcbfcbfd-7e96-4271-94ee-60ef937e3b7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32c006ee-14e2-47d8-b999-bafc729aa67a", "address": "fa:16:3e:1a:bd:54", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c006ee-14", "ovs_interfaceid": "32c006ee-14e2-47d8-b999-bafc729aa67a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:35:28 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Converting VIF {"id": "32c006ee-14e2-47d8-b999-bafc729aa67a", "address": "fa:16:3e:1a:bd:54", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c006ee-14", "ovs_interfaceid": "32c006ee-14e2-47d8-b999-bafc729aa67a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:35:28 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:bd:54,bridge_name='br-int',has_traffic_filtering=True,id=32c006ee-14e2-47d8-b999-bafc729aa67a,network=Network(1bd215e8-0459-4dd2-893b-096b6e31ac08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c006ee-14') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:35:28 user nova-compute[71229]: DEBUG os_vif [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:bd:54,bridge_name='br-int',has_traffic_filtering=True,id=32c006ee-14e2-47d8-b999-bafc729aa67a,network=Network(1bd215e8-0459-4dd2-893b-096b6e31ac08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c006ee-14') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:35:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:35:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:35:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap32c006ee-14, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:35:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap32c006ee-14, col_values=(('external_ids', {'iface-id': '32c006ee-14e2-47d8-b999-bafc729aa67a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:bd:54', 'vm-uuid': 'dcbfcbfd-7e96-4271-94ee-60ef937e3b7e'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:35:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:35:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:28 user nova-compute[71229]: INFO os_vif [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:bd:54,bridge_name='br-int',has_traffic_filtering=True,id=32c006ee-14e2-47d8-b999-bafc729aa67a,network=Network(1bd215e8-0459-4dd2-893b-096b6e31ac08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c006ee-14')
Apr 11 15:35:28 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:35:28 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] No VIF found with MAC fa:16:3e:1a:bd:54, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:35:28 user nova-compute[71229]: DEBUG nova.network.neutron [req-0643ee65-d2c3-4992-ad33-0cc75273ae8d req-fbb5f463-49fd-4527-ab1a-0be80c003a82 service nova] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Updated VIF entry in instance network info cache for port 32c006ee-14e2-47d8-b999-bafc729aa67a. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:35:28 user nova-compute[71229]: DEBUG nova.network.neutron [req-0643ee65-d2c3-4992-ad33-0cc75273ae8d req-fbb5f463-49fd-4527-ab1a-0be80c003a82 service nova] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Updating instance_info_cache with network_info: [{"id": "32c006ee-14e2-47d8-b999-bafc729aa67a", "address": "fa:16:3e:1a:bd:54", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c006ee-14", "ovs_interfaceid": "32c006ee-14e2-47d8-b999-bafc729aa67a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:35:28 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-0643ee65-d2c3-4992-ad33-0cc75273ae8d req-fbb5f463-49fd-4527-ab1a-0be80c003a82 service nova] Releasing lock "refresh_cache-dcbfcbfd-7e96-4271-94ee-60ef937e3b7e" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:35:29 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:29 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:29 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:29 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:29 user nova-compute[71229]: DEBUG nova.compute.manager [req-2b3d6c3e-9ce4-4351-b864-b7b456a5a802 req-43484d95-951b-40d8-8793-f7b6ae395c75 service nova] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Received event network-vif-plugged-32c006ee-14e2-47d8-b999-bafc729aa67a {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:35:29 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2b3d6c3e-9ce4-4351-b864-b7b456a5a802 req-43484d95-951b-40d8-8793-f7b6ae395c75 service nova] Acquiring lock "dcbfcbfd-7e96-4271-94ee-60ef937e3b7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:35:29 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2b3d6c3e-9ce4-4351-b864-b7b456a5a802 req-43484d95-951b-40d8-8793-f7b6ae395c75 service nova] Lock "dcbfcbfd-7e96-4271-94ee-60ef937e3b7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:35:29 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2b3d6c3e-9ce4-4351-b864-b7b456a5a802 req-43484d95-951b-40d8-8793-f7b6ae395c75 service nova] Lock "dcbfcbfd-7e96-4271-94ee-60ef937e3b7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:35:29 user nova-compute[71229]: DEBUG nova.compute.manager [req-2b3d6c3e-9ce4-4351-b864-b7b456a5a802 req-43484d95-951b-40d8-8793-f7b6ae395c75 service nova] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] No waiting events found dispatching network-vif-plugged-32c006ee-14e2-47d8-b999-bafc729aa67a {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:35:29 user nova-compute[71229]: WARNING nova.compute.manager [req-2b3d6c3e-9ce4-4351-b864-b7b456a5a802 req-43484d95-951b-40d8-8793-f7b6ae395c75 service nova] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Received unexpected event network-vif-plugged-32c006ee-14e2-47d8-b999-bafc729aa67a for instance with vm_state building and task_state spawning.
Apr 11 15:35:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:31 user nova-compute[71229]: DEBUG nova.compute.manager [req-2ccbabf5-1dfe-4610-b193-698e0f231b34 req-c12bd258-4074-4092-8669-ae0130a9d726 service nova] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Received event network-vif-plugged-32c006ee-14e2-47d8-b999-bafc729aa67a {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:35:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2ccbabf5-1dfe-4610-b193-698e0f231b34 req-c12bd258-4074-4092-8669-ae0130a9d726 service nova] Acquiring lock "dcbfcbfd-7e96-4271-94ee-60ef937e3b7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:35:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2ccbabf5-1dfe-4610-b193-698e0f231b34 req-c12bd258-4074-4092-8669-ae0130a9d726 service nova] Lock "dcbfcbfd-7e96-4271-94ee-60ef937e3b7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:35:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2ccbabf5-1dfe-4610-b193-698e0f231b34 req-c12bd258-4074-4092-8669-ae0130a9d726 service nova] Lock "dcbfcbfd-7e96-4271-94ee-60ef937e3b7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:35:31 user nova-compute[71229]: DEBUG nova.compute.manager [req-2ccbabf5-1dfe-4610-b193-698e0f231b34 req-c12bd258-4074-4092-8669-ae0130a9d726 service nova] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] No waiting events found dispatching network-vif-plugged-32c006ee-14e2-47d8-b999-bafc729aa67a {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:35:31 user nova-compute[71229]: WARNING nova.compute.manager [req-2ccbabf5-1dfe-4610-b193-698e0f231b34 req-c12bd258-4074-4092-8669-ae0130a9d726 service nova] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Received unexpected event network-vif-plugged-32c006ee-14e2-47d8-b999-bafc729aa67a for instance with vm_state building and task_state spawning.
Apr 11 15:35:32 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227332.0105438, dcbfcbfd-7e96-4271-94ee-60ef937e3b7e => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:35:32 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] VM Resumed (Lifecycle Event)
Apr 11 15:35:32 user nova-compute[71229]: DEBUG nova.compute.manager [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 15:35:32 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Guest created on hypervisor {{(pid=71229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 15:35:32 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Instance spawned successfully.
Apr 11 15:35:32 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 15:35:32 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:35:32 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:35:32 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Found default for hw_cdrom_bus of ide {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:35:32 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Found default for hw_disk_bus of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:35:32 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Found default for hw_input_bus of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:35:32 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Found default for hw_pointer_model of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:35:32 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Found default for hw_video_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:35:32 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Found default for hw_vif_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:35:32 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:35:32 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227332.0131156, dcbfcbfd-7e96-4271-94ee-60ef937e3b7e => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:35:32 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] VM Started (Lifecycle Event)
Apr 11 15:35:32 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:35:32 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:35:32 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:35:32 user nova-compute[71229]: INFO nova.compute.manager [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Took 7.03 seconds to spawn the instance on the hypervisor.
Apr 11 15:35:32 user nova-compute[71229]: DEBUG nova.compute.manager [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:35:32 user nova-compute[71229]: INFO nova.compute.manager [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Took 7.83 seconds to build instance.
Apr 11 15:35:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-69ded5b6-9dcf-43ce-8cd2-f54540a840b5 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "dcbfcbfd-7e96-4271-94ee-60ef937e3b7e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.940s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:35:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "1e3d0956-d528-4097-a200-d9b2b6ce7aa8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:35:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "1e3d0956-d528-4097-a200-d9b2b6ce7aa8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:35:40 user nova-compute[71229]: DEBUG nova.compute.manager [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Starting instance... {{(pid=71229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 15:35:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:35:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:35:40 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 15:35:40 user nova-compute[71229]: INFO nova.compute.claims [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Claim successful on node user
Apr 11 15:35:41 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:35:41 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:35:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.351s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:35:41 user nova-compute[71229]: DEBUG nova.compute.manager [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Start building networks asynchronously for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 15:35:41 user nova-compute[71229]: DEBUG nova.compute.manager [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Allocating IP information in the background. {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 15:35:41 user nova-compute[71229]: DEBUG nova.network.neutron [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] allocate_for_instance() {{(pid=71229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 15:35:41 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 15:35:41 user nova-compute[71229]: DEBUG nova.compute.manager [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Start building block device mappings for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 15:35:41 user nova-compute[71229]: DEBUG nova.policy [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '044f17aee3324b3a97bebe935548b3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23461a3d7ca49f6a77d3fde6f1009d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71229) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 15:35:41 user nova-compute[71229]: DEBUG nova.compute.manager [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Start spawning the instance on the hypervisor. {{(pid=71229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 15:35:41 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Creating instance directory {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 15:35:41 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Creating image(s)
Apr 11 15:35:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "/opt/stack/data/nova/instances/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:35:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "/opt/stack/data/nova/instances/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:35:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "/opt/stack/data/nova/instances/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:35:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "a4a2efe8715353e8e729f83cecfb97b8f359c98b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:35:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "a4a2efe8715353e8e729f83cecfb97b8f359c98b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:35:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4a2efe8715353e8e729f83cecfb97b8f359c98b.part --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:35:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4a2efe8715353e8e729f83cecfb97b8f359c98b.part --force-share --output=json" returned: 0 in 0.145s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:35:41 user nova-compute[71229]: DEBUG nova.virt.images [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] eef769ca-4518-48cc-8f9b-15f43146d184 was qcow2, converting to raw {{(pid=71229) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 15:35:41 user nova-compute[71229]: DEBUG nova.privsep.utils [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71229) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 15:35:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a4a2efe8715353e8e729f83cecfb97b8f359c98b.part /opt/stack/data/nova/instances/_base/a4a2efe8715353e8e729f83cecfb97b8f359c98b.converted {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:35:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:42 user nova-compute[71229]: DEBUG nova.network.neutron [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Successfully created port: 19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 15:35:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a4a2efe8715353e8e729f83cecfb97b8f359c98b.part /opt/stack/data/nova/instances/_base/a4a2efe8715353e8e729f83cecfb97b8f359c98b.converted" returned: 0 in 0.322s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:35:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4a2efe8715353e8e729f83cecfb97b8f359c98b.converted --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:35:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4a2efe8715353e8e729f83cecfb97b8f359c98b.converted --force-share --output=json" returned: 0 in 0.137s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:35:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "a4a2efe8715353e8e729f83cecfb97b8f359c98b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.898s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:35:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4a2efe8715353e8e729f83cecfb97b8f359c98b --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:35:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4a2efe8715353e8e729f83cecfb97b8f359c98b --force-share --output=json" returned: 0 in 0.137s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:35:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "a4a2efe8715353e8e729f83cecfb97b8f359c98b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:35:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "a4a2efe8715353e8e729f83cecfb97b8f359c98b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:35:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4a2efe8715353e8e729f83cecfb97b8f359c98b --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:35:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4a2efe8715353e8e729f83cecfb97b8f359c98b --force-share --output=json" returned: 0 in 0.136s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:35:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a4a2efe8715353e8e729f83cecfb97b8f359c98b,backing_fmt=raw /opt/stack/data/nova/instances/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/disk 1073741824 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:35:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a4a2efe8715353e8e729f83cecfb97b8f359c98b,backing_fmt=raw /opt/stack/data/nova/instances/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/disk 1073741824" returned: 0 in 0.050s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:35:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "a4a2efe8715353e8e729f83cecfb97b8f359c98b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:35:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4a2efe8715353e8e729f83cecfb97b8f359c98b --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:35:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4a2efe8715353e8e729f83cecfb97b8f359c98b --force-share --output=json" returned: 0 in 0.141s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:35:42 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/disk. size=1073741824 {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 15:35:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:35:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:35:42 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Cannot resize image /opt/stack/data/nova/instances/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/disk to a smaller size. {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 15:35:42 user nova-compute[71229]: DEBUG nova.objects.instance [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lazy-loading 'migration_context' on Instance uuid 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:35:42 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Created local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 15:35:42 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Ensure instance console log exists: /opt/stack/data/nova/instances/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 15:35:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:35:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:35:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:35:43 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:43 user nova-compute[71229]: DEBUG nova.network.neutron [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Successfully updated port: 19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:35:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "refresh_cache-1e3d0956-d528-4097-a200-d9b2b6ce7aa8" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:35:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquired lock "refresh_cache-1e3d0956-d528-4097-a200-d9b2b6ce7aa8" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:35:43 user nova-compute[71229]: DEBUG nova.network.neutron [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:35:43 user nova-compute[71229]: DEBUG nova.compute.manager [req-a9e560d6-15ca-4cd0-9db0-d7de1f2ffa4d req-907e8c64-2844-4b95-9a79-b85dea12a196 service nova] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Received event network-changed-19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:35:43 user nova-compute[71229]: DEBUG nova.compute.manager [req-a9e560d6-15ca-4cd0-9db0-d7de1f2ffa4d req-907e8c64-2844-4b95-9a79-b85dea12a196 service nova] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Refreshing instance network info cache due to event network-changed-19b6c9ca-9d18-4f57-9687-ce7ffde5ca53. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:35:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a9e560d6-15ca-4cd0-9db0-d7de1f2ffa4d req-907e8c64-2844-4b95-9a79-b85dea12a196 service nova] Acquiring lock "refresh_cache-1e3d0956-d528-4097-a200-d9b2b6ce7aa8" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:35:43 user nova-compute[71229]: DEBUG nova.network.neutron [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:35:43 user nova-compute[71229]: DEBUG nova.network.neutron [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Updating instance_info_cache with network_info: [{"id": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53", "address": "fa:16:3e:3e:55:16", "network": {"id": "b1189892-ba9d-4316-9962-c737b27f14bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1737061315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c23461a3d7ca49f6a77d3fde6f1009d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19b6c9ca-9d", "ovs_interfaceid": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:35:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Releasing lock "refresh_cache-1e3d0956-d528-4097-a200-d9b2b6ce7aa8" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:35:43 user nova-compute[71229]: DEBUG nova.compute.manager [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Instance network_info: |[{"id": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53", "address": "fa:16:3e:3e:55:16", "network": {"id": "b1189892-ba9d-4316-9962-c737b27f14bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1737061315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c23461a3d7ca49f6a77d3fde6f1009d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19b6c9ca-9d", "ovs_interfaceid": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 15:35:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a9e560d6-15ca-4cd0-9db0-d7de1f2ffa4d req-907e8c64-2844-4b95-9a79-b85dea12a196 service nova] Acquired lock "refresh_cache-1e3d0956-d528-4097-a200-d9b2b6ce7aa8" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:35:43 user nova-compute[71229]: DEBUG nova.network.neutron [req-a9e560d6-15ca-4cd0-9db0-d7de1f2ffa4d req-907e8c64-2844-4b95-9a79-b85dea12a196 service nova] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Refreshing network info cache for port 19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:35:43 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Start _get_guest_xml network_info=[{"id": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53", "address": "fa:16:3e:3e:55:16", "network": {"id": "b1189892-ba9d-4316-9962-c737b27f14bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1737061315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c23461a3d7ca49f6a77d3fde6f1009d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19b6c9ca-9d", "ovs_interfaceid": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:35:37Z,direct_url=<?>,disk_format='qcow2',id=eef769ca-4518-48cc-8f9b-15f43146d184,min_disk=0,min_ram=0,name='tempest-scenario-img--866822494',owner='c23461a3d7ca49f6a77d3fde6f1009d3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:35:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': 'eef769ca-4518-48cc-8f9b-15f43146d184'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:35:43 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:35:43 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:35:43 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:35:43 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:35:37Z,direct_url=<?>,disk_format='qcow2',id=eef769ca-4518-48cc-8f9b-15f43146d184,min_disk=0,min_ram=0,name='tempest-scenario-img--866822494',owner='c23461a3d7ca49f6a77d3fde6f1009d3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:35:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:35:43 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:35:43 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:35:43 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:35:43 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:35:43 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:35:43 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:35:43 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:35:43 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:35:43 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:35:43 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:35:43 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:35:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1775975364',display_name='tempest-TestMinimumBasicScenario-server-1775975364',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1775975364',id=27,image_ref='eef769ca-4518-48cc-8f9b-15f43146d184',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCX38V29uKqq32pbrXcHfjwmsz6kzESDeVl6gqbOhAcULXo21SBTbxQJXUQHaV8PJeMjZRs4D5UehvHzvnc4jeUpiLPu2JFq1xh2/XZqKhiBdFrsxTD5c6W9I6S8vZoQ6A==',key_name='tempest-TestMinimumBasicScenario-1861021757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c23461a3d7ca49f6a77d3fde6f1009d3',ramdisk_id='',reservation_id='r-20z6o102',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eef769ca-4518-48cc-8f9b-15f43146d184',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-673773229',owner_user_name='tempest-TestMinimumBasicScenario-673773229-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:35:41Z,user_data=None,user_id='044f17aee3324b3a97bebe935548b3b4',uuid=1e3d0956-d528-4097-a200-d9b2b6ce7aa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53", "address": "fa:16:3e:3e:55:16", "network": {"id": "b1189892-ba9d-4316-9962-c737b27f14bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1737061315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c23461a3d7ca49f6a77d3fde6f1009d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19b6c9ca-9d", "ovs_interfaceid": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:35:43 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Converting VIF {"id": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53", "address": "fa:16:3e:3e:55:16", "network": {"id": "b1189892-ba9d-4316-9962-c737b27f14bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1737061315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c23461a3d7ca49f6a77d3fde6f1009d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19b6c9ca-9d", "ovs_interfaceid": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:35:43 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:55:16,bridge_name='br-int',has_traffic_filtering=True,id=19b6c9ca-9d18-4f57-9687-ce7ffde5ca53,network=Network(b1189892-ba9d-4316-9962-c737b27f14bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19b6c9ca-9d') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:35:43 user nova-compute[71229]: DEBUG nova.objects.instance [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:35:43 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:35:43 user nova-compute[71229]:   <uuid>1e3d0956-d528-4097-a200-d9b2b6ce7aa8</uuid>
Apr 11 15:35:43 user nova-compute[71229]:   <name>instance-0000001b</name>
Apr 11 15:35:43 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:35:43 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:35:43 user nova-compute[71229]:   <metadata>
Apr 11 15:35:43 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:35:43 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:35:43 user nova-compute[71229]:       <nova:name>tempest-TestMinimumBasicScenario-server-1775975364</nova:name>
Apr 11 15:35:43 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:35:43</nova:creationTime>
Apr 11 15:35:43 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:35:43 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:35:43 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:35:43 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:35:43 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:35:43 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:35:43 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:35:43 user nova-compute[71229]:       <nova:owner>
Apr 11 15:35:43 user nova-compute[71229]:         <nova:user uuid="044f17aee3324b3a97bebe935548b3b4">tempest-TestMinimumBasicScenario-673773229-project-member</nova:user>
Apr 11 15:35:43 user nova-compute[71229]:         <nova:project uuid="c23461a3d7ca49f6a77d3fde6f1009d3">tempest-TestMinimumBasicScenario-673773229</nova:project>
Apr 11 15:35:43 user nova-compute[71229]:       </nova:owner>
Apr 11 15:35:43 user nova-compute[71229]:       <nova:root type="image" uuid="eef769ca-4518-48cc-8f9b-15f43146d184"/>
Apr 11 15:35:43 user nova-compute[71229]:       <nova:ports>
Apr 11 15:35:43 user nova-compute[71229]:         <nova:port uuid="19b6c9ca-9d18-4f57-9687-ce7ffde5ca53">
Apr 11 15:35:43 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 11 15:35:43 user nova-compute[71229]:         </nova:port>
Apr 11 15:35:43 user nova-compute[71229]:       </nova:ports>
Apr 11 15:35:43 user nova-compute[71229]:     </nova:instance>
Apr 11 15:35:43 user nova-compute[71229]:   </metadata>
Apr 11 15:35:43 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:35:43 user nova-compute[71229]:     <system>
Apr 11 15:35:43 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:35:43 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:35:43 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:35:43 user nova-compute[71229]:       <entry name="serial">1e3d0956-d528-4097-a200-d9b2b6ce7aa8</entry>
Apr 11 15:35:43 user nova-compute[71229]:       <entry name="uuid">1e3d0956-d528-4097-a200-d9b2b6ce7aa8</entry>
Apr 11 15:35:43 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:35:43 user nova-compute[71229]:     </system>
Apr 11 15:35:43 user nova-compute[71229]:   </sysinfo>
Apr 11 15:35:43 user nova-compute[71229]:   <os>
Apr 11 15:35:43 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:35:43 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 15:35:43 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:35:43 user nova-compute[71229]:   </os>
Apr 11 15:35:43 user nova-compute[71229]:   <features>
Apr 11 15:35:43 user nova-compute[71229]:     <acpi/>
Apr 11 15:35:43 user nova-compute[71229]:     <apic/>
Apr 11 15:35:43 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:35:43 user nova-compute[71229]:   </features>
Apr 11 15:35:43 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:35:43 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:35:43 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:35:43 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:35:43 user nova-compute[71229]:   </clock>
Apr 11 15:35:43 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:35:43 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:35:43 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:35:43 user nova-compute[71229]:   </cpu>
Apr 11 15:35:43 user nova-compute[71229]:   <devices>
Apr 11 15:35:43 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 15:35:43 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 15:35:43 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/disk"/>
Apr 11 15:35:43 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:35:43 user nova-compute[71229]:     </disk>
Apr 11 15:35:43 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:35:43 user nova-compute[71229]:       <mac address="fa:16:3e:3e:55:16"/>
Apr 11 15:35:43 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:35:43 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:35:43 user nova-compute[71229]:       <target dev="tap19b6c9ca-9d"/>
Apr 11 15:35:43 user nova-compute[71229]:     </interface>
Apr 11 15:35:43 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:35:43 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/console.log" append="off"/>
Apr 11 15:35:43 user nova-compute[71229]:     </serial>
Apr 11 15:35:43 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:35:43 user nova-compute[71229]:     <video>
Apr 11 15:35:43 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:35:43 user nova-compute[71229]:     </video>
Apr 11 15:35:43 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:35:43 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:35:43 user nova-compute[71229]:     </rng>
Apr 11 15:35:43 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:35:43 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:35:43 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:35:43 user nova-compute[71229]:     </memballoon>
Apr 11 15:35:43 user nova-compute[71229]:   </devices>
Apr 11 15:35:43 user nova-compute[71229]: </domain>
Apr 11 15:35:43 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:35:43 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:35:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1775975364',display_name='tempest-TestMinimumBasicScenario-server-1775975364',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1775975364',id=27,image_ref='eef769ca-4518-48cc-8f9b-15f43146d184',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCX38V29uKqq32pbrXcHfjwmsz6kzESDeVl6gqbOhAcULXo21SBTbxQJXUQHaV8PJeMjZRs4D5UehvHzvnc4jeUpiLPu2JFq1xh2/XZqKhiBdFrsxTD5c6W9I6S8vZoQ6A==',key_name='tempest-TestMinimumBasicScenario-1861021757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c23461a3d7ca49f6a77d3fde6f1009d3',ramdisk_id='',reservation_id='r-20z6o102',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eef769ca-4518-48cc-8f9b-15f43146d184',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-673773229',owner_user_name='tempest-TestMinimumBasicScenario-673773229-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:35:41Z,user_data=None,user_id='044f17aee3324b3a97bebe935548b3b4',uuid=1e3d0956-d528-4097-a200-d9b2b6ce7aa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53", "address": "fa:16:3e:3e:55:16", "network": {"id": "b1189892-ba9d-4316-9962-c737b27f14bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1737061315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c23461a3d7ca49f6a77d3fde6f1009d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19b6c9ca-9d", "ovs_interfaceid": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:35:43 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Converting VIF {"id": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53", "address": "fa:16:3e:3e:55:16", "network": {"id": "b1189892-ba9d-4316-9962-c737b27f14bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1737061315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c23461a3d7ca49f6a77d3fde6f1009d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19b6c9ca-9d", "ovs_interfaceid": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:35:43 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:55:16,bridge_name='br-int',has_traffic_filtering=True,id=19b6c9ca-9d18-4f57-9687-ce7ffde5ca53,network=Network(b1189892-ba9d-4316-9962-c737b27f14bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19b6c9ca-9d') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:35:43 user nova-compute[71229]: DEBUG os_vif [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:55:16,bridge_name='br-int',has_traffic_filtering=True,id=19b6c9ca-9d18-4f57-9687-ce7ffde5ca53,network=Network(b1189892-ba9d-4316-9962-c737b27f14bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19b6c9ca-9d') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:35:43 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:43 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:35:43 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:35:43 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:43 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap19b6c9ca-9d, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:35:43 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap19b6c9ca-9d, col_values=(('external_ids', {'iface-id': '19b6c9ca-9d18-4f57-9687-ce7ffde5ca53', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:55:16', 'vm-uuid': '1e3d0956-d528-4097-a200-d9b2b6ce7aa8'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:35:43 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:43 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:35:43 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:43 user nova-compute[71229]: INFO os_vif [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:55:16,bridge_name='br-int',has_traffic_filtering=True,id=19b6c9ca-9d18-4f57-9687-ce7ffde5ca53,network=Network(b1189892-ba9d-4316-9962-c737b27f14bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19b6c9ca-9d')
Apr 11 15:35:43 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:35:43 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] No VIF found with MAC fa:16:3e:3e:55:16, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:35:44 user nova-compute[71229]: DEBUG nova.network.neutron [req-a9e560d6-15ca-4cd0-9db0-d7de1f2ffa4d req-907e8c64-2844-4b95-9a79-b85dea12a196 service nova] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Updated VIF entry in instance network info cache for port 19b6c9ca-9d18-4f57-9687-ce7ffde5ca53. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:35:44 user nova-compute[71229]: DEBUG nova.network.neutron [req-a9e560d6-15ca-4cd0-9db0-d7de1f2ffa4d req-907e8c64-2844-4b95-9a79-b85dea12a196 service nova] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Updating instance_info_cache with network_info: [{"id": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53", "address": "fa:16:3e:3e:55:16", "network": {"id": "b1189892-ba9d-4316-9962-c737b27f14bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1737061315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c23461a3d7ca49f6a77d3fde6f1009d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19b6c9ca-9d", "ovs_interfaceid": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:35:44 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a9e560d6-15ca-4cd0-9db0-d7de1f2ffa4d req-907e8c64-2844-4b95-9a79-b85dea12a196 service nova] Releasing lock "refresh_cache-1e3d0956-d528-4097-a200-d9b2b6ce7aa8" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:35:45 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:45 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:45 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:45 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:45 user nova-compute[71229]: DEBUG nova.compute.manager [req-79058470-7cac-4792-971e-7a4ff1e91497 req-db99c15f-19b2-434c-940d-828e795e68e6 service nova] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Received event network-vif-plugged-19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:35:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-79058470-7cac-4792-971e-7a4ff1e91497 req-db99c15f-19b2-434c-940d-828e795e68e6 service nova] Acquiring lock "1e3d0956-d528-4097-a200-d9b2b6ce7aa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:35:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-79058470-7cac-4792-971e-7a4ff1e91497 req-db99c15f-19b2-434c-940d-828e795e68e6 service nova] Lock "1e3d0956-d528-4097-a200-d9b2b6ce7aa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:35:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-79058470-7cac-4792-971e-7a4ff1e91497 req-db99c15f-19b2-434c-940d-828e795e68e6 service nova] Lock "1e3d0956-d528-4097-a200-d9b2b6ce7aa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:35:45 user nova-compute[71229]: DEBUG nova.compute.manager [req-79058470-7cac-4792-971e-7a4ff1e91497 req-db99c15f-19b2-434c-940d-828e795e68e6 service nova] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] No waiting events found dispatching network-vif-plugged-19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:35:45 user nova-compute[71229]: WARNING nova.compute.manager [req-79058470-7cac-4792-971e-7a4ff1e91497 req-db99c15f-19b2-434c-940d-828e795e68e6 service nova] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Received unexpected event network-vif-plugged-19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 for instance with vm_state building and task_state spawning.
Apr 11 15:35:45 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:47 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227347.6054363, 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:35:47 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] VM Resumed (Lifecycle Event)
Apr 11 15:35:47 user nova-compute[71229]: DEBUG nova.compute.manager [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 15:35:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Guest created on hypervisor {{(pid=71229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 15:35:47 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Instance spawned successfully.
Apr 11 15:35:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 15:35:47 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:35:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Found default for hw_cdrom_bus of ide {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:35:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Found default for hw_disk_bus of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:35:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Found default for hw_input_bus of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:35:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Found default for hw_pointer_model of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:35:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Found default for hw_video_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:35:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Found default for hw_vif_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:35:47 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:35:47 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:35:47 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227347.6113749, 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:35:47 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] VM Started (Lifecycle Event)
Apr 11 15:35:47 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:35:47 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:35:47 user nova-compute[71229]: INFO nova.compute.manager [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Took 6.32 seconds to spawn the instance on the hypervisor.
Apr 11 15:35:47 user nova-compute[71229]: DEBUG nova.compute.manager [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:35:47 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:35:47 user nova-compute[71229]: INFO nova.compute.manager [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Took 7.02 seconds to build instance.
Apr 11 15:35:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-cc76060e-06c9-4040-88cd-957fd9119809 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "1e3d0956-d528-4097-a200-d9b2b6ce7aa8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.131s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:35:47 user nova-compute[71229]: DEBUG nova.compute.manager [req-90098b84-39cc-4bfc-b79e-89f2681e28d4 req-9a3f7de8-acc2-4d48-93bf-34f75b81816e service nova] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Received event network-vif-plugged-19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:35:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-90098b84-39cc-4bfc-b79e-89f2681e28d4 req-9a3f7de8-acc2-4d48-93bf-34f75b81816e service nova] Acquiring lock "1e3d0956-d528-4097-a200-d9b2b6ce7aa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:35:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-90098b84-39cc-4bfc-b79e-89f2681e28d4 req-9a3f7de8-acc2-4d48-93bf-34f75b81816e service nova] Lock "1e3d0956-d528-4097-a200-d9b2b6ce7aa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:35:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-90098b84-39cc-4bfc-b79e-89f2681e28d4 req-9a3f7de8-acc2-4d48-93bf-34f75b81816e service nova] Lock "1e3d0956-d528-4097-a200-d9b2b6ce7aa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:35:47 user nova-compute[71229]: DEBUG nova.compute.manager [req-90098b84-39cc-4bfc-b79e-89f2681e28d4 req-9a3f7de8-acc2-4d48-93bf-34f75b81816e service nova] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] No waiting events found dispatching network-vif-plugged-19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:35:47 user nova-compute[71229]: WARNING nova.compute.manager [req-90098b84-39cc-4bfc-b79e-89f2681e28d4 req-9a3f7de8-acc2-4d48-93bf-34f75b81816e service nova] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Received unexpected event network-vif-plugged-19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 for instance with vm_state active and task_state None.
Apr 11 15:35:48 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:48 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:51 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:51 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:52 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "6f6ae64a-c760-4ba3-8a50-d380835d9913" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:35:52 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "6f6ae64a-c760-4ba3-8a50-d380835d9913" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:35:52 user nova-compute[71229]: DEBUG nova.compute.manager [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Starting instance... {{(pid=71229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 15:35:52 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:35:52 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:35:52 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 15:35:52 user nova-compute[71229]: INFO nova.compute.claims [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Claim successful on node user
Apr 11 15:35:52 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:35:52 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:35:52 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.424s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:35:52 user nova-compute[71229]: DEBUG nova.compute.manager [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Start building networks asynchronously for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 15:35:52 user nova-compute[71229]: DEBUG nova.compute.manager [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Allocating IP information in the background. {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 15:35:52 user nova-compute[71229]: DEBUG nova.network.neutron [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] allocate_for_instance() {{(pid=71229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 15:35:52 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 15:35:52 user nova-compute[71229]: DEBUG nova.compute.manager [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Start building block device mappings for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 15:35:52 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "058df5ba-07ab-4bdd-9a47-907e7b0e0e59" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:35:52 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "058df5ba-07ab-4bdd-9a47-907e7b0e0e59" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:35:53 user nova-compute[71229]: DEBUG nova.policy [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5c8492f96e5d4f54aaae3679c82b6759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd700a53aa25849e0afd562b05881d09a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71229) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 15:35:53 user nova-compute[71229]: DEBUG nova.compute.manager [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Starting instance... {{(pid=71229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 15:35:53 user nova-compute[71229]: DEBUG nova.compute.manager [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Start spawning the instance on the hypervisor. {{(pid=71229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 15:35:53 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Creating instance directory {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 15:35:53 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Creating image(s)
Apr 11 15:35:53 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "/opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:35:53 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "/opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:35:53 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "/opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:35:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:35:53 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:35:53 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:35:53 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 15:35:53 user nova-compute[71229]: INFO nova.compute.claims [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Claim successful on node user
Apr 11 15:35:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.141s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:35:53 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:35:53 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:35:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:35:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.147s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:35:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk 1073741824 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:35:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk 1073741824" returned: 0 in 0.054s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:35:53 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:35:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:35:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.142s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:35:53 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk. size=1073741824 {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 15:35:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:35:53 user nova-compute[71229]: DEBUG nova.network.neutron [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Successfully created port: 2b891eeb-973f-492a-9059-55961bb956bf {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 15:35:53 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:35:53 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:35:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:35:53 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Cannot resize image /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk to a smaller size. {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 15:35:53 user nova-compute[71229]: DEBUG nova.objects.instance [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lazy-loading 'migration_context' on Instance uuid 6f6ae64a-c760-4ba3-8a50-d380835d9913 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:35:53 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Created local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 15:35:53 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Ensure instance console log exists: /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 15:35:53 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:35:53 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:35:53 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:35:53 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.607s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:35:53 user nova-compute[71229]: DEBUG nova.compute.manager [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Start building networks asynchronously for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 15:35:53 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:53 user nova-compute[71229]: DEBUG nova.compute.manager [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Allocating IP information in the background. {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 15:35:53 user nova-compute[71229]: DEBUG nova.network.neutron [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] allocate_for_instance() {{(pid=71229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 15:35:53 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 15:35:53 user nova-compute[71229]: DEBUG nova.compute.manager [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Start building block device mappings for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 15:35:53 user nova-compute[71229]: DEBUG nova.compute.manager [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Start spawning the instance on the hypervisor. {{(pid=71229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 15:35:53 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Creating instance directory {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 15:35:53 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Creating image(s)
Apr 11 15:35:53 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "/opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:35:53 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "/opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:35:53 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "/opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:35:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:35:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.133s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:35:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:35:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:35:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:35:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.172s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:35:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk 1073741824 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:35:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk 1073741824" returned: 0 in 0.052s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:35:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:35:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:35:54 user nova-compute[71229]: DEBUG nova.policy [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5c8492f96e5d4f54aaae3679c82b6759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd700a53aa25849e0afd562b05881d09a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71229) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 15:35:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.158s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:35:54 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Checking if we can resize image /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk. size=1073741824 {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 15:35:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:35:54 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:35:54 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Cannot resize image /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk to a smaller size. {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 15:35:54 user nova-compute[71229]: DEBUG nova.objects.instance [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lazy-loading 'migration_context' on Instance uuid 058df5ba-07ab-4bdd-9a47-907e7b0e0e59 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:35:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Created local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 15:35:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Ensure instance console log exists: /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 15:35:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:35:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:35:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:35:54 user nova-compute[71229]: DEBUG nova.network.neutron [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Successfully updated port: 2b891eeb-973f-492a-9059-55961bb956bf {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:35:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "refresh_cache-6f6ae64a-c760-4ba3-8a50-d380835d9913" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:35:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquired lock "refresh_cache-6f6ae64a-c760-4ba3-8a50-d380835d9913" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:35:54 user nova-compute[71229]: DEBUG nova.network.neutron [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:35:54 user nova-compute[71229]: DEBUG nova.compute.manager [req-5dbd9608-59bf-48ba-8b13-1e2d8f5775ff req-3af06491-b95c-48eb-888c-8fa79bdc1780 service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Received event network-changed-2b891eeb-973f-492a-9059-55961bb956bf {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:35:54 user nova-compute[71229]: DEBUG nova.compute.manager [req-5dbd9608-59bf-48ba-8b13-1e2d8f5775ff req-3af06491-b95c-48eb-888c-8fa79bdc1780 service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Refreshing instance network info cache due to event network-changed-2b891eeb-973f-492a-9059-55961bb956bf. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:35:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-5dbd9608-59bf-48ba-8b13-1e2d8f5775ff req-3af06491-b95c-48eb-888c-8fa79bdc1780 service nova] Acquiring lock "refresh_cache-6f6ae64a-c760-4ba3-8a50-d380835d9913" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:35:54 user nova-compute[71229]: DEBUG nova.network.neutron [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:35:55 user nova-compute[71229]: DEBUG nova.network.neutron [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Successfully created port: cdfec3e6-f5dc-42e6-98a8-651f46bd37f4 {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 15:35:55 user nova-compute[71229]: DEBUG nova.network.neutron [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Updating instance_info_cache with network_info: [{"id": "2b891eeb-973f-492a-9059-55961bb956bf", "address": "fa:16:3e:97:b1:ae", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b891eeb-97", "ovs_interfaceid": "2b891eeb-973f-492a-9059-55961bb956bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:35:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Releasing lock "refresh_cache-6f6ae64a-c760-4ba3-8a50-d380835d9913" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:35:55 user nova-compute[71229]: DEBUG nova.compute.manager [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Instance network_info: |[{"id": "2b891eeb-973f-492a-9059-55961bb956bf", "address": "fa:16:3e:97:b1:ae", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b891eeb-97", "ovs_interfaceid": "2b891eeb-973f-492a-9059-55961bb956bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 15:35:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-5dbd9608-59bf-48ba-8b13-1e2d8f5775ff req-3af06491-b95c-48eb-888c-8fa79bdc1780 service nova] Acquired lock "refresh_cache-6f6ae64a-c760-4ba3-8a50-d380835d9913" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:35:55 user nova-compute[71229]: DEBUG nova.network.neutron [req-5dbd9608-59bf-48ba-8b13-1e2d8f5775ff req-3af06491-b95c-48eb-888c-8fa79bdc1780 service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Refreshing network info cache for port 2b891eeb-973f-492a-9059-55961bb956bf {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:35:55 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Start _get_guest_xml network_info=[{"id": "2b891eeb-973f-492a-9059-55961bb956bf", "address": "fa:16:3e:97:b1:ae", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b891eeb-97", "ovs_interfaceid": "2b891eeb-973f-492a-9059-55961bb956bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '52fe638c-5ada-47d5-b376-233bfa808a37'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:35:55 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:35:55 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:35:55 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:35:55 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:35:55 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:35:55 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:35:55 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:35:55 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:35:55 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:35:55 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:35:55 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:35:55 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:35:55 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:35:55 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:35:55 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:35:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1967250041',display_name='tempest-ServerRescueNegativeTestJSON-server-1967250041',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1967250041',id=28,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d700a53aa25849e0afd562b05881d09a',ramdisk_id='',reservation_id='r-467thbtg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1491000769',owner_user_name='tempest-ServerRescueNegativeTestJSON-1491000769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:35:53Z,user_data=None,user_id='5c8492f96e5d4f54aaae3679c82b6759',uuid=6f6ae64a-c760-4ba3-8a50-d380835d9913,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b891eeb-973f-492a-9059-55961bb956bf", "address": "fa:16:3e:97:b1:ae", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b891eeb-97", "ovs_interfaceid": "2b891eeb-973f-492a-9059-55961bb956bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:35:55 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Converting VIF {"id": "2b891eeb-973f-492a-9059-55961bb956bf", "address": "fa:16:3e:97:b1:ae", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b891eeb-97", "ovs_interfaceid": "2b891eeb-973f-492a-9059-55961bb956bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:35:55 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:b1:ae,bridge_name='br-int',has_traffic_filtering=True,id=2b891eeb-973f-492a-9059-55961bb956bf,network=Network(7ba20249-9c62-46d7-810c-8144c1a1f17e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b891eeb-97') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:35:55 user nova-compute[71229]: DEBUG nova.objects.instance [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f6ae64a-c760-4ba3-8a50-d380835d9913 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:35:55 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:35:55 user nova-compute[71229]:   <uuid>6f6ae64a-c760-4ba3-8a50-d380835d9913</uuid>
Apr 11 15:35:55 user nova-compute[71229]:   <name>instance-0000001c</name>
Apr 11 15:35:55 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:35:55 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:35:55 user nova-compute[71229]:   <metadata>
Apr 11 15:35:55 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:35:55 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:35:55 user nova-compute[71229]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1967250041</nova:name>
Apr 11 15:35:55 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:35:55</nova:creationTime>
Apr 11 15:35:55 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:35:55 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:35:55 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:35:55 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:35:55 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:35:55 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:35:55 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:35:55 user nova-compute[71229]:       <nova:owner>
Apr 11 15:35:55 user nova-compute[71229]:         <nova:user uuid="5c8492f96e5d4f54aaae3679c82b6759">tempest-ServerRescueNegativeTestJSON-1491000769-project-member</nova:user>
Apr 11 15:35:55 user nova-compute[71229]:         <nova:project uuid="d700a53aa25849e0afd562b05881d09a">tempest-ServerRescueNegativeTestJSON-1491000769</nova:project>
Apr 11 15:35:55 user nova-compute[71229]:       </nova:owner>
Apr 11 15:35:55 user nova-compute[71229]:       <nova:root type="image" uuid="52fe638c-5ada-47d5-b376-233bfa808a37"/>
Apr 11 15:35:55 user nova-compute[71229]:       <nova:ports>
Apr 11 15:35:55 user nova-compute[71229]:         <nova:port uuid="2b891eeb-973f-492a-9059-55961bb956bf">
Apr 11 15:35:55 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 11 15:35:55 user nova-compute[71229]:         </nova:port>
Apr 11 15:35:55 user nova-compute[71229]:       </nova:ports>
Apr 11 15:35:55 user nova-compute[71229]:     </nova:instance>
Apr 11 15:35:55 user nova-compute[71229]:   </metadata>
Apr 11 15:35:55 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:35:55 user nova-compute[71229]:     <system>
Apr 11 15:35:55 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:35:55 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:35:55 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:35:55 user nova-compute[71229]:       <entry name="serial">6f6ae64a-c760-4ba3-8a50-d380835d9913</entry>
Apr 11 15:35:55 user nova-compute[71229]:       <entry name="uuid">6f6ae64a-c760-4ba3-8a50-d380835d9913</entry>
Apr 11 15:35:55 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:35:55 user nova-compute[71229]:     </system>
Apr 11 15:35:55 user nova-compute[71229]:   </sysinfo>
Apr 11 15:35:55 user nova-compute[71229]:   <os>
Apr 11 15:35:55 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:35:55 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 15:35:55 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:35:55 user nova-compute[71229]:   </os>
Apr 11 15:35:55 user nova-compute[71229]:   <features>
Apr 11 15:35:55 user nova-compute[71229]:     <acpi/>
Apr 11 15:35:55 user nova-compute[71229]:     <apic/>
Apr 11 15:35:55 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:35:55 user nova-compute[71229]:   </features>
Apr 11 15:35:55 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:35:55 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:35:55 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:35:55 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:35:55 user nova-compute[71229]:   </clock>
Apr 11 15:35:55 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:35:55 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:35:55 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:35:55 user nova-compute[71229]:   </cpu>
Apr 11 15:35:55 user nova-compute[71229]:   <devices>
Apr 11 15:35:55 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 15:35:55 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 15:35:55 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk"/>
Apr 11 15:35:55 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:35:55 user nova-compute[71229]:     </disk>
Apr 11 15:35:55 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:35:55 user nova-compute[71229]:       <mac address="fa:16:3e:97:b1:ae"/>
Apr 11 15:35:55 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:35:55 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:35:55 user nova-compute[71229]:       <target dev="tap2b891eeb-97"/>
Apr 11 15:35:55 user nova-compute[71229]:     </interface>
Apr 11 15:35:55 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:35:55 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/console.log" append="off"/>
Apr 11 15:35:55 user nova-compute[71229]:     </serial>
Apr 11 15:35:55 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:35:55 user nova-compute[71229]:     <video>
Apr 11 15:35:55 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:35:55 user nova-compute[71229]:     </video>
Apr 11 15:35:55 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:35:55 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:35:55 user nova-compute[71229]:     </rng>
Apr 11 15:35:55 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:35:55 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:35:55 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:35:55 user nova-compute[71229]:     </memballoon>
Apr 11 15:35:55 user nova-compute[71229]:   </devices>
Apr 11 15:35:55 user nova-compute[71229]: </domain>
Apr 11 15:35:55 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:35:55 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:35:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1967250041',display_name='tempest-ServerRescueNegativeTestJSON-server-1967250041',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1967250041',id=28,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d700a53aa25849e0afd562b05881d09a',ramdisk_id='',reservation_id='r-467thbtg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1491000769',owner_user_name='tempest-ServerRescueNegativeTestJSON-1491000769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:35:53Z,user_data=None,user_id='5c8492f96e5d4f54aaae3679c82b6759',uuid=6f6ae64a-c760-4ba3-8a50-d380835d9913,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b891eeb-973f-492a-9059-55961bb956bf", "address": "fa:16:3e:97:b1:ae", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b891eeb-97", "ovs_interfaceid": "2b891eeb-973f-492a-9059-55961bb956bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:35:55 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Converting VIF {"id": "2b891eeb-973f-492a-9059-55961bb956bf", "address": "fa:16:3e:97:b1:ae", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b891eeb-97", "ovs_interfaceid": "2b891eeb-973f-492a-9059-55961bb956bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:35:55 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:b1:ae,bridge_name='br-int',has_traffic_filtering=True,id=2b891eeb-973f-492a-9059-55961bb956bf,network=Network(7ba20249-9c62-46d7-810c-8144c1a1f17e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b891eeb-97') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:35:55 user nova-compute[71229]: DEBUG os_vif [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:b1:ae,bridge_name='br-int',has_traffic_filtering=True,id=2b891eeb-973f-492a-9059-55961bb956bf,network=Network(7ba20249-9c62-46d7-810c-8144c1a1f17e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b891eeb-97') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:35:55 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:55 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:35:55 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:35:55 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:55 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b891eeb-97, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:35:55 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2b891eeb-97, col_values=(('external_ids', {'iface-id': '2b891eeb-973f-492a-9059-55961bb956bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:b1:ae', 'vm-uuid': '6f6ae64a-c760-4ba3-8a50-d380835d9913'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:35:55 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:55 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:35:55 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:55 user nova-compute[71229]: INFO os_vif [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:b1:ae,bridge_name='br-int',has_traffic_filtering=True,id=2b891eeb-973f-492a-9059-55961bb956bf,network=Network(7ba20249-9c62-46d7-810c-8144c1a1f17e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b891eeb-97')
Apr 11 15:35:55 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:35:55 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] No VIF found with MAC fa:16:3e:97:b1:ae, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:35:55 user nova-compute[71229]: DEBUG nova.network.neutron [req-5dbd9608-59bf-48ba-8b13-1e2d8f5775ff req-3af06491-b95c-48eb-888c-8fa79bdc1780 service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Updated VIF entry in instance network info cache for port 2b891eeb-973f-492a-9059-55961bb956bf. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:35:55 user nova-compute[71229]: DEBUG nova.network.neutron [req-5dbd9608-59bf-48ba-8b13-1e2d8f5775ff req-3af06491-b95c-48eb-888c-8fa79bdc1780 service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Updating instance_info_cache with network_info: [{"id": "2b891eeb-973f-492a-9059-55961bb956bf", "address": "fa:16:3e:97:b1:ae", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b891eeb-97", "ovs_interfaceid": "2b891eeb-973f-492a-9059-55961bb956bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:35:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-5dbd9608-59bf-48ba-8b13-1e2d8f5775ff req-3af06491-b95c-48eb-888c-8fa79bdc1780 service nova] Releasing lock "refresh_cache-6f6ae64a-c760-4ba3-8a50-d380835d9913" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:35:55 user nova-compute[71229]: DEBUG nova.network.neutron [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Successfully updated port: cdfec3e6-f5dc-42e6-98a8-651f46bd37f4 {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:35:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "refresh_cache-058df5ba-07ab-4bdd-9a47-907e7b0e0e59" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:35:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquired lock "refresh_cache-058df5ba-07ab-4bdd-9a47-907e7b0e0e59" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:35:55 user nova-compute[71229]: DEBUG nova.network.neutron [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:35:55 user nova-compute[71229]: DEBUG nova.compute.manager [req-fe0c03a6-6962-434c-b57a-a134e8c61fad req-3603efc3-894b-4554-8c39-2ea488f68ffc service nova] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Received event network-changed-cdfec3e6-f5dc-42e6-98a8-651f46bd37f4 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:35:55 user nova-compute[71229]: DEBUG nova.compute.manager [req-fe0c03a6-6962-434c-b57a-a134e8c61fad req-3603efc3-894b-4554-8c39-2ea488f68ffc service nova] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Refreshing instance network info cache due to event network-changed-cdfec3e6-f5dc-42e6-98a8-651f46bd37f4. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:35:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-fe0c03a6-6962-434c-b57a-a134e8c61fad req-3603efc3-894b-4554-8c39-2ea488f68ffc service nova] Acquiring lock "refresh_cache-058df5ba-07ab-4bdd-9a47-907e7b0e0e59" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:35:55 user nova-compute[71229]: DEBUG nova.network.neutron [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:35:56 user nova-compute[71229]: DEBUG nova.network.neutron [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Updating instance_info_cache with network_info: [{"id": "cdfec3e6-f5dc-42e6-98a8-651f46bd37f4", "address": "fa:16:3e:47:d3:74", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdfec3e6-f5", "ovs_interfaceid": "cdfec3e6-f5dc-42e6-98a8-651f46bd37f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:35:56 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Releasing lock "refresh_cache-058df5ba-07ab-4bdd-9a47-907e7b0e0e59" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:35:56 user nova-compute[71229]: DEBUG nova.compute.manager [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Instance network_info: |[{"id": "cdfec3e6-f5dc-42e6-98a8-651f46bd37f4", "address": "fa:16:3e:47:d3:74", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdfec3e6-f5", "ovs_interfaceid": "cdfec3e6-f5dc-42e6-98a8-651f46bd37f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 15:35:56 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-fe0c03a6-6962-434c-b57a-a134e8c61fad req-3603efc3-894b-4554-8c39-2ea488f68ffc service nova] Acquired lock "refresh_cache-058df5ba-07ab-4bdd-9a47-907e7b0e0e59" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:35:56 user nova-compute[71229]: DEBUG nova.network.neutron [req-fe0c03a6-6962-434c-b57a-a134e8c61fad req-3603efc3-894b-4554-8c39-2ea488f68ffc service nova] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Refreshing network info cache for port cdfec3e6-f5dc-42e6-98a8-651f46bd37f4 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:35:56 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Start _get_guest_xml network_info=[{"id": "cdfec3e6-f5dc-42e6-98a8-651f46bd37f4", "address": "fa:16:3e:47:d3:74", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdfec3e6-f5", "ovs_interfaceid": "cdfec3e6-f5dc-42e6-98a8-651f46bd37f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '52fe638c-5ada-47d5-b376-233bfa808a37'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:35:56 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:35:56 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:35:56 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:35:56 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:35:56 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:35:56 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:35:56 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:35:56 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:35:56 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:35:56 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:35:56 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:35:56 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:35:56 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:35:56 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:35:56 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:35:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1607555869',display_name='tempest-ServerRescueNegativeTestJSON-server-1607555869',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1607555869',id=29,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d700a53aa25849e0afd562b05881d09a',ramdisk_id='',reservation_id='r-z6w5qaef',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1491000769',owner_user_name='tempest-ServerRescueNegativeTestJSON-1491000769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:35:54Z,user_data=None,user_id='5c8492f96e5d4f54aaae3679c82b6759',uuid=058df5ba-07ab-4bdd-9a47-907e7b0e0e59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cdfec3e6-f5dc-42e6-98a8-651f46bd37f4", "address": "fa:16:3e:47:d3:74", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdfec3e6-f5", "ovs_interfaceid": "cdfec3e6-f5dc-42e6-98a8-651f46bd37f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:35:56 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Converting VIF {"id": "cdfec3e6-f5dc-42e6-98a8-651f46bd37f4", "address": "fa:16:3e:47:d3:74", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdfec3e6-f5", "ovs_interfaceid": "cdfec3e6-f5dc-42e6-98a8-651f46bd37f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:35:56 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:d3:74,bridge_name='br-int',has_traffic_filtering=True,id=cdfec3e6-f5dc-42e6-98a8-651f46bd37f4,network=Network(7ba20249-9c62-46d7-810c-8144c1a1f17e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdfec3e6-f5') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:35:56 user nova-compute[71229]: DEBUG nova.objects.instance [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lazy-loading 'pci_devices' on Instance uuid 058df5ba-07ab-4bdd-9a47-907e7b0e0e59 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:35:56 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:35:56 user nova-compute[71229]:   <uuid>058df5ba-07ab-4bdd-9a47-907e7b0e0e59</uuid>
Apr 11 15:35:56 user nova-compute[71229]:   <name>instance-0000001d</name>
Apr 11 15:35:56 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:35:56 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:35:56 user nova-compute[71229]:   <metadata>
Apr 11 15:35:56 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:35:56 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:35:56 user nova-compute[71229]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1607555869</nova:name>
Apr 11 15:35:56 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:35:56</nova:creationTime>
Apr 11 15:35:56 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:35:56 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:35:56 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:35:56 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:35:56 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:35:56 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:35:56 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:35:56 user nova-compute[71229]:       <nova:owner>
Apr 11 15:35:56 user nova-compute[71229]:         <nova:user uuid="5c8492f96e5d4f54aaae3679c82b6759">tempest-ServerRescueNegativeTestJSON-1491000769-project-member</nova:user>
Apr 11 15:35:56 user nova-compute[71229]:         <nova:project uuid="d700a53aa25849e0afd562b05881d09a">tempest-ServerRescueNegativeTestJSON-1491000769</nova:project>
Apr 11 15:35:56 user nova-compute[71229]:       </nova:owner>
Apr 11 15:35:56 user nova-compute[71229]:       <nova:root type="image" uuid="52fe638c-5ada-47d5-b376-233bfa808a37"/>
Apr 11 15:35:56 user nova-compute[71229]:       <nova:ports>
Apr 11 15:35:56 user nova-compute[71229]:         <nova:port uuid="cdfec3e6-f5dc-42e6-98a8-651f46bd37f4">
Apr 11 15:35:56 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 11 15:35:56 user nova-compute[71229]:         </nova:port>
Apr 11 15:35:56 user nova-compute[71229]:       </nova:ports>
Apr 11 15:35:56 user nova-compute[71229]:     </nova:instance>
Apr 11 15:35:56 user nova-compute[71229]:   </metadata>
Apr 11 15:35:56 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:35:56 user nova-compute[71229]:     <system>
Apr 11 15:35:56 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:35:56 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:35:56 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:35:56 user nova-compute[71229]:       <entry name="serial">058df5ba-07ab-4bdd-9a47-907e7b0e0e59</entry>
Apr 11 15:35:56 user nova-compute[71229]:       <entry name="uuid">058df5ba-07ab-4bdd-9a47-907e7b0e0e59</entry>
Apr 11 15:35:56 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:35:56 user nova-compute[71229]:     </system>
Apr 11 15:35:56 user nova-compute[71229]:   </sysinfo>
Apr 11 15:35:56 user nova-compute[71229]:   <os>
Apr 11 15:35:56 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:35:56 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 15:35:56 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:35:56 user nova-compute[71229]:   </os>
Apr 11 15:35:56 user nova-compute[71229]:   <features>
Apr 11 15:35:56 user nova-compute[71229]:     <acpi/>
Apr 11 15:35:56 user nova-compute[71229]:     <apic/>
Apr 11 15:35:56 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:35:56 user nova-compute[71229]:   </features>
Apr 11 15:35:56 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:35:56 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:35:56 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:35:56 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:35:56 user nova-compute[71229]:   </clock>
Apr 11 15:35:56 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:35:56 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:35:56 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:35:56 user nova-compute[71229]:   </cpu>
Apr 11 15:35:56 user nova-compute[71229]:   <devices>
Apr 11 15:35:56 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 15:35:56 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 15:35:56 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk"/>
Apr 11 15:35:56 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:35:56 user nova-compute[71229]:     </disk>
Apr 11 15:35:56 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:35:56 user nova-compute[71229]:       <mac address="fa:16:3e:47:d3:74"/>
Apr 11 15:35:56 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:35:56 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:35:56 user nova-compute[71229]:       <target dev="tapcdfec3e6-f5"/>
Apr 11 15:35:56 user nova-compute[71229]:     </interface>
Apr 11 15:35:56 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:35:56 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/console.log" append="off"/>
Apr 11 15:35:56 user nova-compute[71229]:     </serial>
Apr 11 15:35:56 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:35:56 user nova-compute[71229]:     <video>
Apr 11 15:35:56 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:35:56 user nova-compute[71229]:     </video>
Apr 11 15:35:56 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:35:56 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:35:56 user nova-compute[71229]:     </rng>
Apr 11 15:35:56 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:35:56 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:35:56 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:35:56 user nova-compute[71229]:     </memballoon>
Apr 11 15:35:56 user nova-compute[71229]:   </devices>
Apr 11 15:35:56 user nova-compute[71229]: </domain>
Apr 11 15:35:56 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:35:56 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:35:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1607555869',display_name='tempest-ServerRescueNegativeTestJSON-server-1607555869',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1607555869',id=29,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d700a53aa25849e0afd562b05881d09a',ramdisk_id='',reservation_id='r-z6w5qaef',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1491000769',owner_user_name='tempest-ServerRescueNegativeTestJSON-1491000769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:35:54Z,user_data=None,user_id='5c8492f96e5d4f54aaae3679c82b6759',uuid=058df5ba-07ab-4bdd-9a47-907e7b0e0e59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cdfec3e6-f5dc-42e6-98a8-651f46bd37f4", "address": "fa:16:3e:47:d3:74", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdfec3e6-f5", "ovs_interfaceid": "cdfec3e6-f5dc-42e6-98a8-651f46bd37f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:35:56 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Converting VIF {"id": "cdfec3e6-f5dc-42e6-98a8-651f46bd37f4", "address": "fa:16:3e:47:d3:74", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdfec3e6-f5", "ovs_interfaceid": "cdfec3e6-f5dc-42e6-98a8-651f46bd37f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:35:56 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:d3:74,bridge_name='br-int',has_traffic_filtering=True,id=cdfec3e6-f5dc-42e6-98a8-651f46bd37f4,network=Network(7ba20249-9c62-46d7-810c-8144c1a1f17e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdfec3e6-f5') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:35:56 user nova-compute[71229]: DEBUG os_vif [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:d3:74,bridge_name='br-int',has_traffic_filtering=True,id=cdfec3e6-f5dc-42e6-98a8-651f46bd37f4,network=Network(7ba20249-9c62-46d7-810c-8144c1a1f17e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdfec3e6-f5') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:35:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:35:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:35:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcdfec3e6-f5, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:35:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcdfec3e6-f5, col_values=(('external_ids', {'iface-id': 'cdfec3e6-f5dc-42e6-98a8-651f46bd37f4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:d3:74', 'vm-uuid': '058df5ba-07ab-4bdd-9a47-907e7b0e0e59'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:35:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:35:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:56 user nova-compute[71229]: INFO os_vif [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:d3:74,bridge_name='br-int',has_traffic_filtering=True,id=cdfec3e6-f5dc-42e6-98a8-651f46bd37f4,network=Network(7ba20249-9c62-46d7-810c-8144c1a1f17e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdfec3e6-f5')
Apr 11 15:35:56 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:35:56 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] No VIF found with MAC fa:16:3e:47:d3:74, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:35:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:56 user nova-compute[71229]: DEBUG nova.network.neutron [req-fe0c03a6-6962-434c-b57a-a134e8c61fad req-3603efc3-894b-4554-8c39-2ea488f68ffc service nova] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Updated VIF entry in instance network info cache for port cdfec3e6-f5dc-42e6-98a8-651f46bd37f4. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:35:56 user nova-compute[71229]: DEBUG nova.network.neutron [req-fe0c03a6-6962-434c-b57a-a134e8c61fad req-3603efc3-894b-4554-8c39-2ea488f68ffc service nova] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Updating instance_info_cache with network_info: [{"id": "cdfec3e6-f5dc-42e6-98a8-651f46bd37f4", "address": "fa:16:3e:47:d3:74", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdfec3e6-f5", "ovs_interfaceid": "cdfec3e6-f5dc-42e6-98a8-651f46bd37f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:35:56 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-fe0c03a6-6962-434c-b57a-a134e8c61fad req-3603efc3-894b-4554-8c39-2ea488f68ffc service nova] Releasing lock "refresh_cache-058df5ba-07ab-4bdd-9a47-907e7b0e0e59" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:35:56 user nova-compute[71229]: DEBUG nova.compute.manager [req-3a40b5f0-4204-4ec9-8f8a-1e831df5b9c7 req-2fff256a-0121-47f9-81c1-bb3016993dc2 service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Received event network-vif-plugged-2b891eeb-973f-492a-9059-55961bb956bf {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:35:56 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3a40b5f0-4204-4ec9-8f8a-1e831df5b9c7 req-2fff256a-0121-47f9-81c1-bb3016993dc2 service nova] Acquiring lock "6f6ae64a-c760-4ba3-8a50-d380835d9913-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:35:56 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3a40b5f0-4204-4ec9-8f8a-1e831df5b9c7 req-2fff256a-0121-47f9-81c1-bb3016993dc2 service nova] Lock "6f6ae64a-c760-4ba3-8a50-d380835d9913-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:35:56 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3a40b5f0-4204-4ec9-8f8a-1e831df5b9c7 req-2fff256a-0121-47f9-81c1-bb3016993dc2 service nova] Lock "6f6ae64a-c760-4ba3-8a50-d380835d9913-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:35:56 user nova-compute[71229]: DEBUG nova.compute.manager [req-3a40b5f0-4204-4ec9-8f8a-1e831df5b9c7 req-2fff256a-0121-47f9-81c1-bb3016993dc2 service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] No waiting events found dispatching network-vif-plugged-2b891eeb-973f-492a-9059-55961bb956bf {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:35:56 user nova-compute[71229]: WARNING nova.compute.manager [req-3a40b5f0-4204-4ec9-8f8a-1e831df5b9c7 req-2fff256a-0121-47f9-81c1-bb3016993dc2 service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Received unexpected event network-vif-plugged-2b891eeb-973f-492a-9059-55961bb956bf for instance with vm_state building and task_state spawning.
Apr 11 15:35:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:57 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:57 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:57 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:57 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:57 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:58 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:58 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:58 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:58 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:58 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:35:58 user nova-compute[71229]: DEBUG nova.compute.manager [req-626bcb3a-fc7d-44c0-86cb-5ff937977fd5 req-1b81c977-c10d-4941-a2ed-3c3d65d01f73 service nova] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Received event network-vif-plugged-cdfec3e6-f5dc-42e6-98a8-651f46bd37f4 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:35:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-626bcb3a-fc7d-44c0-86cb-5ff937977fd5 req-1b81c977-c10d-4941-a2ed-3c3d65d01f73 service nova] Acquiring lock "058df5ba-07ab-4bdd-9a47-907e7b0e0e59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:35:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-626bcb3a-fc7d-44c0-86cb-5ff937977fd5 req-1b81c977-c10d-4941-a2ed-3c3d65d01f73 service nova] Lock "058df5ba-07ab-4bdd-9a47-907e7b0e0e59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:35:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-626bcb3a-fc7d-44c0-86cb-5ff937977fd5 req-1b81c977-c10d-4941-a2ed-3c3d65d01f73 service nova] Lock "058df5ba-07ab-4bdd-9a47-907e7b0e0e59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:35:58 user nova-compute[71229]: DEBUG nova.compute.manager [req-626bcb3a-fc7d-44c0-86cb-5ff937977fd5 req-1b81c977-c10d-4941-a2ed-3c3d65d01f73 service nova] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] No waiting events found dispatching network-vif-plugged-cdfec3e6-f5dc-42e6-98a8-651f46bd37f4 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:35:58 user nova-compute[71229]: WARNING nova.compute.manager [req-626bcb3a-fc7d-44c0-86cb-5ff937977fd5 req-1b81c977-c10d-4941-a2ed-3c3d65d01f73 service nova] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Received unexpected event network-vif-plugged-cdfec3e6-f5dc-42e6-98a8-651f46bd37f4 for instance with vm_state building and task_state spawning.
Apr 11 15:35:58 user nova-compute[71229]: DEBUG nova.compute.manager [req-80a03259-e7e2-4f86-aff9-1f65fffc7076 req-2239412d-75ce-4e5c-9b48-923c786b6a6f service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Received event network-vif-plugged-2b891eeb-973f-492a-9059-55961bb956bf {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:35:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-80a03259-e7e2-4f86-aff9-1f65fffc7076 req-2239412d-75ce-4e5c-9b48-923c786b6a6f service nova] Acquiring lock "6f6ae64a-c760-4ba3-8a50-d380835d9913-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:35:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-80a03259-e7e2-4f86-aff9-1f65fffc7076 req-2239412d-75ce-4e5c-9b48-923c786b6a6f service nova] Lock "6f6ae64a-c760-4ba3-8a50-d380835d9913-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:35:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-80a03259-e7e2-4f86-aff9-1f65fffc7076 req-2239412d-75ce-4e5c-9b48-923c786b6a6f service nova] Lock "6f6ae64a-c760-4ba3-8a50-d380835d9913-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:35:58 user nova-compute[71229]: DEBUG nova.compute.manager [req-80a03259-e7e2-4f86-aff9-1f65fffc7076 req-2239412d-75ce-4e5c-9b48-923c786b6a6f service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] No waiting events found dispatching network-vif-plugged-2b891eeb-973f-492a-9059-55961bb956bf {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:35:58 user nova-compute[71229]: WARNING nova.compute.manager [req-80a03259-e7e2-4f86-aff9-1f65fffc7076 req-2239412d-75ce-4e5c-9b48-923c786b6a6f service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Received unexpected event network-vif-plugged-2b891eeb-973f-492a-9059-55961bb956bf for instance with vm_state building and task_state spawning.
Apr 11 15:36:00 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227360.1617823, 6f6ae64a-c760-4ba3-8a50-d380835d9913 => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:36:00 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] VM Resumed (Lifecycle Event)
Apr 11 15:36:00 user nova-compute[71229]: DEBUG nova.compute.manager [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 15:36:00 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Guest created on hypervisor {{(pid=71229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 15:36:00 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Instance spawned successfully.
Apr 11 15:36:00 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 15:36:00 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:36:00 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:36:00 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Found default for hw_cdrom_bus of ide {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:36:00 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Found default for hw_disk_bus of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:36:00 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Found default for hw_input_bus of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:36:00 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Found default for hw_pointer_model of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:36:00 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Found default for hw_video_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:36:00 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Found default for hw_vif_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:36:00 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:36:00 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227360.1650474, 6f6ae64a-c760-4ba3-8a50-d380835d9913 => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:36:00 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] VM Started (Lifecycle Event)
Apr 11 15:36:00 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:36:00 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:36:00 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:36:00 user nova-compute[71229]: INFO nova.compute.manager [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Took 7.25 seconds to spawn the instance on the hypervisor.
Apr 11 15:36:00 user nova-compute[71229]: DEBUG nova.compute.manager [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:36:00 user nova-compute[71229]: INFO nova.compute.manager [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Took 8.06 seconds to build instance.
Apr 11 15:36:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d4cce55f-d1b1-45bc-9001-12e44cad09a3 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "6f6ae64a-c760-4ba3-8a50-d380835d9913" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.167s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:36:00 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227360.5023272, 058df5ba-07ab-4bdd-9a47-907e7b0e0e59 => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:36:00 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] VM Resumed (Lifecycle Event)
Apr 11 15:36:00 user nova-compute[71229]: DEBUG nova.compute.manager [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 15:36:00 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Guest created on hypervisor {{(pid=71229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 15:36:00 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Instance spawned successfully.
Apr 11 15:36:00 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 15:36:00 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:36:00 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:36:00 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Found default for hw_cdrom_bus of ide {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:36:00 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Found default for hw_disk_bus of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:36:00 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Found default for hw_input_bus of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:36:00 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Found default for hw_pointer_model of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:36:00 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Found default for hw_video_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:36:00 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Found default for hw_vif_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:36:00 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:36:00 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227360.5068583, 058df5ba-07ab-4bdd-9a47-907e7b0e0e59 => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:36:00 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] VM Started (Lifecycle Event)
Apr 11 15:36:00 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:36:00 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:36:00 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:36:00 user nova-compute[71229]: DEBUG nova.compute.manager [req-b1a27e61-1627-4e2b-a43a-374c9be23dbe req-291dd64d-34c5-424e-b0cd-4efdc92a2487 service nova] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Received event network-vif-plugged-cdfec3e6-f5dc-42e6-98a8-651f46bd37f4 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:36:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-b1a27e61-1627-4e2b-a43a-374c9be23dbe req-291dd64d-34c5-424e-b0cd-4efdc92a2487 service nova] Acquiring lock "058df5ba-07ab-4bdd-9a47-907e7b0e0e59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:36:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-b1a27e61-1627-4e2b-a43a-374c9be23dbe req-291dd64d-34c5-424e-b0cd-4efdc92a2487 service nova] Lock "058df5ba-07ab-4bdd-9a47-907e7b0e0e59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:36:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-b1a27e61-1627-4e2b-a43a-374c9be23dbe req-291dd64d-34c5-424e-b0cd-4efdc92a2487 service nova] Lock "058df5ba-07ab-4bdd-9a47-907e7b0e0e59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:36:00 user nova-compute[71229]: DEBUG nova.compute.manager [req-b1a27e61-1627-4e2b-a43a-374c9be23dbe req-291dd64d-34c5-424e-b0cd-4efdc92a2487 service nova] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] No waiting events found dispatching network-vif-plugged-cdfec3e6-f5dc-42e6-98a8-651f46bd37f4 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:36:00 user nova-compute[71229]: WARNING nova.compute.manager [req-b1a27e61-1627-4e2b-a43a-374c9be23dbe req-291dd64d-34c5-424e-b0cd-4efdc92a2487 service nova] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Received unexpected event network-vif-plugged-cdfec3e6-f5dc-42e6-98a8-651f46bd37f4 for instance with vm_state building and task_state spawning.
Apr 11 15:36:00 user nova-compute[71229]: INFO nova.compute.manager [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Took 6.69 seconds to spawn the instance on the hypervisor.
Apr 11 15:36:00 user nova-compute[71229]: DEBUG nova.compute.manager [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:36:00 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:36:00 user nova-compute[71229]: INFO nova.compute.manager [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Took 7.62 seconds to build instance.
Apr 11 15:36:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:36:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:36:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:36:00 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 15:36:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-74564e2d-2534-4e75-81bc-88e73668f04a tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "058df5ba-07ab-4bdd-9a47-907e7b0e0e59" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.755s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:36:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:36:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:36:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:36:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:36:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:36:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:36:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:36:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:36:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:36:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:36:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:36:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:36:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:36:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:36:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85658a44-9ff2-4553-b9fd-686bf35fd6ec/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:36:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:36:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85658a44-9ff2-4553-b9fd-686bf35fd6ec/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:36:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85658a44-9ff2-4553-b9fd-686bf35fd6ec/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:36:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85658a44-9ff2-4553-b9fd-686bf35fd6ec/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:36:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc25fc1-e59f-42c8-a371-b4b12e17fd59/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:36:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc25fc1-e59f-42c8-a371-b4b12e17fd59/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:36:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc25fc1-e59f-42c8-a371-b4b12e17fd59/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:36:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc25fc1-e59f-42c8-a371-b4b12e17fd59/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:36:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f34c2249-840e-4475-87e6-648d173bc7ed/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:36:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f34c2249-840e-4475-87e6-648d173bc7ed/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:36:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f34c2249-840e-4475-87e6-648d173bc7ed/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:36:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f34c2249-840e-4475-87e6-648d173bc7ed/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:36:02 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:36:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d09cda86-eca1-4c42-8654-758eb6cd30e0/disk.rescue --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:36:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d09cda86-eca1-4c42-8654-758eb6cd30e0/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:36:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d09cda86-eca1-4c42-8654-758eb6cd30e0/disk.rescue --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:36:03 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d09cda86-eca1-4c42-8654-758eb6cd30e0/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:36:03 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:36:03 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:36:03 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:36:03 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:36:03 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:36:03 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:36:03 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:36:03 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:36:03 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:36:03 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:36:03 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:36:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:36:04 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:36:04 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:36:04 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=7942MB free_disk=25.82320785522461GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 15:36:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:36:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:36:04 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance de1a45fd-27be-4438-80a4-2f3a100643c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:36:04 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance b0d90fd2-6a95-43c4-8756-e82071d99154 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:36:04 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 7c4329ae-07cb-4f28-9fd6-29b398517d2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:36:04 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 85658a44-9ff2-4553-b9fd-686bf35fd6ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:36:04 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance d09cda86-eca1-4c42-8654-758eb6cd30e0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:36:04 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance f34c2249-840e-4475-87e6-648d173bc7ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:36:04 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance ffc25fc1-e59f-42c8-a371-b4b12e17fd59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:36:04 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance dcbfcbfd-7e96-4271-94ee-60ef937e3b7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:36:04 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:36:04 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 6f6ae64a-c760-4ba3-8a50-d380835d9913 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:36:04 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 058df5ba-07ab-4bdd-9a47-907e7b0e0e59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:36:04 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 15:36:04 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 15:36:05 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:36:05 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:36:05 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 15:36:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.595s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:36:06 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:36:06 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:36:06 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 15:36:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "refresh_cache-ffc25fc1-e59f-42c8-a371-b4b12e17fd59" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:36:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquired lock "refresh_cache-ffc25fc1-e59f-42c8-a371-b4b12e17fd59" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:36:06 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Forcefully refreshing network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 15:36:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:36:06 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Updating instance_info_cache with network_info: [{"id": "3ae0cd28-c459-47b7-be17-133b69773f9c", "address": "fa:16:3e:b9:69:19", "network": {"id": "15a1a586-0100-4057-8501-5c5a282d4063", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834988552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b9b79fb98441fd9f1b5df54471f0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae0cd28-c4", "ovs_interfaceid": "3ae0cd28-c459-47b7-be17-133b69773f9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:36:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Releasing lock "refresh_cache-ffc25fc1-e59f-42c8-a371-b4b12e17fd59" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:36:06 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Updated the network info_cache for instance {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 15:36:06 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:36:06 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:36:06 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:36:06 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:36:06 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:36:06 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:36:06 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 15:36:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:36:07 user nova-compute[71229]: INFO nova.compute.manager [None req-f96c44b2-2622-4f57-8349-0944f7ae2eb2 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Unrescuing
Apr 11 15:36:07 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f96c44b2-2622-4f57-8349-0944f7ae2eb2 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "refresh_cache-d09cda86-eca1-4c42-8654-758eb6cd30e0" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:36:07 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f96c44b2-2622-4f57-8349-0944f7ae2eb2 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquired lock "refresh_cache-d09cda86-eca1-4c42-8654-758eb6cd30e0" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:36:07 user nova-compute[71229]: DEBUG nova.network.neutron [None req-f96c44b2-2622-4f57-8349-0944f7ae2eb2 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:36:08 user nova-compute[71229]: DEBUG nova.network.neutron [None req-f96c44b2-2622-4f57-8349-0944f7ae2eb2 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Updating instance_info_cache with network_info: [{"id": "27d62f09-c938-4a71-be1e-6dc1d6a47382", "address": "fa:16:3e:53:ab:3d", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d62f09-c9", "ovs_interfaceid": "27d62f09-c938-4a71-be1e-6dc1d6a47382", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:36:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f96c44b2-2622-4f57-8349-0944f7ae2eb2 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Releasing lock "refresh_cache-d09cda86-eca1-4c42-8654-758eb6cd30e0" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:36:08 user nova-compute[71229]: DEBUG nova.objects.instance [None req-f96c44b2-2622-4f57-8349-0944f7ae2eb2 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lazy-loading 'flavor' on Instance uuid d09cda86-eca1-4c42-8654-758eb6cd30e0 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:36:08 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:36:08 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:36:08 user nova-compute[71229]: DEBUG nova.compute.manager [req-d3e45dc3-8652-4cf6-9c9a-147c4d3aba40 req-ec7db6e0-373a-4407-8212-11e8a07ff57c service nova] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Received event network-vif-unplugged-27d62f09-c938-4a71-be1e-6dc1d6a47382 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:36:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-d3e45dc3-8652-4cf6-9c9a-147c4d3aba40 req-ec7db6e0-373a-4407-8212-11e8a07ff57c service nova] Acquiring lock "d09cda86-eca1-4c42-8654-758eb6cd30e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:36:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-d3e45dc3-8652-4cf6-9c9a-147c4d3aba40 req-ec7db6e0-373a-4407-8212-11e8a07ff57c service nova] Lock "d09cda86-eca1-4c42-8654-758eb6cd30e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:36:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-d3e45dc3-8652-4cf6-9c9a-147c4d3aba40 req-ec7db6e0-373a-4407-8212-11e8a07ff57c service nova] Lock "d09cda86-eca1-4c42-8654-758eb6cd30e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:36:08 user nova-compute[71229]: DEBUG nova.compute.manager [req-d3e45dc3-8652-4cf6-9c9a-147c4d3aba40 req-ec7db6e0-373a-4407-8212-11e8a07ff57c service nova] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] No waiting events found dispatching network-vif-unplugged-27d62f09-c938-4a71-be1e-6dc1d6a47382 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:36:08 user nova-compute[71229]: WARNING nova.compute.manager [req-d3e45dc3-8652-4cf6-9c9a-147c4d3aba40 req-ec7db6e0-373a-4407-8212-11e8a07ff57c service nova] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Received unexpected event network-vif-unplugged-27d62f09-c938-4a71-be1e-6dc1d6a47382 for instance with vm_state rescued and task_state unrescuing.
Apr 11 15:36:08 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:36:08 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:36:09 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Instance destroyed successfully.
Apr 11 15:36:10 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:36:10 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:36:10 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:36:10 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:36:10 user nova-compute[71229]: DEBUG nova.compute.manager [req-738f6b9b-1e27-4226-a3c5-621f3e49a931 req-716c6e5a-51dc-44f0-9d4b-0274d37d92d4 service nova] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Received event network-vif-plugged-27d62f09-c938-4a71-be1e-6dc1d6a47382 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:36:10 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-738f6b9b-1e27-4226-a3c5-621f3e49a931 req-716c6e5a-51dc-44f0-9d4b-0274d37d92d4 service nova] Acquiring lock "d09cda86-eca1-4c42-8654-758eb6cd30e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:36:10 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-738f6b9b-1e27-4226-a3c5-621f3e49a931 req-716c6e5a-51dc-44f0-9d4b-0274d37d92d4 service nova] Lock "d09cda86-eca1-4c42-8654-758eb6cd30e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:36:10 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-738f6b9b-1e27-4226-a3c5-621f3e49a931 req-716c6e5a-51dc-44f0-9d4b-0274d37d92d4 service nova] Lock "d09cda86-eca1-4c42-8654-758eb6cd30e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:36:10 user nova-compute[71229]: DEBUG nova.compute.manager [req-738f6b9b-1e27-4226-a3c5-621f3e49a931 req-716c6e5a-51dc-44f0-9d4b-0274d37d92d4 service nova] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] No waiting events found dispatching network-vif-plugged-27d62f09-c938-4a71-be1e-6dc1d6a47382 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:36:10 user nova-compute[71229]: WARNING nova.compute.manager [req-738f6b9b-1e27-4226-a3c5-621f3e49a931 req-716c6e5a-51dc-44f0-9d4b-0274d37d92d4 service nova] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Received unexpected event network-vif-plugged-27d62f09-c938-4a71-be1e-6dc1d6a47382 for instance with vm_state rescued and task_state unrescuing.
Apr 11 15:36:10 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:36:10 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:36:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:36:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:36:12 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Removed pending event for d09cda86-eca1-4c42-8654-758eb6cd30e0 due to event {{(pid=71229) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 15:36:12 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227372.680376, d09cda86-eca1-4c42-8654-758eb6cd30e0 => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:36:12 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] VM Resumed (Lifecycle Event)
Apr 11 15:36:12 user nova-compute[71229]: DEBUG nova.compute.manager [None req-f96c44b2-2622-4f57-8349-0944f7ae2eb2 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:36:12 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:36:12 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:36:12 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 11 15:36:12 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227372.6863449, d09cda86-eca1-4c42-8654-758eb6cd30e0 => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:36:12 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] VM Started (Lifecycle Event)
Apr 11 15:36:12 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:36:12 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:36:12 user nova-compute[71229]: DEBUG nova.compute.manager [req-c78f4c5a-02b3-416d-aa74-cd5c2c7c91c8 req-7638238d-22ee-4163-9d8b-6f2b1c519dbd service nova] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Received event network-vif-plugged-27d62f09-c938-4a71-be1e-6dc1d6a47382 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:36:12 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c78f4c5a-02b3-416d-aa74-cd5c2c7c91c8 req-7638238d-22ee-4163-9d8b-6f2b1c519dbd service nova] Acquiring lock "d09cda86-eca1-4c42-8654-758eb6cd30e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:36:12 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c78f4c5a-02b3-416d-aa74-cd5c2c7c91c8 req-7638238d-22ee-4163-9d8b-6f2b1c519dbd service nova] Lock "d09cda86-eca1-4c42-8654-758eb6cd30e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:36:12 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c78f4c5a-02b3-416d-aa74-cd5c2c7c91c8 req-7638238d-22ee-4163-9d8b-6f2b1c519dbd service nova] Lock "d09cda86-eca1-4c42-8654-758eb6cd30e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:36:12 user nova-compute[71229]: DEBUG nova.compute.manager [req-c78f4c5a-02b3-416d-aa74-cd5c2c7c91c8 req-7638238d-22ee-4163-9d8b-6f2b1c519dbd service nova] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] No waiting events found dispatching network-vif-plugged-27d62f09-c938-4a71-be1e-6dc1d6a47382 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:36:12 user nova-compute[71229]: WARNING nova.compute.manager [req-c78f4c5a-02b3-416d-aa74-cd5c2c7c91c8 req-7638238d-22ee-4163-9d8b-6f2b1c519dbd service nova] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Received unexpected event network-vif-plugged-27d62f09-c938-4a71-be1e-6dc1d6a47382 for instance with vm_state rescued and task_state unrescuing.
Apr 11 15:36:12 user nova-compute[71229]: DEBUG nova.compute.manager [req-c78f4c5a-02b3-416d-aa74-cd5c2c7c91c8 req-7638238d-22ee-4163-9d8b-6f2b1c519dbd service nova] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Received event network-vif-plugged-27d62f09-c938-4a71-be1e-6dc1d6a47382 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:36:12 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c78f4c5a-02b3-416d-aa74-cd5c2c7c91c8 req-7638238d-22ee-4163-9d8b-6f2b1c519dbd service nova] Acquiring lock "d09cda86-eca1-4c42-8654-758eb6cd30e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:36:12 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c78f4c5a-02b3-416d-aa74-cd5c2c7c91c8 req-7638238d-22ee-4163-9d8b-6f2b1c519dbd service nova] Lock "d09cda86-eca1-4c42-8654-758eb6cd30e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:36:12 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c78f4c5a-02b3-416d-aa74-cd5c2c7c91c8 req-7638238d-22ee-4163-9d8b-6f2b1c519dbd service nova] Lock "d09cda86-eca1-4c42-8654-758eb6cd30e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:36:12 user nova-compute[71229]: DEBUG nova.compute.manager [req-c78f4c5a-02b3-416d-aa74-cd5c2c7c91c8 req-7638238d-22ee-4163-9d8b-6f2b1c519dbd service nova] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] No waiting events found dispatching network-vif-plugged-27d62f09-c938-4a71-be1e-6dc1d6a47382 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:36:12 user nova-compute[71229]: WARNING nova.compute.manager [req-c78f4c5a-02b3-416d-aa74-cd5c2c7c91c8 req-7638238d-22ee-4163-9d8b-6f2b1c519dbd service nova] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Received unexpected event network-vif-plugged-27d62f09-c938-4a71-be1e-6dc1d6a47382 for instance with vm_state rescued and task_state unrescuing.
Apr 11 15:36:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:36:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:36:21 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:36:21 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:36:25 user nova-compute[71229]: DEBUG nova.compute.manager [req-1e28308e-0adf-4601-9a45-8ac51335ab6f req-da511fd0-ba31-4e88-bdfb-1a1ac92d3734 service nova] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Received event network-changed-dc2a981c-9e15-473f-8bd6-c4c312b107d1 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:36:25 user nova-compute[71229]: DEBUG nova.compute.manager [req-1e28308e-0adf-4601-9a45-8ac51335ab6f req-da511fd0-ba31-4e88-bdfb-1a1ac92d3734 service nova] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Refreshing instance network info cache due to event network-changed-dc2a981c-9e15-473f-8bd6-c4c312b107d1. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:36:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-1e28308e-0adf-4601-9a45-8ac51335ab6f req-da511fd0-ba31-4e88-bdfb-1a1ac92d3734 service nova] Acquiring lock "refresh_cache-f34c2249-840e-4475-87e6-648d173bc7ed" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:36:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-1e28308e-0adf-4601-9a45-8ac51335ab6f req-da511fd0-ba31-4e88-bdfb-1a1ac92d3734 service nova] Acquired lock "refresh_cache-f34c2249-840e-4475-87e6-648d173bc7ed" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:36:25 user nova-compute[71229]: DEBUG nova.network.neutron [req-1e28308e-0adf-4601-9a45-8ac51335ab6f req-da511fd0-ba31-4e88-bdfb-1a1ac92d3734 service nova] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Refreshing network info cache for port dc2a981c-9e15-473f-8bd6-c4c312b107d1 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:36:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "f34c2249-840e-4475-87e6-648d173bc7ed" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:36:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "f34c2249-840e-4475-87e6-648d173bc7ed" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:36:25 user nova-compute[71229]: DEBUG nova.objects.instance [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lazy-loading 'flavor' on Instance uuid f34c2249-840e-4475-87e6-648d173bc7ed {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:36:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "f34c2249-840e-4475-87e6-648d173bc7ed" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:36:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "f34c2249-840e-4475-87e6-648d173bc7ed" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:36:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "f34c2249-840e-4475-87e6-648d173bc7ed" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.005s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:36:25 user nova-compute[71229]: INFO nova.compute.manager [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Attaching volume dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3 to /dev/vdb
Apr 11 15:36:25 user nova-compute[71229]: DEBUG os_brick.utils [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:36:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:36:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:36:25 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b87433-8bc1-4429-9f99-1ebc8d0d6993]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d55e24a97c90\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:36:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:36:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:36:25 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[78954a3b-10c0-4aa8-8a3a-58279612962f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:36:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:36:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:36:25 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e158b3-83c2-4f2b-81e0-880b64cfed8b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:36:25 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[35157950-017c-4db7-a40d-7949d1e29fa1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:36:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Running cmd (subprocess): nvme version {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:36:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] 'nvme version' failed. Not Retrying. {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:36:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] nvme not present on system {{(pid=71229) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 15:36:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:36:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:36:25 user nova-compute[71229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 15:36:25 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2756a288-e71f-42e5-9bc5-6d9b6b64323b]: (4, '') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:36:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71229) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 15:36:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 15:36:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] LIGHTOS: no hostnqn found. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 15:36:25 user nova-compute[71229]: DEBUG os_brick.utils [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d55e24a97c90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:36:25 user nova-compute[71229]: DEBUG nova.virt.block_device [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Updating existing volume attachment record: e8b03c3b-a3d5-4b85-893f-66ae00230a76 {{(pid=71229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 15:36:26 user nova-compute[71229]: DEBUG nova.network.neutron [req-1e28308e-0adf-4601-9a45-8ac51335ab6f req-da511fd0-ba31-4e88-bdfb-1a1ac92d3734 service nova] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Updated VIF entry in instance network info cache for port dc2a981c-9e15-473f-8bd6-c4c312b107d1. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:36:26 user nova-compute[71229]: DEBUG nova.network.neutron [req-1e28308e-0adf-4601-9a45-8ac51335ab6f req-da511fd0-ba31-4e88-bdfb-1a1ac92d3734 service nova] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Updating instance_info_cache with network_info: [{"id": "dc2a981c-9e15-473f-8bd6-c4c312b107d1", "address": "fa:16:3e:68:02:4d", "network": {"id": "8dd93667-4f8b-4d89-b7be-056f5f39bffe", "bridge": "br-int", "label": "tempest-TestStampPattern-1555823894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0f7abe5e3144c7ab354ffaba1748616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc2a981c-9e", "ovs_interfaceid": "dc2a981c-9e15-473f-8bd6-c4c312b107d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:36:26 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-1e28308e-0adf-4601-9a45-8ac51335ab6f req-da511fd0-ba31-4e88-bdfb-1a1ac92d3734 service nova] Releasing lock "refresh_cache-f34c2249-840e-4475-87e6-648d173bc7ed" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:36:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:36:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'swSlcjaJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:36:30 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:36:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:36:30 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:36:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:36:30 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 15:36:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3 -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[26225d0e-8cd6-4c05-af7b-d81c13486eb1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 15:36:30 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3 -p 172.16.0.220:3260 --interface default --op new {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[700ff169-5e53-4556-b6a7-11a8a3cdd614]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3] added\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3] added
Apr 11 15:36:30 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6d5089-6731-4570-8e88-6cb10dbad417]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab8c939-dca1-4b23-925b-77fbe6851965]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v swSlcjaJ {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v swSlcjaJ" returned: 0 in 0.027s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[86cd0870-a43a-4739-a46a-73b7f438cfb9]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'swSlcjaJ'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc45871-8599-4e8e-8935-866b42a3b73a]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a03369-9b28-46d0-8959-0637ea8855ba]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:36:30 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:36:30 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:36:30 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:36:30 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3 -p 172.16.0.220:3260 --login {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[91efc5b7-ce79-451e-b8fc-6246781f7178]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3, portal: 172.16.0.220,3260]
Apr 11 15:36:30 user nova-compute[71229]: Login to [iface: default, target: iqn.2010-10.org.openstack:dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3, portal: 172.16.0.220,3260] successful.
Apr 11 15:36:30 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c133f394-38b0-4bb0-8a9d-74f365066105]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e8715b-707f-4937-a0e8-95c7a383e2ef]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:36:30 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:36:30 user nova-compute[71229]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3 (non-flash)
Apr 11 15:36:30 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:36:30 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:36:30 user nova-compute[71229]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3 (non-flash)
Apr 11 15:36:30 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] HCTL ('34', '-', '-', 0) found on session 32 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93f301a-6404-4bd8-b649-ca60cb00f33f]: (4, ('- - 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:36:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'swSlcjaJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 15:36:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:36:31 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:36:31 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23565663136363036', 'path': '/dev/sdc'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:36:31 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565663136363036', 'path': '/dev/sdc'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 15:36:31 user nova-compute[71229]: DEBUG nova.objects.instance [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lazy-loading 'flavor' on Instance uuid f34c2249-840e-4475-87e6-648d173bc7ed {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:36:31 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 15:36:31 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:36:31 user nova-compute[71229]:   <source dev="/dev/sdc"/>
Apr 11 15:36:31 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 15:36:31 user nova-compute[71229]:   <serial>dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3</serial>
Apr 11 15:36:31 user nova-compute[71229]: </disk>
Apr 11 15:36:31 user nova-compute[71229]:  {{(pid=71229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 15:36:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:36:32 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:36:32 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:36:32 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] No VIF found with MAC fa:16:3e:68:02:4d, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:36:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f2f5c723-1b9d-4a09-b159-520ddd4d3fa2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "f34c2249-840e-4475-87e6-648d173bc7ed" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.651s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:36:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-6bff1d9a-8d9e-4ca9-ac0c-b916563b0539 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "f34c2249-840e-4475-87e6-648d173bc7ed" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:36:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-6bff1d9a-8d9e-4ca9-ac0c-b916563b0539 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "f34c2249-840e-4475-87e6-648d173bc7ed" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:36:33 user nova-compute[71229]: INFO nova.compute.manager [None req-6bff1d9a-8d9e-4ca9-ac0c-b916563b0539 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Detaching volume dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3
Apr 11 15:36:33 user nova-compute[71229]: INFO nova.virt.block_device [None req-6bff1d9a-8d9e-4ca9-ac0c-b916563b0539 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Attempting to driver detach volume dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3 from mountpoint /dev/vdb
Apr 11 15:36:33 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-6bff1d9a-8d9e-4ca9-ac0c-b916563b0539 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Attempting to detach device vdb from instance f34c2249-840e-4475-87e6-648d173bc7ed from the persistent domain config. {{(pid=71229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 15:36:33 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-6bff1d9a-8d9e-4ca9-ac0c-b916563b0539 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 15:36:33 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:36:33 user nova-compute[71229]:   <source dev="/dev/sdc"/>
Apr 11 15:36:33 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 15:36:33 user nova-compute[71229]:   <serial>dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3</serial>
Apr 11 15:36:33 user nova-compute[71229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 15:36:33 user nova-compute[71229]: </disk>
Apr 11 15:36:33 user nova-compute[71229]:  {{(pid=71229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 15:36:33 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-6bff1d9a-8d9e-4ca9-ac0c-b916563b0539 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Successfully detached device vdb from instance f34c2249-840e-4475-87e6-648d173bc7ed from the persistent domain config.
Apr 11 15:36:33 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-6bff1d9a-8d9e-4ca9-ac0c-b916563b0539 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f34c2249-840e-4475-87e6-648d173bc7ed from the live domain config. {{(pid=71229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 15:36:33 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-6bff1d9a-8d9e-4ca9-ac0c-b916563b0539 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 15:36:33 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:36:33 user nova-compute[71229]:   <source dev="/dev/sdc"/>
Apr 11 15:36:33 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 15:36:33 user nova-compute[71229]:   <serial>dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3</serial>
Apr 11 15:36:33 user nova-compute[71229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 15:36:33 user nova-compute[71229]: </disk>
Apr 11 15:36:33 user nova-compute[71229]:  {{(pid=71229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 15:36:34 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Received event <DeviceRemovedEvent: 1681227394.4120092, f34c2249-840e-4475-87e6-648d173bc7ed => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71229) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 15:36:34 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-6bff1d9a-8d9e-4ca9-ac0c-b916563b0539 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f34c2249-840e-4475-87e6-648d173bc7ed {{(pid=71229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 15:36:34 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-6bff1d9a-8d9e-4ca9-ac0c-b916563b0539 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Successfully detached device vdb from instance f34c2249-840e-4475-87e6-648d173bc7ed from the live domain config.
Apr 11 15:36:34 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bff1d9a-8d9e-4ca9-ac0c-b916563b0539 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 15:36:34 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bff1d9a-8d9e-4ca9-ac0c-b916563b0539 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'swSlcjaJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:36:34 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-6bff1d9a-8d9e-4ca9-ac0c-b916563b0539 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:36:34 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-6bff1d9a-8d9e-4ca9-ac0c-b916563b0539 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:36:34 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-6bff1d9a-8d9e-4ca9-ac0c-b916563b0539 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:36:34 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:36:34 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:36:34 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0dc0bbd-db61-4d4b-835b-fd898c96b470]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:36:34 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bff1d9a-8d9e-4ca9-ac0c-b916563b0539 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 15:36:34 user nova-compute[71229]: No targets found.
Apr 11 15:36:34 user nova-compute[71229]: iSNS:
Apr 11 15:36:34 user nova-compute[71229]: No targets found.
Apr 11 15:36:34 user nova-compute[71229]: STATIC:
Apr 11 15:36:34 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb
Apr 11 15:36:34 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:36:34 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:36:34 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3
Apr 11 15:36:34 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:36:34 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:36:34 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4
Apr 11 15:36:34 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:36:34 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:36:34 user nova-compute[71229]: FIRMWARE:
Apr 11 15:36:34 user nova-compute[71229]: No targets found.
Apr 11 15:36:34 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:36:34 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bff1d9a-8d9e-4ca9-ac0c-b916563b0539 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 15:36:34 user nova-compute[71229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 15:36:34 user nova-compute[71229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71229) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 15:36:34 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bff1d9a-8d9e-4ca9-ac0c-b916563b0539 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3', 0)] {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 15:36:34 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:36:34 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:36:34 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d54fdbc-59bb-4cb0-bf2f-5fc49dda230e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:36:34 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:36:34 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:36:34 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[87063067-aff9-4287-99a0-e7802e3f6081]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:36:34 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bff1d9a-8d9e-4ca9-ac0c-b916563b0539 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:36:34 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:36:34 user nova-compute[71229]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3 (non-flash)
Apr 11 15:36:34 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:36:34 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bff1d9a-8d9e-4ca9-ac0c-b916563b0539 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:36:34 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:36:34 user nova-compute[71229]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3 (non-flash)
Apr 11 15:36:34 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:36:34 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bff1d9a-8d9e-4ca9-ac0c-b916563b0539 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb4c1332e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3'): ({'sdc'}, set())}) {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 15:36:34 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-6bff1d9a-8d9e-4ca9-ac0c-b916563b0539 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Removing single pathed devices sdc {{(pid=71229) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 15:36:34 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:36:34 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:36:34 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3e0251-89d1-4c7d-a187-c90e785bb2d6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:36:34 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:36:34 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:36:34 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff18023-bf33-4f93-91af-a2c40bae0c4b]: (4, ('ok\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:36:34 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-6bff1d9a-8d9e-4ca9-ac0c-b916563b0539 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Flushing IO for device /dev/sdc {{(pid=71229) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 15:36:34 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:36:34 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:36:34 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[544a7f96-3e48-48ec-b6d6-fbc94941a755]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:36:34 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-6bff1d9a-8d9e-4ca9-ac0c-b916563b0539 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71229) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 15:36:34 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:36:34 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:36:34 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0db93d2-b42f-42a1-a683-6e03c14ca5ca]: (4, ('1', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:36:34 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-6bff1d9a-8d9e-4ca9-ac0c-b916563b0539 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 15:36:34 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-6bff1d9a-8d9e-4ca9-ac0c-b916563b0539 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] SCSI volumes sdc have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 15:36:34 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bff1d9a-8d9e-4ca9-ac0c-b916563b0539 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3')] {{(pid=71229) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 15:36:34 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:36:34 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:36:34 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e74e6db-18c9-4a44-9df5-d27647bf6e6c]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:36:34 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bff1d9a-8d9e-4ca9-ac0c-b916563b0539 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:36:34 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3 -p 172.16.0.220:3260 --logout {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:36:34 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:36:34 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef6654b-1220-4502-8a72-aa49af7416aa]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:36:34 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bff1d9a-8d9e-4ca9-ac0c-b916563b0539 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3, portal: 172.16.0.220,3260]
Apr 11 15:36:34 user nova-compute[71229]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3, portal: 172.16.0.220,3260] successful.
Apr 11 15:36:34 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:36:34 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3 -p 172.16.0.220:3260 --op delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:36:34 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbbc4f7b-8594-4477-b4ad-e92bf8bb3bc3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:36:34 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d033bf-e928-4389-b6c7-41a9c1cedc3d]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:36:34 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bff1d9a-8d9e-4ca9-ac0c-b916563b0539 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:36:34 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-6bff1d9a-8d9e-4ca9-ac0c-b916563b0539 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:36:34 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bff1d9a-8d9e-4ca9-ac0c-b916563b0539 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] <== disconnect_volume: return (305ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:36:34 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bff1d9a-8d9e-4ca9-ac0c-b916563b0539 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 15:36:35 user nova-compute[71229]: DEBUG nova.objects.instance [None req-6bff1d9a-8d9e-4ca9-ac0c-b916563b0539 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lazy-loading 'flavor' on Instance uuid f34c2249-840e-4475-87e6-648d173bc7ed {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:36:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-6bff1d9a-8d9e-4ca9-ac0c-b916563b0539 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "f34c2249-840e-4475-87e6-648d173bc7ed" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.634s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:36:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:36:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:36:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:36:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:36:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:36:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:36:47 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:36:47 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Cleaning up deleted instances {{(pid=71229) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 15:36:47 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] There are 0 instances to clean {{(pid=71229) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 15:36:51 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:36:51 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:36:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:36:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-2a533cd9-f8f3-44ba-8482-5cad3643aa37 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ffc25fc1-e59f-42c8-a371-b4b12e17fd59" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:37:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-2a533cd9-f8f3-44ba-8482-5cad3643aa37 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ffc25fc1-e59f-42c8-a371-b4b12e17fd59" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:37:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-2a533cd9-f8f3-44ba-8482-5cad3643aa37 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "ffc25fc1-e59f-42c8-a371-b4b12e17fd59-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:37:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-2a533cd9-f8f3-44ba-8482-5cad3643aa37 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ffc25fc1-e59f-42c8-a371-b4b12e17fd59-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:37:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-2a533cd9-f8f3-44ba-8482-5cad3643aa37 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ffc25fc1-e59f-42c8-a371-b4b12e17fd59-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:37:01 user nova-compute[71229]: INFO nova.compute.manager [None req-2a533cd9-f8f3-44ba-8482-5cad3643aa37 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Terminating instance
Apr 11 15:37:01 user nova-compute[71229]: DEBUG nova.compute.manager [None req-2a533cd9-f8f3-44ba-8482-5cad3643aa37 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Start destroying the instance on the hypervisor. {{(pid=71229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 15:37:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:01 user nova-compute[71229]: DEBUG nova.compute.manager [req-594576bd-c782-4264-9b9f-6dd9b3a701d0 req-87279be1-d7cc-4049-b4ca-12182f7e9585 service nova] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Received event network-vif-unplugged-3ae0cd28-c459-47b7-be17-133b69773f9c {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:37:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-594576bd-c782-4264-9b9f-6dd9b3a701d0 req-87279be1-d7cc-4049-b4ca-12182f7e9585 service nova] Acquiring lock "ffc25fc1-e59f-42c8-a371-b4b12e17fd59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:37:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-594576bd-c782-4264-9b9f-6dd9b3a701d0 req-87279be1-d7cc-4049-b4ca-12182f7e9585 service nova] Lock "ffc25fc1-e59f-42c8-a371-b4b12e17fd59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:37:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-594576bd-c782-4264-9b9f-6dd9b3a701d0 req-87279be1-d7cc-4049-b4ca-12182f7e9585 service nova] Lock "ffc25fc1-e59f-42c8-a371-b4b12e17fd59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:37:01 user nova-compute[71229]: DEBUG nova.compute.manager [req-594576bd-c782-4264-9b9f-6dd9b3a701d0 req-87279be1-d7cc-4049-b4ca-12182f7e9585 service nova] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] No waiting events found dispatching network-vif-unplugged-3ae0cd28-c459-47b7-be17-133b69773f9c {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:37:01 user nova-compute[71229]: DEBUG nova.compute.manager [req-594576bd-c782-4264-9b9f-6dd9b3a701d0 req-87279be1-d7cc-4049-b4ca-12182f7e9585 service nova] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Received event network-vif-unplugged-3ae0cd28-c459-47b7-be17-133b69773f9c for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 15:37:01 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:37:01 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 15:37:01 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:37:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:37:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:37:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:37:01 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 15:37:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:01 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Instance destroyed successfully.
Apr 11 15:37:01 user nova-compute[71229]: DEBUG nova.objects.instance [None req-2a533cd9-f8f3-44ba-8482-5cad3643aa37 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lazy-loading 'resources' on Instance uuid ffc25fc1-e59f-42c8-a371-b4b12e17fd59 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:37:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-2a533cd9-f8f3-44ba-8482-5cad3643aa37 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T15:31:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1714025063',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1714025063',id=21,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYrUwvaqlHN87/1coexF5rSHRlGXUa9nMDtkuMig5cppT2KcjZ1/LzgWVf5StAo8KnqLK68JMRfWhU47MCnTdmCe53lfYleLEedLL3gnNiTy7iFFgo0q1LydREc5eKJzQ==',key_name='tempest-keypair-1917410281',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:35:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63b9b79fb98441fd9f1b5df54471f0bd',ramdisk_id='',reservation_id='r-kzb2xrpd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1785499036',owner_user_name='tempest-AttachVolumeShelveTestJSON-1785499036-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:35:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88d988d9ce0a41669b7c487ac07b4cfe',uuid=ffc25fc1-e59f-42c8-a371-b4b12e17fd59,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ae0cd28-c459-47b7-be17-133b69773f9c", "address": "fa:16:3e:b9:69:19", "network": {"id": "15a1a586-0100-4057-8501-5c5a282d4063", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834988552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b9b79fb98441fd9f1b5df54471f0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae0cd28-c4", "ovs_interfaceid": "3ae0cd28-c459-47b7-be17-133b69773f9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:37:01 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-2a533cd9-f8f3-44ba-8482-5cad3643aa37 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Converting VIF {"id": "3ae0cd28-c459-47b7-be17-133b69773f9c", "address": "fa:16:3e:b9:69:19", "network": {"id": "15a1a586-0100-4057-8501-5c5a282d4063", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-834988552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b9b79fb98441fd9f1b5df54471f0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae0cd28-c4", "ovs_interfaceid": "3ae0cd28-c459-47b7-be17-133b69773f9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:37:01 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-2a533cd9-f8f3-44ba-8482-5cad3643aa37 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:69:19,bridge_name='br-int',has_traffic_filtering=True,id=3ae0cd28-c459-47b7-be17-133b69773f9c,network=Network(15a1a586-0100-4057-8501-5c5a282d4063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ae0cd28-c4') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:37:01 user nova-compute[71229]: DEBUG os_vif [None req-2a533cd9-f8f3-44ba-8482-5cad3643aa37 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:69:19,bridge_name='br-int',has_traffic_filtering=True,id=3ae0cd28-c459-47b7-be17-133b69773f9c,network=Network(15a1a586-0100-4057-8501-5c5a282d4063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ae0cd28-c4') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:37:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ae0cd28-c4, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:37:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:37:01 user nova-compute[71229]: INFO os_vif [None req-2a533cd9-f8f3-44ba-8482-5cad3643aa37 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:69:19,bridge_name='br-int',has_traffic_filtering=True,id=3ae0cd28-c459-47b7-be17-133b69773f9c,network=Network(15a1a586-0100-4057-8501-5c5a282d4063),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ae0cd28-c4')
Apr 11 15:37:01 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-2a533cd9-f8f3-44ba-8482-5cad3643aa37 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Deleting instance files /opt/stack/data/nova/instances/ffc25fc1-e59f-42c8-a371-b4b12e17fd59_del
Apr 11 15:37:01 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-2a533cd9-f8f3-44ba-8482-5cad3643aa37 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Deletion of /opt/stack/data/nova/instances/ffc25fc1-e59f-42c8-a371-b4b12e17fd59_del complete
Apr 11 15:37:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:02 user nova-compute[71229]: INFO nova.compute.manager [None req-2a533cd9-f8f3-44ba-8482-5cad3643aa37 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Took 0.92 seconds to destroy the instance on the hypervisor.
Apr 11 15:37:02 user nova-compute[71229]: DEBUG oslo.service.loopingcall [None req-2a533cd9-f8f3-44ba-8482-5cad3643aa37 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71229) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 15:37:02 user nova-compute[71229]: DEBUG nova.compute.manager [-] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Deallocating network for instance {{(pid=71229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 15:37:02 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] deallocate_for_instance() {{(pid=71229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 15:37:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:02 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:37:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:02 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:37:02 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Took 0.84 seconds to deallocate network for instance.
Apr 11 15:37:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:02 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-2a533cd9-f8f3-44ba-8482-5cad3643aa37 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:37:02 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-2a533cd9-f8f3-44ba-8482-5cad3643aa37 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:37:03 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:03 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85658a44-9ff2-4553-b9fd-686bf35fd6ec/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:03 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85658a44-9ff2-4553-b9fd-686bf35fd6ec/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:03 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85658a44-9ff2-4553-b9fd-686bf35fd6ec/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:03 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85658a44-9ff2-4553-b9fd-686bf35fd6ec/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:03 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-2a533cd9-f8f3-44ba-8482-5cad3643aa37 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:37:03 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Error from libvirt while getting description of instance-00000015: [Error Code 42] Domain not found: no domain with matching uuid 'ffc25fc1-e59f-42c8-a371-b4b12e17fd59' (instance-00000015): libvirt.libvirtError: Domain not found: no domain with matching uuid 'ffc25fc1-e59f-42c8-a371-b4b12e17fd59' (instance-00000015)
Apr 11 15:37:03 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f34c2249-840e-4475-87e6-648d173bc7ed/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:03 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-2a533cd9-f8f3-44ba-8482-5cad3643aa37 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:37:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-2a533cd9-f8f3-44ba-8482-5cad3643aa37 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.489s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:37:03 user nova-compute[71229]: INFO nova.scheduler.client.report [None req-2a533cd9-f8f3-44ba-8482-5cad3643aa37 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Deleted allocations for instance ffc25fc1-e59f-42c8-a371-b4b12e17fd59
Apr 11 15:37:03 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f34c2249-840e-4475-87e6-648d173bc7ed/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:03 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f34c2249-840e-4475-87e6-648d173bc7ed/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:03 user nova-compute[71229]: DEBUG nova.compute.manager [req-e0dcf8e0-d4c9-470d-be52-7f1abf4cd745 req-4ea25a15-e5a7-471a-ab41-bbd157347bc5 service nova] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Received event network-vif-plugged-3ae0cd28-c459-47b7-be17-133b69773f9c {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:37:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e0dcf8e0-d4c9-470d-be52-7f1abf4cd745 req-4ea25a15-e5a7-471a-ab41-bbd157347bc5 service nova] Acquiring lock "ffc25fc1-e59f-42c8-a371-b4b12e17fd59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:37:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e0dcf8e0-d4c9-470d-be52-7f1abf4cd745 req-4ea25a15-e5a7-471a-ab41-bbd157347bc5 service nova] Lock "ffc25fc1-e59f-42c8-a371-b4b12e17fd59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:37:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e0dcf8e0-d4c9-470d-be52-7f1abf4cd745 req-4ea25a15-e5a7-471a-ab41-bbd157347bc5 service nova] Lock "ffc25fc1-e59f-42c8-a371-b4b12e17fd59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:37:03 user nova-compute[71229]: DEBUG nova.compute.manager [req-e0dcf8e0-d4c9-470d-be52-7f1abf4cd745 req-4ea25a15-e5a7-471a-ab41-bbd157347bc5 service nova] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] No waiting events found dispatching network-vif-plugged-3ae0cd28-c459-47b7-be17-133b69773f9c {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:37:03 user nova-compute[71229]: WARNING nova.compute.manager [req-e0dcf8e0-d4c9-470d-be52-7f1abf4cd745 req-4ea25a15-e5a7-471a-ab41-bbd157347bc5 service nova] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Received unexpected event network-vif-plugged-3ae0cd28-c459-47b7-be17-133b69773f9c for instance with vm_state deleted and task_state None.
Apr 11 15:37:03 user nova-compute[71229]: DEBUG nova.compute.manager [req-e0dcf8e0-d4c9-470d-be52-7f1abf4cd745 req-4ea25a15-e5a7-471a-ab41-bbd157347bc5 service nova] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Received event network-vif-deleted-3ae0cd28-c459-47b7-be17-133b69773f9c {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:37:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-2a533cd9-f8f3-44ba-8482-5cad3643aa37 tempest-AttachVolumeShelveTestJSON-1785499036 tempest-AttachVolumeShelveTestJSON-1785499036-project-member] Lock "ffc25fc1-e59f-42c8-a371-b4b12e17fd59" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.450s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:37:03 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f34c2249-840e-4475-87e6-648d173bc7ed/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:03 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:37:03 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:03 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:03 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:03 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:03 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:05 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:37:05 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:37:05 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=7857MB free_disk=25.780746459960938GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 15:37:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:37:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:37:05 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance de1a45fd-27be-4438-80a4-2f3a100643c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:37:05 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance b0d90fd2-6a95-43c4-8756-e82071d99154 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:37:05 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 7c4329ae-07cb-4f28-9fd6-29b398517d2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:37:05 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 85658a44-9ff2-4553-b9fd-686bf35fd6ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:37:05 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance d09cda86-eca1-4c42-8654-758eb6cd30e0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:37:05 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance f34c2249-840e-4475-87e6-648d173bc7ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:37:05 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance dcbfcbfd-7e96-4271-94ee-60ef937e3b7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:37:05 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:37:05 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 6f6ae64a-c760-4ba3-8a50-d380835d9913 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:37:05 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 058df5ba-07ab-4bdd-9a47-907e7b0e0e59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:37:05 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 15:37:05 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 15:37:05 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:37:05 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:37:05 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 15:37:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.425s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:37:05 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:37:05 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71229) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 15:37:05 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:37:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:07 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:37:07 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:37:07 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 15:37:07 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "refresh_cache-85658a44-9ff2-4553-b9fd-686bf35fd6ec" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:37:07 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquired lock "refresh_cache-85658a44-9ff2-4553-b9fd-686bf35fd6ec" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:37:07 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Forcefully refreshing network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 15:37:08 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Updating instance_info_cache with network_info: [{"id": "c6826c01-eadd-49db-a842-accd25f7534a", "address": "fa:16:3e:0d:20:92", "network": {"id": "8dd93667-4f8b-4d89-b7be-056f5f39bffe", "bridge": "br-int", "label": "tempest-TestStampPattern-1555823894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0f7abe5e3144c7ab354ffaba1748616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6826c01-ea", "ovs_interfaceid": "c6826c01-eadd-49db-a842-accd25f7534a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:37:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Releasing lock "refresh_cache-85658a44-9ff2-4553-b9fd-686bf35fd6ec" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:37:08 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Updated the network info_cache for instance {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 15:37:08 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:37:08 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:37:08 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:37:08 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:37:08 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:37:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:37:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 15:37:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 15:37:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 15:37:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:37:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:12 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:37:15 user nova-compute[71229]: DEBUG nova.compute.manager [req-fefd8e3f-49bc-4895-8dd6-ae973a3259f8 req-230b15d3-a4f1-4778-bd43-d64984a7fad0 service nova] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Received event network-changed-32c006ee-14e2-47d8-b999-bafc729aa67a {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:37:15 user nova-compute[71229]: DEBUG nova.compute.manager [req-fefd8e3f-49bc-4895-8dd6-ae973a3259f8 req-230b15d3-a4f1-4778-bd43-d64984a7fad0 service nova] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Refreshing instance network info cache due to event network-changed-32c006ee-14e2-47d8-b999-bafc729aa67a. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:37:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-fefd8e3f-49bc-4895-8dd6-ae973a3259f8 req-230b15d3-a4f1-4778-bd43-d64984a7fad0 service nova] Acquiring lock "refresh_cache-dcbfcbfd-7e96-4271-94ee-60ef937e3b7e" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:37:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-fefd8e3f-49bc-4895-8dd6-ae973a3259f8 req-230b15d3-a4f1-4778-bd43-d64984a7fad0 service nova] Acquired lock "refresh_cache-dcbfcbfd-7e96-4271-94ee-60ef937e3b7e" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:37:15 user nova-compute[71229]: DEBUG nova.network.neutron [req-fefd8e3f-49bc-4895-8dd6-ae973a3259f8 req-230b15d3-a4f1-4778-bd43-d64984a7fad0 service nova] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Refreshing network info cache for port 32c006ee-14e2-47d8-b999-bafc729aa67a {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:37:16 user nova-compute[71229]: DEBUG nova.network.neutron [req-fefd8e3f-49bc-4895-8dd6-ae973a3259f8 req-230b15d3-a4f1-4778-bd43-d64984a7fad0 service nova] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Updated VIF entry in instance network info cache for port 32c006ee-14e2-47d8-b999-bafc729aa67a. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:37:16 user nova-compute[71229]: DEBUG nova.network.neutron [req-fefd8e3f-49bc-4895-8dd6-ae973a3259f8 req-230b15d3-a4f1-4778-bd43-d64984a7fad0 service nova] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Updating instance_info_cache with network_info: [{"id": "32c006ee-14e2-47d8-b999-bafc729aa67a", "address": "fa:16:3e:1a:bd:54", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c006ee-14", "ovs_interfaceid": "32c006ee-14e2-47d8-b999-bafc729aa67a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:37:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-fefd8e3f-49bc-4895-8dd6-ae973a3259f8 req-230b15d3-a4f1-4778-bd43-d64984a7fad0 service nova] Releasing lock "refresh_cache-dcbfcbfd-7e96-4271-94ee-60ef937e3b7e" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:37:16 user nova-compute[71229]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681227421.9388711, ffc25fc1-e59f-42c8-a371-b4b12e17fd59 => Stopped> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:37:16 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] VM Stopped (Lifecycle Event)
Apr 11 15:37:16 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a88e2546-2f37-4f23-89ca-8718ae8a63eb None None] [instance: ffc25fc1-e59f-42c8-a371-b4b12e17fd59] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:37:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ffce2921-d4a5-4bcb-8032-62a6dc321fb4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:37:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ffce2921-d4a5-4bcb-8032-62a6dc321fb4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:37:18 user nova-compute[71229]: DEBUG nova.compute.manager [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Starting instance... {{(pid=71229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 15:37:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:37:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:37:18 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 15:37:18 user nova-compute[71229]: INFO nova.compute.claims [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Claim successful on node user
Apr 11 15:37:19 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:37:19 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:37:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.416s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:37:19 user nova-compute[71229]: DEBUG nova.compute.manager [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Start building networks asynchronously for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 15:37:19 user nova-compute[71229]: DEBUG nova.compute.manager [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Allocating IP information in the background. {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 15:37:19 user nova-compute[71229]: DEBUG nova.network.neutron [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] allocate_for_instance() {{(pid=71229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 15:37:19 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 15:37:19 user nova-compute[71229]: DEBUG nova.compute.manager [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Start building block device mappings for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 15:37:19 user nova-compute[71229]: INFO nova.virt.block_device [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Booting with volume 98d29c73-7b06-45f4-90e0-01a41825cc68 at /dev/vda
Apr 11 15:37:19 user nova-compute[71229]: DEBUG nova.policy [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '10720df0ac4f4e62a0a5c9883d600add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7660e8f76b471487136806ee9eec62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71229) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 15:37:19 user nova-compute[71229]: DEBUG os_brick.utils [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:37:19 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:19 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:19 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0cd1888-4d7e-4466-a1de-0020b1c69381]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d55e24a97c90\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:19 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:19 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:19 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f41eeca-9496-41cc-9b27-2151b4e90ae7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:19 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:19 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:19 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f8412b-5440-4f86-ad1e-b237e2b52476]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:19 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[34daeb50-fcfe-4688-93f4-73a02149d67b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:19 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Running cmd (subprocess): nvme version {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:19 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 'nvme version' failed. Not Retrying. {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:37:19 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] nvme not present on system {{(pid=71229) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 15:37:19 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:19 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:37:19 user nova-compute[71229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 15:37:19 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2823e17-afe0-4d37-89d8-41050be3b7dc]: (4, '') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:19 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71229) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 15:37:19 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 15:37:19 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] LIGHTOS: no hostnqn found. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 15:37:19 user nova-compute[71229]: DEBUG os_brick.utils [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d55e24a97c90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:37:19 user nova-compute[71229]: DEBUG nova.virt.block_device [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Updating existing volume attachment record: 4436576b-8ea7-45a6-8ded-e979580c275c {{(pid=71229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 15:37:19 user nova-compute[71229]: DEBUG nova.network.neutron [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Successfully created port: 910fb3d4-3965-41a2-8f97-9de79ee78c78 {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 15:37:20 user nova-compute[71229]: DEBUG nova.network.neutron [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Successfully updated port: 910fb3d4-3965-41a2-8f97-9de79ee78c78 {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:37:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "refresh_cache-ffce2921-d4a5-4bcb-8032-62a6dc321fb4" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:37:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquired lock "refresh_cache-ffce2921-d4a5-4bcb-8032-62a6dc321fb4" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:37:20 user nova-compute[71229]: DEBUG nova.network.neutron [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:37:20 user nova-compute[71229]: DEBUG nova.compute.manager [req-144460be-ccdb-4403-9053-5616d0dea725 req-9ea8f14f-abea-464e-8d3d-14d4dd0da838 service nova] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Received event network-changed-910fb3d4-3965-41a2-8f97-9de79ee78c78 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:37:20 user nova-compute[71229]: DEBUG nova.compute.manager [req-144460be-ccdb-4403-9053-5616d0dea725 req-9ea8f14f-abea-464e-8d3d-14d4dd0da838 service nova] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Refreshing instance network info cache due to event network-changed-910fb3d4-3965-41a2-8f97-9de79ee78c78. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:37:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-144460be-ccdb-4403-9053-5616d0dea725 req-9ea8f14f-abea-464e-8d3d-14d4dd0da838 service nova] Acquiring lock "refresh_cache-ffce2921-d4a5-4bcb-8032-62a6dc321fb4" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:37:20 user nova-compute[71229]: DEBUG nova.network.neutron [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:37:21 user nova-compute[71229]: DEBUG nova.network.neutron [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Updating instance_info_cache with network_info: [{"id": "910fb3d4-3965-41a2-8f97-9de79ee78c78", "address": "fa:16:3e:50:1e:37", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap910fb3d4-39", "ovs_interfaceid": "910fb3d4-3965-41a2-8f97-9de79ee78c78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:37:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Releasing lock "refresh_cache-ffce2921-d4a5-4bcb-8032-62a6dc321fb4" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:37:21 user nova-compute[71229]: DEBUG nova.compute.manager [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Instance network_info: |[{"id": "910fb3d4-3965-41a2-8f97-9de79ee78c78", "address": "fa:16:3e:50:1e:37", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap910fb3d4-39", "ovs_interfaceid": "910fb3d4-3965-41a2-8f97-9de79ee78c78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 15:37:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-144460be-ccdb-4403-9053-5616d0dea725 req-9ea8f14f-abea-464e-8d3d-14d4dd0da838 service nova] Acquired lock "refresh_cache-ffce2921-d4a5-4bcb-8032-62a6dc321fb4" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:37:21 user nova-compute[71229]: DEBUG nova.network.neutron [req-144460be-ccdb-4403-9053-5616d0dea725 req-9ea8f14f-abea-464e-8d3d-14d4dd0da838 service nova] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Refreshing network info cache for port 910fb3d4-3965-41a2-8f97-9de79ee78c78 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:37:21 user nova-compute[71229]: DEBUG nova.network.neutron [req-144460be-ccdb-4403-9053-5616d0dea725 req-9ea8f14f-abea-464e-8d3d-14d4dd0da838 service nova] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Updated VIF entry in instance network info cache for port 910fb3d4-3965-41a2-8f97-9de79ee78c78. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:37:21 user nova-compute[71229]: DEBUG nova.network.neutron [req-144460be-ccdb-4403-9053-5616d0dea725 req-9ea8f14f-abea-464e-8d3d-14d4dd0da838 service nova] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Updating instance_info_cache with network_info: [{"id": "910fb3d4-3965-41a2-8f97-9de79ee78c78", "address": "fa:16:3e:50:1e:37", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap910fb3d4-39", "ovs_interfaceid": "910fb3d4-3965-41a2-8f97-9de79ee78c78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:37:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-144460be-ccdb-4403-9053-5616d0dea725 req-9ea8f14f-abea-464e-8d3d-14d4dd0da838 service nova] Releasing lock "refresh_cache-ffce2921-d4a5-4bcb-8032-62a6dc321fb4" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:37:21 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:21 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:23 user nova-compute[71229]: DEBUG nova.compute.manager [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Start spawning the instance on the hypervisor. {{(pid=71229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 15:37:23 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Creating instance directory {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 15:37:23 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Creating image(s)
Apr 11 15:37:23 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Did not create local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 15:37:23 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Ensure instance console log exists: /opt/stack/data/nova/instances/ffce2921-d4a5-4bcb-8032-62a6dc321fb4/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 15:37:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:37:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:37:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:37:23 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Start _get_guest_xml network_info=[{"id": "910fb3d4-3965-41a2-8f97-9de79ee78c78", "address": "fa:16:3e:50:1e:37", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap910fb3d4-39", "ovs_interfaceid": "910fb3d4-3965-41a2-8f97-9de79ee78c78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gSNaBYAr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ffce2921-d4a5-4bcb-8032-62a6dc321fb4', 'attached_at': '', 'detached_at': '', 'volume_id': '98d29c73-7b06-45f4-90e0-01a41825cc68', 'serial': '98d29c73-7b06-45f4-90e0-01a41825cc68'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '4436576b-8ea7-45a6-8ded-e979580c275c', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:37:23 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:37:23 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:37:23 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:37:23 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:37:23 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:37:23 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:37:23 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:37:23 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:37:23 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:37:23 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:37:23 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:37:23 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:37:23 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:37:23 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:37:23 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 15:37:23 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gSNaBYAr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:37:23 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:37:23 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:37:23 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:37:23 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:37:23 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:37:23 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:37:23 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 15:37:23 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:23 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:23 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2fd917-06f4-432c-b5b9-183db0d39db3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 15:37:24 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 -p 172.16.0.220:3260 --interface default --op new {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64918b3-8cdf-4de6-9d89-78e22fda75d5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68] added\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68] added
Apr 11 15:37:24 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[352885c2-cdf5-408a-8e8c-00679f710989]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9913c168-3a3d-465b-94f4-24df8f6348b7]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gSNaBYAr {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gSNaBYAr" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4555a8e3-d870-4711-97bc-484a75db1c49]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gSNaBYAr'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c2b830-7c6a-4be2-899f-b955b4837d9a]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[916c0d25-0b88-49e2-ace9-7776d2bfb852]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:37:24 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:37:24 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:37:24 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:37:24 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 -p 172.16.0.220:3260 --login {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85d0d2b-68ee-4124-9e9b-693fd6cc1f70]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68, portal: 172.16.0.220,3260]
Apr 11 15:37:24 user nova-compute[71229]: Login to [iface: default, target: iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68, portal: 172.16.0.220,3260] successful.
Apr 11 15:37:24 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e543e106-81df-489a-a6f5-225840ca7aca]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9bd0ec-3ca7-423a-b78e-9c3c88adeb82]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:37:24 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:37:24 user nova-compute[71229]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 (non-flash)
Apr 11 15:37:24 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:37:24 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:37:24 user nova-compute[71229]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 (non-flash)
Apr 11 15:37:24 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] HCTL ('34', '-', '-', 0) found on session 33 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4ff8ad-1a7a-4fe9-bc73-accfcd3299c9]: (4, ('- - 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gSNaBYAr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG nova.compute.manager [req-5e6220a7-6ea7-441d-abb5-6fe3a367519e req-cfcae1e2-f73c-40ae-9264-4cda63571865 service nova] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Received event network-changed-dc2a981c-9e15-473f-8bd6-c4c312b107d1 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG nova.compute.manager [req-5e6220a7-6ea7-441d-abb5-6fe3a367519e req-cfcae1e2-f73c-40ae-9264-4cda63571865 service nova] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Refreshing instance network info cache due to event network-changed-dc2a981c-9e15-473f-8bd6-c4c312b107d1. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-5e6220a7-6ea7-441d-abb5-6fe3a367519e req-cfcae1e2-f73c-40ae-9264-4cda63571865 service nova] Acquiring lock "refresh_cache-f34c2249-840e-4475-87e6-648d173bc7ed" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-5e6220a7-6ea7-441d-abb5-6fe3a367519e req-cfcae1e2-f73c-40ae-9264-4cda63571865 service nova] Acquired lock "refresh_cache-f34c2249-840e-4475-87e6-648d173bc7ed" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG nova.network.neutron [req-5e6220a7-6ea7-441d-abb5-6fe3a367519e req-cfcae1e2-f73c-40ae-9264-4cda63571865 service nova] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Refreshing network info cache for port dc2a981c-9e15-473f-8bd6-c4c312b107d1 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-41f790b2-5b80-4d16-8c96-6c23b5d01639 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "f34c2249-840e-4475-87e6-648d173bc7ed" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-41f790b2-5b80-4d16-8c96-6c23b5d01639 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "f34c2249-840e-4475-87e6-648d173bc7ed" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-41f790b2-5b80-4d16-8c96-6c23b5d01639 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "f34c2249-840e-4475-87e6-648d173bc7ed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-41f790b2-5b80-4d16-8c96-6c23b5d01639 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "f34c2249-840e-4475-87e6-648d173bc7ed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-41f790b2-5b80-4d16-8c96-6c23b5d01639 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "f34c2249-840e-4475-87e6-648d173bc7ed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:37:24 user nova-compute[71229]: INFO nova.compute.manager [None req-41f790b2-5b80-4d16-8c96-6c23b5d01639 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Terminating instance
Apr 11 15:37:24 user nova-compute[71229]: DEBUG nova.compute.manager [None req-41f790b2-5b80-4d16-8c96-6c23b5d01639 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Start destroying the instance on the hypervisor. {{(pid=71229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:24 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:37:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '26630323165373366', 'path': '/dev/sdc'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:37:25 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630323165373366', 'path': '/dev/sdc'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 15:37:25 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:37:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-794339141',display_name='tempest-ServerActionsTestJSON-server-794339141',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-794339141',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfAJGQ+GOa8zW+jlKgD9Kz6/k6iEv9pZIOIjICzcstJ92AAS94+47mc3fRsqyx5FaTMV9P4lTsW4Fy7tKIAtMpRx0Sl7sa6ttQnPbPhlcYqfbdWbTqmmKi6+BuZpqSknA==',key_name='tempest-keypair-1137963694',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb7660e8f76b471487136806ee9eec62',ramdisk_id='',reservation_id='r-g3c0fmpg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1659503440',owner_user_name='tempest-ServerActionsTestJSON-1659503440-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:37:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10720df0ac4f4e62a0a5c9883d600add',uuid=ffce2921-d4a5-4bcb-8032-62a6dc321fb4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "910fb3d4-3965-41a2-8f97-9de79ee78c78", "address": "fa:16:3e:50:1e:37", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap910fb3d4-39", "ovs_interfaceid": "910fb3d4-3965-41a2-8f97-9de79ee78c78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:37:25 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Converting VIF {"id": "910fb3d4-3965-41a2-8f97-9de79ee78c78", "address": "fa:16:3e:50:1e:37", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap910fb3d4-39", "ovs_interfaceid": "910fb3d4-3965-41a2-8f97-9de79ee78c78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:37:25 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:1e:37,bridge_name='br-int',has_traffic_filtering=True,id=910fb3d4-3965-41a2-8f97-9de79ee78c78,network=Network(1bd215e8-0459-4dd2-893b-096b6e31ac08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap910fb3d4-39') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:37:25 user nova-compute[71229]: DEBUG nova.objects.instance [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lazy-loading 'pci_devices' on Instance uuid ffce2921-d4a5-4bcb-8032-62a6dc321fb4 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:37:25 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:37:25 user nova-compute[71229]:   <uuid>ffce2921-d4a5-4bcb-8032-62a6dc321fb4</uuid>
Apr 11 15:37:25 user nova-compute[71229]:   <name>instance-0000001e</name>
Apr 11 15:37:25 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:37:25 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:37:25 user nova-compute[71229]:   <metadata>
Apr 11 15:37:25 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:37:25 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:37:25 user nova-compute[71229]:       <nova:name>tempest-ServerActionsTestJSON-server-794339141</nova:name>
Apr 11 15:37:25 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:37:23</nova:creationTime>
Apr 11 15:37:25 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:37:25 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:37:25 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:37:25 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:37:25 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:37:25 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:37:25 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:37:25 user nova-compute[71229]:       <nova:owner>
Apr 11 15:37:25 user nova-compute[71229]:         <nova:user uuid="10720df0ac4f4e62a0a5c9883d600add">tempest-ServerActionsTestJSON-1659503440-project-member</nova:user>
Apr 11 15:37:25 user nova-compute[71229]:         <nova:project uuid="bb7660e8f76b471487136806ee9eec62">tempest-ServerActionsTestJSON-1659503440</nova:project>
Apr 11 15:37:25 user nova-compute[71229]:       </nova:owner>
Apr 11 15:37:25 user nova-compute[71229]:       <nova:ports>
Apr 11 15:37:25 user nova-compute[71229]:         <nova:port uuid="910fb3d4-3965-41a2-8f97-9de79ee78c78">
Apr 11 15:37:25 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 11 15:37:25 user nova-compute[71229]:         </nova:port>
Apr 11 15:37:25 user nova-compute[71229]:       </nova:ports>
Apr 11 15:37:25 user nova-compute[71229]:     </nova:instance>
Apr 11 15:37:25 user nova-compute[71229]:   </metadata>
Apr 11 15:37:25 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:37:25 user nova-compute[71229]:     <system>
Apr 11 15:37:25 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:37:25 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:37:25 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:37:25 user nova-compute[71229]:       <entry name="serial">ffce2921-d4a5-4bcb-8032-62a6dc321fb4</entry>
Apr 11 15:37:25 user nova-compute[71229]:       <entry name="uuid">ffce2921-d4a5-4bcb-8032-62a6dc321fb4</entry>
Apr 11 15:37:25 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:37:25 user nova-compute[71229]:     </system>
Apr 11 15:37:25 user nova-compute[71229]:   </sysinfo>
Apr 11 15:37:25 user nova-compute[71229]:   <os>
Apr 11 15:37:25 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:37:25 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 15:37:25 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:37:25 user nova-compute[71229]:   </os>
Apr 11 15:37:25 user nova-compute[71229]:   <features>
Apr 11 15:37:25 user nova-compute[71229]:     <acpi/>
Apr 11 15:37:25 user nova-compute[71229]:     <apic/>
Apr 11 15:37:25 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:37:25 user nova-compute[71229]:   </features>
Apr 11 15:37:25 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:37:25 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:37:25 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:37:25 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:37:25 user nova-compute[71229]:   </clock>
Apr 11 15:37:25 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:37:25 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:37:25 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:37:25 user nova-compute[71229]:   </cpu>
Apr 11 15:37:25 user nova-compute[71229]:   <devices>
Apr 11 15:37:25 user nova-compute[71229]:     <disk type="block" device="disk">
Apr 11 15:37:25 user nova-compute[71229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:37:25 user nova-compute[71229]:       <source dev="/dev/sdc"/>
Apr 11 15:37:25 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:37:25 user nova-compute[71229]:       <serial>98d29c73-7b06-45f4-90e0-01a41825cc68</serial>
Apr 11 15:37:25 user nova-compute[71229]:     </disk>
Apr 11 15:37:25 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:37:25 user nova-compute[71229]:       <mac address="fa:16:3e:50:1e:37"/>
Apr 11 15:37:25 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:37:25 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:37:25 user nova-compute[71229]:       <target dev="tap910fb3d4-39"/>
Apr 11 15:37:25 user nova-compute[71229]:     </interface>
Apr 11 15:37:25 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:37:25 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/ffce2921-d4a5-4bcb-8032-62a6dc321fb4/console.log" append="off"/>
Apr 11 15:37:25 user nova-compute[71229]:     </serial>
Apr 11 15:37:25 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:37:25 user nova-compute[71229]:     <video>
Apr 11 15:37:25 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:37:25 user nova-compute[71229]:     </video>
Apr 11 15:37:25 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:37:25 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:37:25 user nova-compute[71229]:     </rng>
Apr 11 15:37:25 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:37:25 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:37:25 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:37:25 user nova-compute[71229]:     </memballoon>
Apr 11 15:37:25 user nova-compute[71229]:   </devices>
Apr 11 15:37:25 user nova-compute[71229]: </domain>
Apr 11 15:37:25 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:37:25 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:37:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-794339141',display_name='tempest-ServerActionsTestJSON-server-794339141',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-794339141',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfAJGQ+GOa8zW+jlKgD9Kz6/k6iEv9pZIOIjICzcstJ92AAS94+47mc3fRsqyx5FaTMV9P4lTsW4Fy7tKIAtMpRx0Sl7sa6ttQnPbPhlcYqfbdWbTqmmKi6+BuZpqSknA==',key_name='tempest-keypair-1137963694',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb7660e8f76b471487136806ee9eec62',ramdisk_id='',reservation_id='r-g3c0fmpg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1659503440',owner_user_name='tempest-ServerActionsTestJSON-1659503440-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:37:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10720df0ac4f4e62a0a5c9883d600add',uuid=ffce2921-d4a5-4bcb-8032-62a6dc321fb4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "910fb3d4-3965-41a2-8f97-9de79ee78c78", "address": "fa:16:3e:50:1e:37", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap910fb3d4-39", "ovs_interfaceid": "910fb3d4-3965-41a2-8f97-9de79ee78c78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:37:25 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Converting VIF {"id": "910fb3d4-3965-41a2-8f97-9de79ee78c78", "address": "fa:16:3e:50:1e:37", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap910fb3d4-39", "ovs_interfaceid": "910fb3d4-3965-41a2-8f97-9de79ee78c78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:37:25 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:1e:37,bridge_name='br-int',has_traffic_filtering=True,id=910fb3d4-3965-41a2-8f97-9de79ee78c78,network=Network(1bd215e8-0459-4dd2-893b-096b6e31ac08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap910fb3d4-39') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:37:25 user nova-compute[71229]: DEBUG os_vif [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:1e:37,bridge_name='br-int',has_traffic_filtering=True,id=910fb3d4-3965-41a2-8f97-9de79ee78c78,network=Network(1bd215e8-0459-4dd2-893b-096b6e31ac08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap910fb3d4-39') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:37:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:37:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:37:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap910fb3d4-39, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:37:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap910fb3d4-39, col_values=(('external_ids', {'iface-id': '910fb3d4-3965-41a2-8f97-9de79ee78c78', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:1e:37', 'vm-uuid': 'ffce2921-d4a5-4bcb-8032-62a6dc321fb4'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:37:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:37:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:25 user nova-compute[71229]: INFO os_vif [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:1e:37,bridge_name='br-int',has_traffic_filtering=True,id=910fb3d4-3965-41a2-8f97-9de79ee78c78,network=Network(1bd215e8-0459-4dd2-893b-096b6e31ac08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap910fb3d4-39')
Apr 11 15:37:25 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:37:25 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] No VIF found with MAC fa:16:3e:50:1e:37, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:37:25 user nova-compute[71229]: DEBUG nova.network.neutron [req-5e6220a7-6ea7-441d-abb5-6fe3a367519e req-cfcae1e2-f73c-40ae-9264-4cda63571865 service nova] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Updated VIF entry in instance network info cache for port dc2a981c-9e15-473f-8bd6-c4c312b107d1. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:37:25 user nova-compute[71229]: DEBUG nova.network.neutron [req-5e6220a7-6ea7-441d-abb5-6fe3a367519e req-cfcae1e2-f73c-40ae-9264-4cda63571865 service nova] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Updating instance_info_cache with network_info: [{"id": "dc2a981c-9e15-473f-8bd6-c4c312b107d1", "address": "fa:16:3e:68:02:4d", "network": {"id": "8dd93667-4f8b-4d89-b7be-056f5f39bffe", "bridge": "br-int", "label": "tempest-TestStampPattern-1555823894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0f7abe5e3144c7ab354ffaba1748616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc2a981c-9e", "ovs_interfaceid": "dc2a981c-9e15-473f-8bd6-c4c312b107d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:37:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-5e6220a7-6ea7-441d-abb5-6fe3a367519e req-cfcae1e2-f73c-40ae-9264-4cda63571865 service nova] Releasing lock "refresh_cache-f34c2249-840e-4475-87e6-648d173bc7ed" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:37:25 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Instance destroyed successfully.
Apr 11 15:37:25 user nova-compute[71229]: DEBUG nova.objects.instance [None req-41f790b2-5b80-4d16-8c96-6c23b5d01639 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lazy-loading 'resources' on Instance uuid f34c2249-840e-4475-87e6-648d173bc7ed {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:37:25 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-41f790b2-5b80-4d16-8c96-6c23b5d01639 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:34:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1403839106',display_name='tempest-TestStampPattern-server-1403839106',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1403839106',id=25,image_ref='acf06024-4378-482a-bbf6-6ff8213c4958',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3FSQFz663lRbqzNxmPBbu9uJ3msIEfoeqvzCwilWtgPX+8lEdFmI1HaDVmQnOzGM0qsSCbXPgFMVYIHe6QVLQ+qXsBEhvf3WHKTsTkVBdGgOn/xo5dIBdvrA6jCgt/VA==',key_name='tempest-TestStampPattern-416277054',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:34:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f0f7abe5e3144c7ab354ffaba1748616',ramdisk_id='',reservation_id='r-g0b4x1ow',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='85658a44-9ff2-4553-b9fd-686bf35fd6ec',image_min_disk='1',image_min_ram='0',image_owner_id='f0f7abe5e3144c7ab354ffaba1748616',image_owner_project_name='tempest-TestStampPattern-344874523',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-344874523-project-member',image_user_id='402ec212c8a64a559f82c166070a92ef',owner_project_name='tempest-TestStampPattern-344874523',owner_user_name='tempest-TestStampPattern-344874523-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:34:42Z,user_data=None,user_id='402ec212c8a64a559f82c166070a92ef',uuid=f34c2249-840e-4475-87e6-648d173bc7ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc2a981c-9e15-473f-8bd6-c4c312b107d1", "address": "fa:16:3e:68:02:4d", "network": {"id": "8dd93667-4f8b-4d89-b7be-056f5f39bffe", "bridge": "br-int", "label": "tempest-TestStampPattern-1555823894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0f7abe5e3144c7ab354ffaba1748616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc2a981c-9e", "ovs_interfaceid": "dc2a981c-9e15-473f-8bd6-c4c312b107d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:37:25 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-41f790b2-5b80-4d16-8c96-6c23b5d01639 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Converting VIF {"id": "dc2a981c-9e15-473f-8bd6-c4c312b107d1", "address": "fa:16:3e:68:02:4d", "network": {"id": "8dd93667-4f8b-4d89-b7be-056f5f39bffe", "bridge": "br-int", "label": "tempest-TestStampPattern-1555823894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0f7abe5e3144c7ab354ffaba1748616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc2a981c-9e", "ovs_interfaceid": "dc2a981c-9e15-473f-8bd6-c4c312b107d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:37:25 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-41f790b2-5b80-4d16-8c96-6c23b5d01639 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:02:4d,bridge_name='br-int',has_traffic_filtering=True,id=dc2a981c-9e15-473f-8bd6-c4c312b107d1,network=Network(8dd93667-4f8b-4d89-b7be-056f5f39bffe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc2a981c-9e') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:37:25 user nova-compute[71229]: DEBUG os_vif [None req-41f790b2-5b80-4d16-8c96-6c23b5d01639 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:02:4d,bridge_name='br-int',has_traffic_filtering=True,id=dc2a981c-9e15-473f-8bd6-c4c312b107d1,network=Network(8dd93667-4f8b-4d89-b7be-056f5f39bffe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc2a981c-9e') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:37:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc2a981c-9e, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:37:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:37:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:25 user nova-compute[71229]: INFO os_vif [None req-41f790b2-5b80-4d16-8c96-6c23b5d01639 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:02:4d,bridge_name='br-int',has_traffic_filtering=True,id=dc2a981c-9e15-473f-8bd6-c4c312b107d1,network=Network(8dd93667-4f8b-4d89-b7be-056f5f39bffe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc2a981c-9e')
Apr 11 15:37:25 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-41f790b2-5b80-4d16-8c96-6c23b5d01639 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Deleting instance files /opt/stack/data/nova/instances/f34c2249-840e-4475-87e6-648d173bc7ed_del
Apr 11 15:37:25 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-41f790b2-5b80-4d16-8c96-6c23b5d01639 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Deletion of /opt/stack/data/nova/instances/f34c2249-840e-4475-87e6-648d173bc7ed_del complete
Apr 11 15:37:26 user nova-compute[71229]: INFO nova.compute.manager [None req-41f790b2-5b80-4d16-8c96-6c23b5d01639 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Took 1.14 seconds to destroy the instance on the hypervisor.
Apr 11 15:37:26 user nova-compute[71229]: DEBUG oslo.service.loopingcall [None req-41f790b2-5b80-4d16-8c96-6c23b5d01639 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71229) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 15:37:26 user nova-compute[71229]: DEBUG nova.compute.manager [-] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Deallocating network for instance {{(pid=71229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 15:37:26 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] deallocate_for_instance() {{(pid=71229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 15:37:26 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:37:26 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Took 0.46 seconds to deallocate network for instance.
Apr 11 15:37:26 user nova-compute[71229]: DEBUG nova.compute.manager [req-28a2aad1-e08c-4ae4-b20e-97f8e80fe5cf req-55376843-d23a-4819-be0a-9274e2d5c608 service nova] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Received event network-vif-deleted-dc2a981c-9e15-473f-8bd6-c4c312b107d1 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:37:26 user nova-compute[71229]: INFO nova.compute.manager [req-28a2aad1-e08c-4ae4-b20e-97f8e80fe5cf req-55376843-d23a-4819-be0a-9274e2d5c608 service nova] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Neutron deleted interface dc2a981c-9e15-473f-8bd6-c4c312b107d1; detaching it from the instance and deleting it from the info cache
Apr 11 15:37:26 user nova-compute[71229]: DEBUG nova.network.neutron [req-28a2aad1-e08c-4ae4-b20e-97f8e80fe5cf req-55376843-d23a-4819-be0a-9274e2d5c608 service nova] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:37:26 user nova-compute[71229]: DEBUG nova.compute.manager [req-28a2aad1-e08c-4ae4-b20e-97f8e80fe5cf req-55376843-d23a-4819-be0a-9274e2d5c608 service nova] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Detach interface failed, port_id=dc2a981c-9e15-473f-8bd6-c4c312b107d1, reason: Instance f34c2249-840e-4475-87e6-648d173bc7ed could not be found. {{(pid=71229) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 15:37:26 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-41f790b2-5b80-4d16-8c96-6c23b5d01639 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:37:26 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-41f790b2-5b80-4d16-8c96-6c23b5d01639 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:37:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:26 user nova-compute[71229]: DEBUG nova.compute.manager [req-ec294973-191c-43bf-9f14-17b89a290703 req-37310beb-dd9e-44aa-97d9-3ae016909c6f service nova] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Received event network-vif-unplugged-dc2a981c-9e15-473f-8bd6-c4c312b107d1 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:37:26 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-ec294973-191c-43bf-9f14-17b89a290703 req-37310beb-dd9e-44aa-97d9-3ae016909c6f service nova] Acquiring lock "f34c2249-840e-4475-87e6-648d173bc7ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:37:26 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-ec294973-191c-43bf-9f14-17b89a290703 req-37310beb-dd9e-44aa-97d9-3ae016909c6f service nova] Lock "f34c2249-840e-4475-87e6-648d173bc7ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:37:26 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-ec294973-191c-43bf-9f14-17b89a290703 req-37310beb-dd9e-44aa-97d9-3ae016909c6f service nova] Lock "f34c2249-840e-4475-87e6-648d173bc7ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:37:26 user nova-compute[71229]: DEBUG nova.compute.manager [req-ec294973-191c-43bf-9f14-17b89a290703 req-37310beb-dd9e-44aa-97d9-3ae016909c6f service nova] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] No waiting events found dispatching network-vif-unplugged-dc2a981c-9e15-473f-8bd6-c4c312b107d1 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:37:26 user nova-compute[71229]: WARNING nova.compute.manager [req-ec294973-191c-43bf-9f14-17b89a290703 req-37310beb-dd9e-44aa-97d9-3ae016909c6f service nova] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Received unexpected event network-vif-unplugged-dc2a981c-9e15-473f-8bd6-c4c312b107d1 for instance with vm_state deleted and task_state None.
Apr 11 15:37:26 user nova-compute[71229]: DEBUG nova.compute.manager [req-ec294973-191c-43bf-9f14-17b89a290703 req-37310beb-dd9e-44aa-97d9-3ae016909c6f service nova] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Received event network-vif-plugged-dc2a981c-9e15-473f-8bd6-c4c312b107d1 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:37:26 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-ec294973-191c-43bf-9f14-17b89a290703 req-37310beb-dd9e-44aa-97d9-3ae016909c6f service nova] Acquiring lock "f34c2249-840e-4475-87e6-648d173bc7ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:37:26 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-ec294973-191c-43bf-9f14-17b89a290703 req-37310beb-dd9e-44aa-97d9-3ae016909c6f service nova] Lock "f34c2249-840e-4475-87e6-648d173bc7ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:37:26 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-ec294973-191c-43bf-9f14-17b89a290703 req-37310beb-dd9e-44aa-97d9-3ae016909c6f service nova] Lock "f34c2249-840e-4475-87e6-648d173bc7ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:37:26 user nova-compute[71229]: DEBUG nova.compute.manager [req-ec294973-191c-43bf-9f14-17b89a290703 req-37310beb-dd9e-44aa-97d9-3ae016909c6f service nova] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] No waiting events found dispatching network-vif-plugged-dc2a981c-9e15-473f-8bd6-c4c312b107d1 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:37:26 user nova-compute[71229]: WARNING nova.compute.manager [req-ec294973-191c-43bf-9f14-17b89a290703 req-37310beb-dd9e-44aa-97d9-3ae016909c6f service nova] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Received unexpected event network-vif-plugged-dc2a981c-9e15-473f-8bd6-c4c312b107d1 for instance with vm_state deleted and task_state None.
Apr 11 15:37:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:26 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-41f790b2-5b80-4d16-8c96-6c23b5d01639 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:37:26 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-41f790b2-5b80-4d16-8c96-6c23b5d01639 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:37:27 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-41f790b2-5b80-4d16-8c96-6c23b5d01639 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.507s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:37:27 user nova-compute[71229]: INFO nova.scheduler.client.report [None req-41f790b2-5b80-4d16-8c96-6c23b5d01639 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Deleted allocations for instance f34c2249-840e-4475-87e6-648d173bc7ed
Apr 11 15:37:27 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-41f790b2-5b80-4d16-8c96-6c23b5d01639 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "f34c2249-840e-4475-87e6-648d173bc7ed" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.292s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:37:28 user nova-compute[71229]: DEBUG nova.compute.manager [req-3b46c809-3038-449d-ae95-7ee17796da2b req-54b87246-19d8-4209-a580-983e6e25b93b service nova] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Received event network-vif-plugged-910fb3d4-3965-41a2-8f97-9de79ee78c78 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:37:28 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3b46c809-3038-449d-ae95-7ee17796da2b req-54b87246-19d8-4209-a580-983e6e25b93b service nova] Acquiring lock "ffce2921-d4a5-4bcb-8032-62a6dc321fb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:37:28 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3b46c809-3038-449d-ae95-7ee17796da2b req-54b87246-19d8-4209-a580-983e6e25b93b service nova] Lock "ffce2921-d4a5-4bcb-8032-62a6dc321fb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:37:28 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3b46c809-3038-449d-ae95-7ee17796da2b req-54b87246-19d8-4209-a580-983e6e25b93b service nova] Lock "ffce2921-d4a5-4bcb-8032-62a6dc321fb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:37:28 user nova-compute[71229]: DEBUG nova.compute.manager [req-3b46c809-3038-449d-ae95-7ee17796da2b req-54b87246-19d8-4209-a580-983e6e25b93b service nova] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] No waiting events found dispatching network-vif-plugged-910fb3d4-3965-41a2-8f97-9de79ee78c78 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:37:28 user nova-compute[71229]: WARNING nova.compute.manager [req-3b46c809-3038-449d-ae95-7ee17796da2b req-54b87246-19d8-4209-a580-983e6e25b93b service nova] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Received unexpected event network-vif-plugged-910fb3d4-3965-41a2-8f97-9de79ee78c78 for instance with vm_state building and task_state spawning.
Apr 11 15:37:28 user nova-compute[71229]: DEBUG nova.compute.manager [req-3b46c809-3038-449d-ae95-7ee17796da2b req-54b87246-19d8-4209-a580-983e6e25b93b service nova] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Received event network-vif-plugged-910fb3d4-3965-41a2-8f97-9de79ee78c78 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:37:28 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3b46c809-3038-449d-ae95-7ee17796da2b req-54b87246-19d8-4209-a580-983e6e25b93b service nova] Acquiring lock "ffce2921-d4a5-4bcb-8032-62a6dc321fb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:37:28 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3b46c809-3038-449d-ae95-7ee17796da2b req-54b87246-19d8-4209-a580-983e6e25b93b service nova] Lock "ffce2921-d4a5-4bcb-8032-62a6dc321fb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:37:28 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3b46c809-3038-449d-ae95-7ee17796da2b req-54b87246-19d8-4209-a580-983e6e25b93b service nova] Lock "ffce2921-d4a5-4bcb-8032-62a6dc321fb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:37:28 user nova-compute[71229]: DEBUG nova.compute.manager [req-3b46c809-3038-449d-ae95-7ee17796da2b req-54b87246-19d8-4209-a580-983e6e25b93b service nova] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] No waiting events found dispatching network-vif-plugged-910fb3d4-3965-41a2-8f97-9de79ee78c78 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:37:28 user nova-compute[71229]: WARNING nova.compute.manager [req-3b46c809-3038-449d-ae95-7ee17796da2b req-54b87246-19d8-4209-a580-983e6e25b93b service nova] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Received unexpected event network-vif-plugged-910fb3d4-3965-41a2-8f97-9de79ee78c78 for instance with vm_state building and task_state spawning.
Apr 11 15:37:28 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227448.979869, ffce2921-d4a5-4bcb-8032-62a6dc321fb4 => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:37:28 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] VM Resumed (Lifecycle Event)
Apr 11 15:37:28 user nova-compute[71229]: DEBUG nova.compute.manager [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 15:37:28 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Guest created on hypervisor {{(pid=71229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 15:37:28 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Instance spawned successfully.
Apr 11 15:37:28 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 15:37:29 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:37:29 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:37:29 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Found default for hw_cdrom_bus of ide {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:37:29 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Found default for hw_disk_bus of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:37:29 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Found default for hw_input_bus of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:37:29 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Found default for hw_pointer_model of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:37:29 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Found default for hw_video_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:37:29 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Found default for hw_vif_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:37:29 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:37:29 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227448.981652, ffce2921-d4a5-4bcb-8032-62a6dc321fb4 => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:37:29 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] VM Started (Lifecycle Event)
Apr 11 15:37:29 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:37:29 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:37:29 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:37:29 user nova-compute[71229]: INFO nova.compute.manager [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Took 5.16 seconds to spawn the instance on the hypervisor.
Apr 11 15:37:29 user nova-compute[71229]: DEBUG nova.compute.manager [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:37:29 user nova-compute[71229]: INFO nova.compute.manager [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Took 10.51 seconds to build instance.
Apr 11 15:37:29 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b174f7d0-e421-4857-8a2d-a0d78a817774 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ffce2921-d4a5-4bcb-8032-62a6dc321fb4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.603s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:37:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "1e3d0956-d528-4097-a200-d9b2b6ce7aa8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:37:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "1e3d0956-d528-4097-a200-d9b2b6ce7aa8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:37:33 user nova-compute[71229]: DEBUG nova.objects.instance [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lazy-loading 'flavor' on Instance uuid 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:37:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "1e3d0956-d528-4097-a200-d9b2b6ce7aa8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:37:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "1e3d0956-d528-4097-a200-d9b2b6ce7aa8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:37:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "1e3d0956-d528-4097-a200-d9b2b6ce7aa8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:37:33 user nova-compute[71229]: INFO nova.compute.manager [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Attaching volume 6119ec74-db79-4b19-9bf7-44cc8a4d853a to /dev/vdb
Apr 11 15:37:33 user nova-compute[71229]: DEBUG os_brick.utils [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:37:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:33 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7c8bdc-15df-43f8-86da-d08c47da8b68]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d55e24a97c90\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:33 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9fef2d-f543-4a50-9c9a-786c9b430580]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:33 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dcc3dde-9b33-4667-a270-fe4711b88feb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:33 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a274aaed-cfca-43e7-9778-74ea8906b44e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Running cmd (subprocess): nvme version {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] 'nvme version' failed. Not Retrying. {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:37:33 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] nvme not present on system {{(pid=71229) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 15:37:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:37:33 user nova-compute[71229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 15:37:33 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9baedeed-c56b-40d8-be92-3f3f889d3281]: (4, '') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:33 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71229) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 15:37:33 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 15:37:33 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] LIGHTOS: no hostnqn found. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 15:37:33 user nova-compute[71229]: DEBUG os_brick.utils [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d55e24a97c90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:37:33 user nova-compute[71229]: DEBUG nova.virt.block_device [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Updating existing volume attachment record: a22edbfc-678c-40ed-902e-feaeba3cffbb {{(pid=71229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 15:37:35 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cvnTNDLM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:37:37 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:37:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:37:37 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:37:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:37:37 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 15:37:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0014b1d-7417-4d09-840c-cd36f1e73017]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 15:37:37 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a -p 172.16.0.220:3260 --interface default --op new {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[058d83bb-3f45-405c-8a4d-5b7411dcd6c6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a] added\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a] added
Apr 11 15:37:37 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[297b690b-e51e-40f7-af0d-529cb8b35f36]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c79afb4-94ed-4c31-bbf7-aad1f34b5c53]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cvnTNDLM {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cvnTNDLM" returned: 0 in 0.024s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[52dfa87d-c591-42d1-8304-0f0d4f5e03c9]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cvnTNDLM'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca44af2-986c-45fb-8cb0-529542b26849]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[619420c0-7694-47a2-a572-a30852e32899]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:37:37 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:37:37 user nova-compute[71229]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 (non-flash)
Apr 11 15:37:37 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:37:37 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:37:37 user nova-compute[71229]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 (non-flash)
Apr 11 15:37:37 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a -p 172.16.0.220:3260 --login {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca95bff-e2d3-4386-aa24-cebcdf53df92]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a, portal: 172.16.0.220,3260]
Apr 11 15:37:37 user nova-compute[71229]: Login to [iface: default, target: iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a, portal: 172.16.0.220,3260] successful.
Apr 11 15:37:37 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eeaa3c0-7a60-45dc-89bf-9b6eaaccf947]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb21914-6a85-413f-9cdc-b8c698481393]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:37:37 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:37:37 user nova-compute[71229]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 (non-flash)
Apr 11 15:37:37 user nova-compute[71229]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a (non-flash)
Apr 11 15:37:37 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:37:37 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:37:37 user nova-compute[71229]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 (non-flash)
Apr 11 15:37:37 user nova-compute[71229]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a (non-flash)
Apr 11 15:37:37 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] HCTL ('36', '-', '-', 0) found on session 34 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f2961c-2fb9-4cb0-8bbc-5baa5cbbc3d1]: (4, ('- - 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:37:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cvnTNDLM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 15:37:38 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:37:38 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '26565336531323639', 'path': '/dev/sde'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:37:38 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565336531323639', 'path': '/dev/sde'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 15:37:38 user nova-compute[71229]: DEBUG nova.objects.instance [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lazy-loading 'flavor' on Instance uuid 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:37:38 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 15:37:38 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:37:38 user nova-compute[71229]:   <source dev="/dev/sde"/>
Apr 11 15:37:38 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 15:37:38 user nova-compute[71229]:   <serial>6119ec74-db79-4b19-9bf7-44cc8a4d853a</serial>
Apr 11 15:37:38 user nova-compute[71229]: </disk>
Apr 11 15:37:38 user nova-compute[71229]:  {{(pid=71229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 15:37:39 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:37:39 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:37:39 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] No VIF found with MAC fa:16:3e:3e:55:16, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:37:39 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1218f9dd-3fdd-4611-90ae-f96c889407cb tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "1e3d0956-d528-4097-a200-d9b2b6ce7aa8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.258s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:37:40 user nova-compute[71229]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681227445.899491, f34c2249-840e-4475-87e6-648d173bc7ed => Stopped> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:37:40 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] VM Stopped (Lifecycle Event)
Apr 11 15:37:40 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:37:40 user nova-compute[71229]: DEBUG nova.compute.manager [None req-891ffa3b-9dfe-4a7a-95ea-62273a9c1a43 None None] [instance: f34c2249-840e-4475-87e6-648d173bc7ed] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:37:42 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:42 user nova-compute[71229]: DEBUG nova.compute.manager [req-a0526ff4-bc43-404a-8268-72debdee6636 req-fd4c5c4b-18c1-4e32-942b-d84e973acdc8 service nova] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Received event network-changed-19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:37:42 user nova-compute[71229]: DEBUG nova.compute.manager [req-a0526ff4-bc43-404a-8268-72debdee6636 req-fd4c5c4b-18c1-4e32-942b-d84e973acdc8 service nova] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Refreshing instance network info cache due to event network-changed-19b6c9ca-9d18-4f57-9687-ce7ffde5ca53. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:37:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a0526ff4-bc43-404a-8268-72debdee6636 req-fd4c5c4b-18c1-4e32-942b-d84e973acdc8 service nova] Acquiring lock "refresh_cache-1e3d0956-d528-4097-a200-d9b2b6ce7aa8" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:37:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a0526ff4-bc43-404a-8268-72debdee6636 req-fd4c5c4b-18c1-4e32-942b-d84e973acdc8 service nova] Acquired lock "refresh_cache-1e3d0956-d528-4097-a200-d9b2b6ce7aa8" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:37:42 user nova-compute[71229]: DEBUG nova.network.neutron [req-a0526ff4-bc43-404a-8268-72debdee6636 req-fd4c5c4b-18c1-4e32-942b-d84e973acdc8 service nova] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Refreshing network info cache for port 19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:37:43 user nova-compute[71229]: INFO nova.compute.manager [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Rescuing
Apr 11 15:37:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "refresh_cache-058df5ba-07ab-4bdd-9a47-907e7b0e0e59" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:37:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquired lock "refresh_cache-058df5ba-07ab-4bdd-9a47-907e7b0e0e59" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:37:43 user nova-compute[71229]: DEBUG nova.network.neutron [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:37:43 user nova-compute[71229]: DEBUG nova.network.neutron [req-a0526ff4-bc43-404a-8268-72debdee6636 req-fd4c5c4b-18c1-4e32-942b-d84e973acdc8 service nova] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Updated VIF entry in instance network info cache for port 19b6c9ca-9d18-4f57-9687-ce7ffde5ca53. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:37:43 user nova-compute[71229]: DEBUG nova.network.neutron [req-a0526ff4-bc43-404a-8268-72debdee6636 req-fd4c5c4b-18c1-4e32-942b-d84e973acdc8 service nova] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Updating instance_info_cache with network_info: [{"id": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53", "address": "fa:16:3e:3e:55:16", "network": {"id": "b1189892-ba9d-4316-9962-c737b27f14bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1737061315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c23461a3d7ca49f6a77d3fde6f1009d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19b6c9ca-9d", "ovs_interfaceid": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:37:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a0526ff4-bc43-404a-8268-72debdee6636 req-fd4c5c4b-18c1-4e32-942b-d84e973acdc8 service nova] Releasing lock "refresh_cache-1e3d0956-d528-4097-a200-d9b2b6ce7aa8" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:37:43 user nova-compute[71229]: DEBUG nova.network.neutron [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Updating instance_info_cache with network_info: [{"id": "cdfec3e6-f5dc-42e6-98a8-651f46bd37f4", "address": "fa:16:3e:47:d3:74", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdfec3e6-f5", "ovs_interfaceid": "cdfec3e6-f5dc-42e6-98a8-651f46bd37f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:37:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Releasing lock "refresh_cache-058df5ba-07ab-4bdd-9a47-907e7b0e0e59" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:37:43 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:43 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:43 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:44 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:44 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:44 user nova-compute[71229]: DEBUG nova.compute.manager [req-e407d68f-6e41-4f58-973a-c79018c1e3d6 req-802c2b4a-78ed-4d2d-ab92-a800e31d3bd5 service nova] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Received event network-vif-unplugged-cdfec3e6-f5dc-42e6-98a8-651f46bd37f4 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:37:44 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e407d68f-6e41-4f58-973a-c79018c1e3d6 req-802c2b4a-78ed-4d2d-ab92-a800e31d3bd5 service nova] Acquiring lock "058df5ba-07ab-4bdd-9a47-907e7b0e0e59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:37:44 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e407d68f-6e41-4f58-973a-c79018c1e3d6 req-802c2b4a-78ed-4d2d-ab92-a800e31d3bd5 service nova] Lock "058df5ba-07ab-4bdd-9a47-907e7b0e0e59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:37:44 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e407d68f-6e41-4f58-973a-c79018c1e3d6 req-802c2b4a-78ed-4d2d-ab92-a800e31d3bd5 service nova] Lock "058df5ba-07ab-4bdd-9a47-907e7b0e0e59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:37:44 user nova-compute[71229]: DEBUG nova.compute.manager [req-e407d68f-6e41-4f58-973a-c79018c1e3d6 req-802c2b4a-78ed-4d2d-ab92-a800e31d3bd5 service nova] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] No waiting events found dispatching network-vif-unplugged-cdfec3e6-f5dc-42e6-98a8-651f46bd37f4 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:37:44 user nova-compute[71229]: WARNING nova.compute.manager [req-e407d68f-6e41-4f58-973a-c79018c1e3d6 req-802c2b4a-78ed-4d2d-ab92-a800e31d3bd5 service nova] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Received unexpected event network-vif-unplugged-cdfec3e6-f5dc-42e6-98a8-651f46bd37f4 for instance with vm_state active and task_state rescuing.
Apr 11 15:37:44 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Instance destroyed successfully.
Apr 11 15:37:44 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Attempting rescue
Apr 11 15:37:44 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71229) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 11 15:37:44 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Instance directory exists: not creating {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 15:37:44 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Creating image(s)
Apr 11 15:37:44 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "/opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:37:44 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "/opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:37:44 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "/opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:37:44 user nova-compute[71229]: DEBUG nova.objects.instance [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lazy-loading 'trusted_certs' on Instance uuid 058df5ba-07ab-4bdd-9a47-907e7b0e0e59 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:37:44 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:37:44 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:37:44 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:44 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.158s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:44 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:44 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue" returned: 0 in 0.052s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:44 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:37:44 user nova-compute[71229]: DEBUG nova.objects.instance [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lazy-loading 'migration_context' on Instance uuid 058df5ba-07ab-4bdd-9a47-907e7b0e0e59 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:37:44 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Created local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 15:37:44 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Start _get_guest_xml network_info=[{"id": "cdfec3e6-f5dc-42e6-98a8-651f46bd37f4", "address": "fa:16:3e:47:d3:74", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "vif_mac": "fa:16:3e:47:d3:74"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdfec3e6-f5", "ovs_interfaceid": "cdfec3e6-f5dc-42e6-98a8-651f46bd37f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '52fe638c-5ada-47d5-b376-233bfa808a37', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:37:44 user nova-compute[71229]: DEBUG nova.objects.instance [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lazy-loading 'resources' on Instance uuid 058df5ba-07ab-4bdd-9a47-907e7b0e0e59 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:37:44 user nova-compute[71229]: DEBUG nova.objects.instance [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lazy-loading 'numa_topology' on Instance uuid 058df5ba-07ab-4bdd-9a47-907e7b0e0e59 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:37:44 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:37:44 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:37:44 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:37:44 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:37:44 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:37:44 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:37:44 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:37:44 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:37:44 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:37:44 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:37:44 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:37:44 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:37:44 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:37:44 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:37:44 user nova-compute[71229]: DEBUG nova.objects.instance [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lazy-loading 'vcpu_model' on Instance uuid 058df5ba-07ab-4bdd-9a47-907e7b0e0e59 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:37:44 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:35:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1607555869',display_name='tempest-ServerRescueNegativeTestJSON-server-1607555869',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1607555869',id=29,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:36:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d700a53aa25849e0afd562b05881d09a',ramdisk_id='',reservation_id='r-z6w5qaef',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1491000769',owner_user_name='tempest-ServerRescueNegativeTestJSON-1491000769-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:36:01Z,user_data=None,user_id='5c8492f96e5d4f54aaae3679c82b6759',uuid=058df5ba-07ab-4bdd-9a47-907e7b0e0e59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cdfec3e6-f5dc-42e6-98a8-651f46bd37f4", "address": "fa:16:3e:47:d3:74", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "vif_mac": "fa:16:3e:47:d3:74"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdfec3e6-f5", "ovs_interfaceid": "cdfec3e6-f5dc-42e6-98a8-651f46bd37f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:37:44 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Converting VIF {"id": "cdfec3e6-f5dc-42e6-98a8-651f46bd37f4", "address": "fa:16:3e:47:d3:74", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "vif_mac": "fa:16:3e:47:d3:74"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdfec3e6-f5", "ovs_interfaceid": "cdfec3e6-f5dc-42e6-98a8-651f46bd37f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:37:44 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:d3:74,bridge_name='br-int',has_traffic_filtering=True,id=cdfec3e6-f5dc-42e6-98a8-651f46bd37f4,network=Network(7ba20249-9c62-46d7-810c-8144c1a1f17e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdfec3e6-f5') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:37:44 user nova-compute[71229]: DEBUG nova.objects.instance [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lazy-loading 'pci_devices' on Instance uuid 058df5ba-07ab-4bdd-9a47-907e7b0e0e59 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:37:44 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:37:44 user nova-compute[71229]:   <uuid>058df5ba-07ab-4bdd-9a47-907e7b0e0e59</uuid>
Apr 11 15:37:44 user nova-compute[71229]:   <name>instance-0000001d</name>
Apr 11 15:37:44 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:37:44 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:37:44 user nova-compute[71229]:   <metadata>
Apr 11 15:37:44 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:37:44 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:37:44 user nova-compute[71229]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1607555869</nova:name>
Apr 11 15:37:44 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:37:44</nova:creationTime>
Apr 11 15:37:44 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:37:44 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:37:44 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:37:44 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:37:44 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:37:44 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:37:44 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:37:44 user nova-compute[71229]:       <nova:owner>
Apr 11 15:37:44 user nova-compute[71229]:         <nova:user uuid="5c8492f96e5d4f54aaae3679c82b6759">tempest-ServerRescueNegativeTestJSON-1491000769-project-member</nova:user>
Apr 11 15:37:44 user nova-compute[71229]:         <nova:project uuid="d700a53aa25849e0afd562b05881d09a">tempest-ServerRescueNegativeTestJSON-1491000769</nova:project>
Apr 11 15:37:44 user nova-compute[71229]:       </nova:owner>
Apr 11 15:37:44 user nova-compute[71229]:       <nova:root type="image" uuid="52fe638c-5ada-47d5-b376-233bfa808a37"/>
Apr 11 15:37:44 user nova-compute[71229]:       <nova:ports>
Apr 11 15:37:44 user nova-compute[71229]:         <nova:port uuid="cdfec3e6-f5dc-42e6-98a8-651f46bd37f4">
Apr 11 15:37:44 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 11 15:37:44 user nova-compute[71229]:         </nova:port>
Apr 11 15:37:44 user nova-compute[71229]:       </nova:ports>
Apr 11 15:37:44 user nova-compute[71229]:     </nova:instance>
Apr 11 15:37:44 user nova-compute[71229]:   </metadata>
Apr 11 15:37:44 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:37:44 user nova-compute[71229]:     <system>
Apr 11 15:37:44 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:37:44 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:37:44 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:37:44 user nova-compute[71229]:       <entry name="serial">058df5ba-07ab-4bdd-9a47-907e7b0e0e59</entry>
Apr 11 15:37:44 user nova-compute[71229]:       <entry name="uuid">058df5ba-07ab-4bdd-9a47-907e7b0e0e59</entry>
Apr 11 15:37:44 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:37:44 user nova-compute[71229]:     </system>
Apr 11 15:37:44 user nova-compute[71229]:   </sysinfo>
Apr 11 15:37:44 user nova-compute[71229]:   <os>
Apr 11 15:37:44 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:37:44 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:37:44 user nova-compute[71229]:   </os>
Apr 11 15:37:44 user nova-compute[71229]:   <features>
Apr 11 15:37:44 user nova-compute[71229]:     <acpi/>
Apr 11 15:37:44 user nova-compute[71229]:     <apic/>
Apr 11 15:37:44 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:37:44 user nova-compute[71229]:   </features>
Apr 11 15:37:44 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:37:44 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:37:44 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:37:44 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:37:44 user nova-compute[71229]:   </clock>
Apr 11 15:37:44 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:37:44 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:37:44 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:37:44 user nova-compute[71229]:   </cpu>
Apr 11 15:37:44 user nova-compute[71229]:   <devices>
Apr 11 15:37:44 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 15:37:44 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 15:37:44 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue"/>
Apr 11 15:37:44 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:37:44 user nova-compute[71229]:     </disk>
Apr 11 15:37:44 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 15:37:44 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 15:37:44 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk"/>
Apr 11 15:37:44 user nova-compute[71229]:       <target dev="vdb" bus="virtio"/>
Apr 11 15:37:44 user nova-compute[71229]:     </disk>
Apr 11 15:37:44 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:37:44 user nova-compute[71229]:       <mac address="fa:16:3e:47:d3:74"/>
Apr 11 15:37:44 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:37:44 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:37:44 user nova-compute[71229]:       <target dev="tapcdfec3e6-f5"/>
Apr 11 15:37:44 user nova-compute[71229]:     </interface>
Apr 11 15:37:44 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:37:44 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/console.log" append="off"/>
Apr 11 15:37:44 user nova-compute[71229]:     </serial>
Apr 11 15:37:44 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:37:44 user nova-compute[71229]:     <video>
Apr 11 15:37:44 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:37:44 user nova-compute[71229]:     </video>
Apr 11 15:37:44 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:37:44 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:37:44 user nova-compute[71229]:     </rng>
Apr 11 15:37:44 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:37:44 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:37:44 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:37:44 user nova-compute[71229]:     </memballoon>
Apr 11 15:37:44 user nova-compute[71229]:   </devices>
Apr 11 15:37:44 user nova-compute[71229]: </domain>
Apr 11 15:37:44 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:37:44 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Instance destroyed successfully.
Apr 11 15:37:44 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:37:44 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:37:44 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] No VIF found with MAC fa:16:3e:47:d3:74, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:37:45 user nova-compute[71229]: DEBUG nova.compute.manager [req-1e53f403-25d6-4be1-9947-c74a54231ca9 req-9014dbda-d37c-4264-89eb-c06e1345cf0b service nova] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Received event network-changed-19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:37:45 user nova-compute[71229]: DEBUG nova.compute.manager [req-1e53f403-25d6-4be1-9947-c74a54231ca9 req-9014dbda-d37c-4264-89eb-c06e1345cf0b service nova] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Refreshing instance network info cache due to event network-changed-19b6c9ca-9d18-4f57-9687-ce7ffde5ca53. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:37:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-1e53f403-25d6-4be1-9947-c74a54231ca9 req-9014dbda-d37c-4264-89eb-c06e1345cf0b service nova] Acquiring lock "refresh_cache-1e3d0956-d528-4097-a200-d9b2b6ce7aa8" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:37:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-1e53f403-25d6-4be1-9947-c74a54231ca9 req-9014dbda-d37c-4264-89eb-c06e1345cf0b service nova] Acquired lock "refresh_cache-1e3d0956-d528-4097-a200-d9b2b6ce7aa8" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:37:45 user nova-compute[71229]: DEBUG nova.network.neutron [req-1e53f403-25d6-4be1-9947-c74a54231ca9 req-9014dbda-d37c-4264-89eb-c06e1345cf0b service nova] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Refreshing network info cache for port 19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:37:45 user nova-compute[71229]: DEBUG nova.network.neutron [req-1e53f403-25d6-4be1-9947-c74a54231ca9 req-9014dbda-d37c-4264-89eb-c06e1345cf0b service nova] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Updated VIF entry in instance network info cache for port 19b6c9ca-9d18-4f57-9687-ce7ffde5ca53. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:37:45 user nova-compute[71229]: DEBUG nova.network.neutron [req-1e53f403-25d6-4be1-9947-c74a54231ca9 req-9014dbda-d37c-4264-89eb-c06e1345cf0b service nova] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Updating instance_info_cache with network_info: [{"id": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53", "address": "fa:16:3e:3e:55:16", "network": {"id": "b1189892-ba9d-4316-9962-c737b27f14bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1737061315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c23461a3d7ca49f6a77d3fde6f1009d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19b6c9ca-9d", "ovs_interfaceid": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:37:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-1e53f403-25d6-4be1-9947-c74a54231ca9 req-9014dbda-d37c-4264-89eb-c06e1345cf0b service nova] Releasing lock "refresh_cache-1e3d0956-d528-4097-a200-d9b2b6ce7aa8" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:37:45 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:46 user nova-compute[71229]: DEBUG nova.compute.manager [req-cf1f5ee5-5314-46ea-a2c3-0171517d4864 req-f092c58b-77e4-4f26-b9d1-38cefc42ed9c service nova] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Received event network-vif-plugged-cdfec3e6-f5dc-42e6-98a8-651f46bd37f4 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:37:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-cf1f5ee5-5314-46ea-a2c3-0171517d4864 req-f092c58b-77e4-4f26-b9d1-38cefc42ed9c service nova] Acquiring lock "058df5ba-07ab-4bdd-9a47-907e7b0e0e59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:37:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-cf1f5ee5-5314-46ea-a2c3-0171517d4864 req-f092c58b-77e4-4f26-b9d1-38cefc42ed9c service nova] Lock "058df5ba-07ab-4bdd-9a47-907e7b0e0e59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:37:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-cf1f5ee5-5314-46ea-a2c3-0171517d4864 req-f092c58b-77e4-4f26-b9d1-38cefc42ed9c service nova] Lock "058df5ba-07ab-4bdd-9a47-907e7b0e0e59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:37:46 user nova-compute[71229]: DEBUG nova.compute.manager [req-cf1f5ee5-5314-46ea-a2c3-0171517d4864 req-f092c58b-77e4-4f26-b9d1-38cefc42ed9c service nova] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] No waiting events found dispatching network-vif-plugged-cdfec3e6-f5dc-42e6-98a8-651f46bd37f4 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:37:46 user nova-compute[71229]: WARNING nova.compute.manager [req-cf1f5ee5-5314-46ea-a2c3-0171517d4864 req-f092c58b-77e4-4f26-b9d1-38cefc42ed9c service nova] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Received unexpected event network-vif-plugged-cdfec3e6-f5dc-42e6-98a8-651f46bd37f4 for instance with vm_state active and task_state rescuing.
Apr 11 15:37:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "1e3d0956-d528-4097-a200-d9b2b6ce7aa8" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:37:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "1e3d0956-d528-4097-a200-d9b2b6ce7aa8" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:37:46 user nova-compute[71229]: INFO nova.compute.manager [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Rebooting instance
Apr 11 15:37:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "refresh_cache-1e3d0956-d528-4097-a200-d9b2b6ce7aa8" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:37:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquired lock "refresh_cache-1e3d0956-d528-4097-a200-d9b2b6ce7aa8" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:37:46 user nova-compute[71229]: DEBUG nova.network.neutron [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:37:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:47 user nova-compute[71229]: DEBUG nova.network.neutron [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Updating instance_info_cache with network_info: [{"id": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53", "address": "fa:16:3e:3e:55:16", "network": {"id": "b1189892-ba9d-4316-9962-c737b27f14bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1737061315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c23461a3d7ca49f6a77d3fde6f1009d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19b6c9ca-9d", "ovs_interfaceid": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:37:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Releasing lock "refresh_cache-1e3d0956-d528-4097-a200-d9b2b6ce7aa8" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:37:47 user nova-compute[71229]: DEBUG nova.compute.manager [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:37:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:47 user nova-compute[71229]: DEBUG nova.compute.manager [req-24614ad6-62c5-4201-8d72-05bf798c4498 req-1bbf102c-9833-40a6-8c58-e6496b22a03b service nova] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Received event network-vif-unplugged-19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:37:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-24614ad6-62c5-4201-8d72-05bf798c4498 req-1bbf102c-9833-40a6-8c58-e6496b22a03b service nova] Acquiring lock "1e3d0956-d528-4097-a200-d9b2b6ce7aa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:37:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-24614ad6-62c5-4201-8d72-05bf798c4498 req-1bbf102c-9833-40a6-8c58-e6496b22a03b service nova] Lock "1e3d0956-d528-4097-a200-d9b2b6ce7aa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:37:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-24614ad6-62c5-4201-8d72-05bf798c4498 req-1bbf102c-9833-40a6-8c58-e6496b22a03b service nova] Lock "1e3d0956-d528-4097-a200-d9b2b6ce7aa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:37:47 user nova-compute[71229]: DEBUG nova.compute.manager [req-24614ad6-62c5-4201-8d72-05bf798c4498 req-1bbf102c-9833-40a6-8c58-e6496b22a03b service nova] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] No waiting events found dispatching network-vif-unplugged-19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:37:47 user nova-compute[71229]: WARNING nova.compute.manager [req-24614ad6-62c5-4201-8d72-05bf798c4498 req-1bbf102c-9833-40a6-8c58-e6496b22a03b service nova] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Received unexpected event network-vif-unplugged-19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 for instance with vm_state active and task_state reboot_started_hard.
Apr 11 15:37:48 user nova-compute[71229]: DEBUG nova.compute.manager [req-24a4011d-2636-4e7f-ab1d-d323b539d7d2 req-5e95ac17-0c2e-4cb0-8bb8-f4f7fbdacf53 service nova] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Received event network-vif-plugged-cdfec3e6-f5dc-42e6-98a8-651f46bd37f4 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-24a4011d-2636-4e7f-ab1d-d323b539d7d2 req-5e95ac17-0c2e-4cb0-8bb8-f4f7fbdacf53 service nova] Acquiring lock "058df5ba-07ab-4bdd-9a47-907e7b0e0e59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-24a4011d-2636-4e7f-ab1d-d323b539d7d2 req-5e95ac17-0c2e-4cb0-8bb8-f4f7fbdacf53 service nova] Lock "058df5ba-07ab-4bdd-9a47-907e7b0e0e59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-24a4011d-2636-4e7f-ab1d-d323b539d7d2 req-5e95ac17-0c2e-4cb0-8bb8-f4f7fbdacf53 service nova] Lock "058df5ba-07ab-4bdd-9a47-907e7b0e0e59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG nova.compute.manager [req-24a4011d-2636-4e7f-ab1d-d323b539d7d2 req-5e95ac17-0c2e-4cb0-8bb8-f4f7fbdacf53 service nova] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] No waiting events found dispatching network-vif-plugged-cdfec3e6-f5dc-42e6-98a8-651f46bd37f4 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:37:48 user nova-compute[71229]: WARNING nova.compute.manager [req-24a4011d-2636-4e7f-ab1d-d323b539d7d2 req-5e95ac17-0c2e-4cb0-8bb8-f4f7fbdacf53 service nova] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Received unexpected event network-vif-plugged-cdfec3e6-f5dc-42e6-98a8-651f46bd37f4 for instance with vm_state active and task_state rescuing.
Apr 11 15:37:48 user nova-compute[71229]: DEBUG nova.compute.manager [req-24a4011d-2636-4e7f-ab1d-d323b539d7d2 req-5e95ac17-0c2e-4cb0-8bb8-f4f7fbdacf53 service nova] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Received event network-vif-plugged-cdfec3e6-f5dc-42e6-98a8-651f46bd37f4 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-24a4011d-2636-4e7f-ab1d-d323b539d7d2 req-5e95ac17-0c2e-4cb0-8bb8-f4f7fbdacf53 service nova] Acquiring lock "058df5ba-07ab-4bdd-9a47-907e7b0e0e59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-24a4011d-2636-4e7f-ab1d-d323b539d7d2 req-5e95ac17-0c2e-4cb0-8bb8-f4f7fbdacf53 service nova] Lock "058df5ba-07ab-4bdd-9a47-907e7b0e0e59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-24a4011d-2636-4e7f-ab1d-d323b539d7d2 req-5e95ac17-0c2e-4cb0-8bb8-f4f7fbdacf53 service nova] Lock "058df5ba-07ab-4bdd-9a47-907e7b0e0e59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG nova.compute.manager [req-24a4011d-2636-4e7f-ab1d-d323b539d7d2 req-5e95ac17-0c2e-4cb0-8bb8-f4f7fbdacf53 service nova] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] No waiting events found dispatching network-vif-plugged-cdfec3e6-f5dc-42e6-98a8-651f46bd37f4 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:37:48 user nova-compute[71229]: WARNING nova.compute.manager [req-24a4011d-2636-4e7f-ab1d-d323b539d7d2 req-5e95ac17-0c2e-4cb0-8bb8-f4f7fbdacf53 service nova] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Received unexpected event network-vif-plugged-cdfec3e6-f5dc-42e6-98a8-651f46bd37f4 for instance with vm_state active and task_state rescuing.
Apr 11 15:37:48 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Instance destroyed successfully.
Apr 11 15:37:48 user nova-compute[71229]: DEBUG nova.objects.instance [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lazy-loading 'resources' on Instance uuid 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:35:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1775975364',display_name='tempest-TestMinimumBasicScenario-server-1775975364',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1775975364',id=27,image_ref='eef769ca-4518-48cc-8f9b-15f43146d184',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCX38V29uKqq32pbrXcHfjwmsz6kzESDeVl6gqbOhAcULXo21SBTbxQJXUQHaV8PJeMjZRs4D5UehvHzvnc4jeUpiLPu2JFq1xh2/XZqKhiBdFrsxTD5c6W9I6S8vZoQ6A==',key_name='tempest-TestMinimumBasicScenario-1861021757',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:35:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c23461a3d7ca49f6a77d3fde6f1009d3',ramdisk_id='',reservation_id='r-20z6o102',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eef769ca-4518-48cc-8f9b-15f43146d184',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-673773229',owner_user_name='tempest-TestMinimumBasicScenario-673773229-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:37:47Z,user_data=None,user_id='044f17aee3324b3a97bebe935548b3b4',uuid=1e3d0956-d528-4097-a200-d9b2b6ce7aa8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53", "address": "fa:16:3e:3e:55:16", "network": {"id": "b1189892-ba9d-4316-9962-c737b27f14bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1737061315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c23461a3d7ca49f6a77d3fde6f1009d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19b6c9ca-9d", "ovs_interfaceid": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Converting VIF {"id": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53", "address": "fa:16:3e:3e:55:16", "network": {"id": "b1189892-ba9d-4316-9962-c737b27f14bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1737061315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c23461a3d7ca49f6a77d3fde6f1009d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19b6c9ca-9d", "ovs_interfaceid": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:55:16,bridge_name='br-int',has_traffic_filtering=True,id=19b6c9ca-9d18-4f57-9687-ce7ffde5ca53,network=Network(b1189892-ba9d-4316-9962-c737b27f14bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19b6c9ca-9d') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG os_vif [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:55:16,bridge_name='br-int',has_traffic_filtering=True,id=19b6c9ca-9d18-4f57-9687-ce7ffde5ca53,network=Network(b1189892-ba9d-4316-9962-c737b27f14bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19b6c9ca-9d') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap19b6c9ca-9d, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:48 user nova-compute[71229]: INFO os_vif [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:55:16,bridge_name='br-int',has_traffic_filtering=True,id=19b6c9ca-9d18-4f57-9687-ce7ffde5ca53,network=Network(b1189892-ba9d-4316-9962-c737b27f14bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19b6c9ca-9d')
Apr 11 15:37:48 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cvnTNDLM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:37:48 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:37:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4852bac9-207d-4264-9ab0-1644b370d162]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 15:37:48 user nova-compute[71229]: No targets found.
Apr 11 15:37:48 user nova-compute[71229]: iSNS:
Apr 11 15:37:48 user nova-compute[71229]: No targets found.
Apr 11 15:37:48 user nova-compute[71229]: STATIC:
Apr 11 15:37:48 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb
Apr 11 15:37:48 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:37:48 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:37:48 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a
Apr 11 15:37:48 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:37:48 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:37:48 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4
Apr 11 15:37:48 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:37:48 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:37:48 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68
Apr 11 15:37:48 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:37:48 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:37:48 user nova-compute[71229]: FIRMWARE:
Apr 11 15:37:48 user nova-compute[71229]: No targets found.
Apr 11 15:37:48 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 15:37:48 user nova-compute[71229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 15:37:48 user nova-compute[71229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71229) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a', 0)] {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf51595-9e09-4b7b-b684-2899b85c8aca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d7f0c6-627c-4bc3-ac57-0705296f9167]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:37:48 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:37:48 user nova-compute[71229]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 (non-flash)
Apr 11 15:37:48 user nova-compute[71229]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a (non-flash)
Apr 11 15:37:48 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:37:48 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:37:48 user nova-compute[71229]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 (non-flash)
Apr 11 15:37:48 user nova-compute[71229]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a (non-flash)
Apr 11 15:37:48 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb4c290280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a'): ({'sde'}, set())}) {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Removing single pathed devices sde {{(pid=71229) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d360f951-a03a-4315-9f19-8de0a2aeae39]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Removed pending event for 058df5ba-07ab-4bdd-9a47-907e7b0e0e59 due to event {{(pid=71229) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227468.4465623, 058df5ba-07ab-4bdd-9a47-907e7b0e0e59 => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:37:48 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] VM Resumed (Lifecycle Event)
Apr 11 15:37:48 user nova-compute[71229]: DEBUG nova.compute.manager [None req-8c417327-ce7a-4897-a8ab-3c2336aa422c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc004a7-d018-4097-9134-5e0869854c13]: (4, ('ok\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Flushing IO for device /dev/sde {{(pid=71229) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1cf48c-dec6-45ee-bd62-de6e406366a7]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71229) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:48 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 11 15:37:48 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227468.4476562, 058df5ba-07ab-4bdd-9a47-907e7b0e0e59 => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:37:48 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] VM Started (Lifecycle Event)
Apr 11 15:37:48 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6509cc-0424-4d05-9adf-d2575fb60617]: (4, ('1', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] SCSI volumes sde have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a')] {{(pid=71229) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8246bd30-20fb-4d68-abe3-f8f9323f0317]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a -p 172.16.0.220:3260 --logout {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8dd4083-5ec2-4e2b-92c5-028dac4369cf]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a, portal: 172.16.0.220,3260]
Apr 11 15:37:48 user nova-compute[71229]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a, portal: 172.16.0.220,3260] successful.
Apr 11 15:37:48 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a -p 172.16.0.220:3260 --op delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e45c51-4ead-4896-9a2a-74b3ffc8b175]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] <== disconnect_volume: return (334ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Start _get_guest_xml network_info=[{"id": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53", "address": "fa:16:3e:3e:55:16", "network": {"id": "b1189892-ba9d-4316-9962-c737b27f14bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1737061315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c23461a3d7ca49f6a77d3fde6f1009d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19b6c9ca-9d", "ovs_interfaceid": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=eef769ca-4518-48cc-8f9b-15f43146d184,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': 'eef769ca-4518-48cc-8f9b-15f43146d184'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cvnTNDLM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '1e3d0956-d528-4097-a200-d9b2b6ce7aa8', 'attached_at': '', 'detached_at': '', 'volume_id': '6119ec74-db79-4b19-9bf7-44cc8a4d853a', 'serial': '6119ec74-db79-4b19-9bf7-44cc8a4d853a'}, 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'a22edbfc-678c-40ed-902e-feaeba3cffbb', 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:37:48 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:37:48 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:37:48 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=eef769ca-4518-48cc-8f9b-15f43146d184,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG nova.objects.instance [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cvnTNDLM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:37:48 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:37:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:37:48 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:37:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:37:48 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9097f3ed-4a38-434e-a81e-336093e165b1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 15:37:48 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a -p 172.16.0.220:3260 --interface default --op new {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7391f93-2fb2-48b6-9098-5425efe4f6e0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a] added\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a] added
Apr 11 15:37:48 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[10cfcb7d-7856-428d-a153-28787bd5a4a0]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[45761517-cc0b-4845-a622-2ff355928ef7]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cvnTNDLM {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cvnTNDLM" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a1b5b1-7fe9-40db-95a8-becde1e84fff]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cvnTNDLM'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[029d8254-a276-428b-a9a5-cf186652ffdf]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a92669-5fe1-4268-8095-cd9298b5742c]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:37:48 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:37:48 user nova-compute[71229]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 (non-flash)
Apr 11 15:37:48 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:37:48 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:37:48 user nova-compute[71229]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 (non-flash)
Apr 11 15:37:48 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:37:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a -p 172.16.0.220:3260 --login {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:49 user nova-compute[71229]: DEBUG nova.compute.manager [req-c0eee073-be8b-4080-996c-09367b11e6f6 req-7738ad53-278b-479a-b609-f0ca903b980a service nova] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Received event network-vif-plugged-19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:37:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c0eee073-be8b-4080-996c-09367b11e6f6 req-7738ad53-278b-479a-b609-f0ca903b980a service nova] Acquiring lock "1e3d0956-d528-4097-a200-d9b2b6ce7aa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:37:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c0eee073-be8b-4080-996c-09367b11e6f6 req-7738ad53-278b-479a-b609-f0ca903b980a service nova] Lock "1e3d0956-d528-4097-a200-d9b2b6ce7aa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:37:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c0eee073-be8b-4080-996c-09367b11e6f6 req-7738ad53-278b-479a-b609-f0ca903b980a service nova] Lock "1e3d0956-d528-4097-a200-d9b2b6ce7aa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:37:49 user nova-compute[71229]: DEBUG nova.compute.manager [req-c0eee073-be8b-4080-996c-09367b11e6f6 req-7738ad53-278b-479a-b609-f0ca903b980a service nova] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] No waiting events found dispatching network-vif-plugged-19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:37:49 user nova-compute[71229]: WARNING nova.compute.manager [req-c0eee073-be8b-4080-996c-09367b11e6f6 req-7738ad53-278b-479a-b609-f0ca903b980a service nova] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Received unexpected event network-vif-plugged-19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 for instance with vm_state active and task_state reboot_started_hard.
Apr 11 15:37:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a -p 172.16.0.220:3260 --login" returned: 0 in 1.071s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:50 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[114f4294-fe52-4a04-8af7-3a88560872e6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a, portal: 172.16.0.220,3260]
Apr 11 15:37:50 user nova-compute[71229]: Login to [iface: default, target: iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a, portal: 172.16.0.220,3260] successful.
Apr 11 15:37:50 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:37:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:50 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bedc453-a0b2-49bb-ba47-5784da8faeae]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:37:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:50 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7de5dd-68aa-4cf7-a100-fc457aedcc05]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:37:50 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:37:50 user nova-compute[71229]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 (non-flash)
Apr 11 15:37:50 user nova-compute[71229]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a (non-flash)
Apr 11 15:37:50 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:37:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:37:50 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:37:50 user nova-compute[71229]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 (non-flash)
Apr 11 15:37:50 user nova-compute[71229]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a (non-flash)
Apr 11 15:37:50 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:37:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.303s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:37:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 15:37:50 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] HCTL ('36', '-', '-', 0) found on session 35 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 15:37:50 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 15:37:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:50 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe2416d-55c9-41f2-b123-02941956e38b]: (4, ('- - 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:50 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Searching for a device in session 35 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:37:50 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cvnTNDLM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 15:37:51 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.338s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:37:51 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] <== connect_volume: return (2340ms) {'type': 'block', 'scsi_wwn': '26565336531323639', 'path': '/dev/sde'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:37:51 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565336531323639', 'path': '/dev/sde'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 15:37:51 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:35:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1775975364',display_name='tempest-TestMinimumBasicScenario-server-1775975364',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1775975364',id=27,image_ref='eef769ca-4518-48cc-8f9b-15f43146d184',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCX38V29uKqq32pbrXcHfjwmsz6kzESDeVl6gqbOhAcULXo21SBTbxQJXUQHaV8PJeMjZRs4D5UehvHzvnc4jeUpiLPu2JFq1xh2/XZqKhiBdFrsxTD5c6W9I6S8vZoQ6A==',key_name='tempest-TestMinimumBasicScenario-1861021757',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:35:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c23461a3d7ca49f6a77d3fde6f1009d3',ramdisk_id='',reservation_id='r-20z6o102',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eef769ca-4518-48cc-8f9b-15f43146d184',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-673773229',owner_user_name='tempest-TestMinimumBasicScenario-673773229-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:37:47Z,user_data=None,user_id='044f17aee3324b3a97bebe935548b3b4',uuid=1e3d0956-d528-4097-a200-d9b2b6ce7aa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53", "address": "fa:16:3e:3e:55:16", "network": {"id": "b1189892-ba9d-4316-9962-c737b27f14bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1737061315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c23461a3d7ca49f6a77d3fde6f1009d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19b6c9ca-9d", "ovs_interfaceid": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:37:51 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Converting VIF {"id": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53", "address": "fa:16:3e:3e:55:16", "network": {"id": "b1189892-ba9d-4316-9962-c737b27f14bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1737061315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c23461a3d7ca49f6a77d3fde6f1009d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19b6c9ca-9d", "ovs_interfaceid": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:37:51 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:55:16,bridge_name='br-int',has_traffic_filtering=True,id=19b6c9ca-9d18-4f57-9687-ce7ffde5ca53,network=Network(b1189892-ba9d-4316-9962-c737b27f14bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19b6c9ca-9d') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:37:51 user nova-compute[71229]: DEBUG nova.objects.instance [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:37:51 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:37:51 user nova-compute[71229]:   <uuid>1e3d0956-d528-4097-a200-d9b2b6ce7aa8</uuid>
Apr 11 15:37:51 user nova-compute[71229]:   <name>instance-0000001b</name>
Apr 11 15:37:51 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:37:51 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:37:51 user nova-compute[71229]:   <metadata>
Apr 11 15:37:51 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:37:51 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:37:51 user nova-compute[71229]:       <nova:name>tempest-TestMinimumBasicScenario-server-1775975364</nova:name>
Apr 11 15:37:51 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:37:48</nova:creationTime>
Apr 11 15:37:51 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:37:51 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:37:51 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:37:51 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:37:51 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:37:51 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:37:51 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:37:51 user nova-compute[71229]:       <nova:owner>
Apr 11 15:37:51 user nova-compute[71229]:         <nova:user uuid="044f17aee3324b3a97bebe935548b3b4">tempest-TestMinimumBasicScenario-673773229-project-member</nova:user>
Apr 11 15:37:51 user nova-compute[71229]:         <nova:project uuid="c23461a3d7ca49f6a77d3fde6f1009d3">tempest-TestMinimumBasicScenario-673773229</nova:project>
Apr 11 15:37:51 user nova-compute[71229]:       </nova:owner>
Apr 11 15:37:51 user nova-compute[71229]:       <nova:root type="image" uuid="eef769ca-4518-48cc-8f9b-15f43146d184"/>
Apr 11 15:37:51 user nova-compute[71229]:       <nova:ports>
Apr 11 15:37:51 user nova-compute[71229]:         <nova:port uuid="19b6c9ca-9d18-4f57-9687-ce7ffde5ca53">
Apr 11 15:37:51 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 11 15:37:51 user nova-compute[71229]:         </nova:port>
Apr 11 15:37:51 user nova-compute[71229]:       </nova:ports>
Apr 11 15:37:51 user nova-compute[71229]:     </nova:instance>
Apr 11 15:37:51 user nova-compute[71229]:   </metadata>
Apr 11 15:37:51 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:37:51 user nova-compute[71229]:     <system>
Apr 11 15:37:51 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:37:51 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:37:51 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:37:51 user nova-compute[71229]:       <entry name="serial">1e3d0956-d528-4097-a200-d9b2b6ce7aa8</entry>
Apr 11 15:37:51 user nova-compute[71229]:       <entry name="uuid">1e3d0956-d528-4097-a200-d9b2b6ce7aa8</entry>
Apr 11 15:37:51 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:37:51 user nova-compute[71229]:     </system>
Apr 11 15:37:51 user nova-compute[71229]:   </sysinfo>
Apr 11 15:37:51 user nova-compute[71229]:   <os>
Apr 11 15:37:51 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:37:51 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 15:37:51 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:37:51 user nova-compute[71229]:   </os>
Apr 11 15:37:51 user nova-compute[71229]:   <features>
Apr 11 15:37:51 user nova-compute[71229]:     <acpi/>
Apr 11 15:37:51 user nova-compute[71229]:     <apic/>
Apr 11 15:37:51 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:37:51 user nova-compute[71229]:   </features>
Apr 11 15:37:51 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:37:51 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:37:51 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:37:51 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:37:51 user nova-compute[71229]:   </clock>
Apr 11 15:37:51 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:37:51 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:37:51 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:37:51 user nova-compute[71229]:   </cpu>
Apr 11 15:37:51 user nova-compute[71229]:   <devices>
Apr 11 15:37:51 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 15:37:51 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 15:37:51 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/disk"/>
Apr 11 15:37:51 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:37:51 user nova-compute[71229]:     </disk>
Apr 11 15:37:51 user nova-compute[71229]:     <disk type="block" device="disk">
Apr 11 15:37:51 user nova-compute[71229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:37:51 user nova-compute[71229]:       <source dev="/dev/sde"/>
Apr 11 15:37:51 user nova-compute[71229]:       <target dev="vdb" bus="virtio"/>
Apr 11 15:37:51 user nova-compute[71229]:       <serial>6119ec74-db79-4b19-9bf7-44cc8a4d853a</serial>
Apr 11 15:37:51 user nova-compute[71229]:     </disk>
Apr 11 15:37:51 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:37:51 user nova-compute[71229]:       <mac address="fa:16:3e:3e:55:16"/>
Apr 11 15:37:51 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:37:51 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:37:51 user nova-compute[71229]:       <target dev="tap19b6c9ca-9d"/>
Apr 11 15:37:51 user nova-compute[71229]:     </interface>
Apr 11 15:37:51 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:37:51 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/console.log" append="off"/>
Apr 11 15:37:51 user nova-compute[71229]:     </serial>
Apr 11 15:37:51 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:37:51 user nova-compute[71229]:     <video>
Apr 11 15:37:51 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:37:51 user nova-compute[71229]:     </video>
Apr 11 15:37:51 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:37:51 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:37:51 user nova-compute[71229]:     </rng>
Apr 11 15:37:51 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:37:51 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:37:51 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:37:51 user nova-compute[71229]:     </memballoon>
Apr 11 15:37:51 user nova-compute[71229]:   </devices>
Apr 11 15:37:51 user nova-compute[71229]: </domain>
Apr 11 15:37:51 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:37:51 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:51 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:51 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:51 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:51 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:37:51 user nova-compute[71229]: DEBUG nova.objects.instance [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:37:51 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4a2efe8715353e8e729f83cecfb97b8f359c98b --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:51 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4a2efe8715353e8e729f83cecfb97b8f359c98b --force-share --output=json" returned: 0 in 0.138s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:51 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/disk. size=1073741824 {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 15:37:51 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:51 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:51 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Cannot resize image /opt/stack/data/nova/instances/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/disk to a smaller size. {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 15:37:51 user nova-compute[71229]: DEBUG nova.objects.instance [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lazy-loading 'migration_context' on Instance uuid 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:37:51 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:35:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1775975364',display_name='tempest-TestMinimumBasicScenario-server-1775975364',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1775975364',id=27,image_ref='eef769ca-4518-48cc-8f9b-15f43146d184',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCX38V29uKqq32pbrXcHfjwmsz6kzESDeVl6gqbOhAcULXo21SBTbxQJXUQHaV8PJeMjZRs4D5UehvHzvnc4jeUpiLPu2JFq1xh2/XZqKhiBdFrsxTD5c6W9I6S8vZoQ6A==',key_name='tempest-TestMinimumBasicScenario-1861021757',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:35:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='c23461a3d7ca49f6a77d3fde6f1009d3',ramdisk_id='',reservation_id='r-20z6o102',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eef769ca-4518-48cc-8f9b-15f43146d184',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-673773229',owner_user_name='tempest-TestMinimumBasicScenario-673773229-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:37:47Z,user_data=None,user_id='044f17aee3324b3a97bebe935548b3b4',uuid=1e3d0956-d528-4097-a200-d9b2b6ce7aa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53", "address": "fa:16:3e:3e:55:16", "network": {"id": "b1189892-ba9d-4316-9962-c737b27f14bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1737061315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c23461a3d7ca49f6a77d3fde6f1009d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19b6c9ca-9d", "ovs_interfaceid": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:37:51 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Converting VIF {"id": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53", "address": "fa:16:3e:3e:55:16", "network": {"id": "b1189892-ba9d-4316-9962-c737b27f14bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1737061315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c23461a3d7ca49f6a77d3fde6f1009d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19b6c9ca-9d", "ovs_interfaceid": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:37:51 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:55:16,bridge_name='br-int',has_traffic_filtering=True,id=19b6c9ca-9d18-4f57-9687-ce7ffde5ca53,network=Network(b1189892-ba9d-4316-9962-c737b27f14bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19b6c9ca-9d') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:37:51 user nova-compute[71229]: DEBUG os_vif [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:55:16,bridge_name='br-int',has_traffic_filtering=True,id=19b6c9ca-9d18-4f57-9687-ce7ffde5ca53,network=Network(b1189892-ba9d-4316-9962-c737b27f14bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19b6c9ca-9d') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:37:51 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:51 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:37:51 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:37:51 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:51 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap19b6c9ca-9d, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:37:51 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap19b6c9ca-9d, col_values=(('external_ids', {'iface-id': '19b6c9ca-9d18-4f57-9687-ce7ffde5ca53', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:55:16', 'vm-uuid': '1e3d0956-d528-4097-a200-d9b2b6ce7aa8'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:37:51 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:51 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:37:51 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:51 user nova-compute[71229]: INFO os_vif [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:55:16,bridge_name='br-int',has_traffic_filtering=True,id=19b6c9ca-9d18-4f57-9687-ce7ffde5ca53,network=Network(b1189892-ba9d-4316-9962-c737b27f14bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19b6c9ca-9d')
Apr 11 15:37:52 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:53 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:53 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:53 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:53 user nova-compute[71229]: DEBUG nova.compute.manager [req-d5a4930f-8345-42e4-9c0c-afe3894ccd43 req-291fe1ed-0058-4172-b8b1-89a8c4c72ef1 service nova] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Received event network-vif-plugged-19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:37:53 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-d5a4930f-8345-42e4-9c0c-afe3894ccd43 req-291fe1ed-0058-4172-b8b1-89a8c4c72ef1 service nova] Acquiring lock "1e3d0956-d528-4097-a200-d9b2b6ce7aa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:37:53 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-d5a4930f-8345-42e4-9c0c-afe3894ccd43 req-291fe1ed-0058-4172-b8b1-89a8c4c72ef1 service nova] Lock "1e3d0956-d528-4097-a200-d9b2b6ce7aa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:37:53 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-d5a4930f-8345-42e4-9c0c-afe3894ccd43 req-291fe1ed-0058-4172-b8b1-89a8c4c72ef1 service nova] Lock "1e3d0956-d528-4097-a200-d9b2b6ce7aa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:37:53 user nova-compute[71229]: DEBUG nova.compute.manager [req-d5a4930f-8345-42e4-9c0c-afe3894ccd43 req-291fe1ed-0058-4172-b8b1-89a8c4c72ef1 service nova] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] No waiting events found dispatching network-vif-plugged-19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:37:53 user nova-compute[71229]: WARNING nova.compute.manager [req-d5a4930f-8345-42e4-9c0c-afe3894ccd43 req-291fe1ed-0058-4172-b8b1-89a8c4c72ef1 service nova] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Received unexpected event network-vif-plugged-19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 for instance with vm_state active and task_state reboot_started_hard.
Apr 11 15:37:53 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:53 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:53 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:53 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:37:53 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:53 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Triggering sync for uuid de1a45fd-27be-4438-80a4-2f3a100643c9 {{(pid=71229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 15:37:53 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Triggering sync for uuid b0d90fd2-6a95-43c4-8756-e82071d99154 {{(pid=71229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 15:37:53 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Triggering sync for uuid 7c4329ae-07cb-4f28-9fd6-29b398517d2b {{(pid=71229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 15:37:53 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Triggering sync for uuid 85658a44-9ff2-4553-b9fd-686bf35fd6ec {{(pid=71229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 15:37:53 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Triggering sync for uuid d09cda86-eca1-4c42-8654-758eb6cd30e0 {{(pid=71229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 15:37:54 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Triggering sync for uuid dcbfcbfd-7e96-4271-94ee-60ef937e3b7e {{(pid=71229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 15:37:54 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Triggering sync for uuid 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 {{(pid=71229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 15:37:54 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Triggering sync for uuid 6f6ae64a-c760-4ba3-8a50-d380835d9913 {{(pid=71229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 15:37:54 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Triggering sync for uuid 058df5ba-07ab-4bdd-9a47-907e7b0e0e59 {{(pid=71229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 15:37:54 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Triggering sync for uuid ffce2921-d4a5-4bcb-8032-62a6dc321fb4 {{(pid=71229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 15:37:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "de1a45fd-27be-4438-80a4-2f3a100643c9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:37:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "de1a45fd-27be-4438-80a4-2f3a100643c9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:37:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "b0d90fd2-6a95-43c4-8756-e82071d99154" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:37:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "b0d90fd2-6a95-43c4-8756-e82071d99154" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:37:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "7c4329ae-07cb-4f28-9fd6-29b398517d2b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:37:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "7c4329ae-07cb-4f28-9fd6-29b398517d2b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:37:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "85658a44-9ff2-4553-b9fd-686bf35fd6ec" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:37:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "85658a44-9ff2-4553-b9fd-686bf35fd6ec" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:37:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "d09cda86-eca1-4c42-8654-758eb6cd30e0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:37:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "d09cda86-eca1-4c42-8654-758eb6cd30e0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:37:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "dcbfcbfd-7e96-4271-94ee-60ef937e3b7e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:37:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "dcbfcbfd-7e96-4271-94ee-60ef937e3b7e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:37:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "1e3d0956-d528-4097-a200-d9b2b6ce7aa8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:37:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "6f6ae64a-c760-4ba3-8a50-d380835d9913" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:37:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "6f6ae64a-c760-4ba3-8a50-d380835d9913" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:37:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "058df5ba-07ab-4bdd-9a47-907e7b0e0e59" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:37:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "058df5ba-07ab-4bdd-9a47-907e7b0e0e59" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:37:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "ffce2921-d4a5-4bcb-8032-62a6dc321fb4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:37:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "ffce2921-d4a5-4bcb-8032-62a6dc321fb4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:37:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "de1a45fd-27be-4438-80a4-2f3a100643c9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:37:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "7c4329ae-07cb-4f28-9fd6-29b398517d2b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:37:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "b0d90fd2-6a95-43c4-8756-e82071d99154" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:37:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "dcbfcbfd-7e96-4271-94ee-60ef937e3b7e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:37:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "85658a44-9ff2-4553-b9fd-686bf35fd6ec" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:37:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "6f6ae64a-c760-4ba3-8a50-d380835d9913" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:37:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "d09cda86-eca1-4c42-8654-758eb6cd30e0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:37:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "ffce2921-d4a5-4bcb-8032-62a6dc321fb4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:37:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "058df5ba-07ab-4bdd-9a47-907e7b0e0e59" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:37:55 user nova-compute[71229]: DEBUG nova.compute.manager [req-194cfd06-ef0d-47f6-9a3a-f56ec0a262f2 req-3a6c09fc-ecc8-4286-9be6-c359ed87ed7b service nova] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Received event network-vif-plugged-19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:37:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-194cfd06-ef0d-47f6-9a3a-f56ec0a262f2 req-3a6c09fc-ecc8-4286-9be6-c359ed87ed7b service nova] Acquiring lock "1e3d0956-d528-4097-a200-d9b2b6ce7aa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:37:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-194cfd06-ef0d-47f6-9a3a-f56ec0a262f2 req-3a6c09fc-ecc8-4286-9be6-c359ed87ed7b service nova] Lock "1e3d0956-d528-4097-a200-d9b2b6ce7aa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:37:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-194cfd06-ef0d-47f6-9a3a-f56ec0a262f2 req-3a6c09fc-ecc8-4286-9be6-c359ed87ed7b service nova] Lock "1e3d0956-d528-4097-a200-d9b2b6ce7aa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:37:55 user nova-compute[71229]: DEBUG nova.compute.manager [req-194cfd06-ef0d-47f6-9a3a-f56ec0a262f2 req-3a6c09fc-ecc8-4286-9be6-c359ed87ed7b service nova] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] No waiting events found dispatching network-vif-plugged-19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:37:55 user nova-compute[71229]: WARNING nova.compute.manager [req-194cfd06-ef0d-47f6-9a3a-f56ec0a262f2 req-3a6c09fc-ecc8-4286-9be6-c359ed87ed7b service nova] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Received unexpected event network-vif-plugged-19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 for instance with vm_state active and task_state reboot_started_hard.
Apr 11 15:37:55 user nova-compute[71229]: DEBUG nova.compute.manager [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 15:37:55 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Removed pending event for 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 due to event {{(pid=71229) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 15:37:55 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227475.5328364, 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:37:55 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] VM Resumed (Lifecycle Event)
Apr 11 15:37:55 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Instance rebooted successfully.
Apr 11 15:37:55 user nova-compute[71229]: DEBUG nova.compute.manager [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:37:55 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:37:55 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:37:55 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Apr 11 15:37:55 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227475.5332685, 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:37:55 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] VM Started (Lifecycle Event)
Apr 11 15:37:55 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:37:55 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:37:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f84db0cb-445f-4c26-88e4-0217c62a8177 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "1e3d0956-d528-4097-a200-d9b2b6ce7aa8" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.819s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:37:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "1e3d0956-d528-4097-a200-d9b2b6ce7aa8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.671s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:37:55 user nova-compute[71229]: INFO nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Apr 11 15:37:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "1e3d0956-d528-4097-a200-d9b2b6ce7aa8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:37:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:57 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "d09cda86-eca1-4c42-8654-758eb6cd30e0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:37:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "d09cda86-eca1-4c42-8654-758eb6cd30e0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:37:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "d09cda86-eca1-4c42-8654-758eb6cd30e0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:37:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "d09cda86-eca1-4c42-8654-758eb6cd30e0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:37:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "d09cda86-eca1-4c42-8654-758eb6cd30e0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:37:58 user nova-compute[71229]: INFO nova.compute.manager [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Terminating instance
Apr 11 15:37:58 user nova-compute[71229]: DEBUG nova.compute.manager [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Start destroying the instance on the hypervisor. {{(pid=71229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 15:37:59 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:59 user nova-compute[71229]: DEBUG nova.compute.manager [req-4457b64c-6bed-4f7a-b3c9-2bcfa1f004c0 req-43f5db9a-756d-49c2-a87e-90e9bda32ff3 service nova] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Received event network-vif-unplugged-27d62f09-c938-4a71-be1e-6dc1d6a47382 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:37:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4457b64c-6bed-4f7a-b3c9-2bcfa1f004c0 req-43f5db9a-756d-49c2-a87e-90e9bda32ff3 service nova] Acquiring lock "d09cda86-eca1-4c42-8654-758eb6cd30e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:37:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4457b64c-6bed-4f7a-b3c9-2bcfa1f004c0 req-43f5db9a-756d-49c2-a87e-90e9bda32ff3 service nova] Lock "d09cda86-eca1-4c42-8654-758eb6cd30e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:37:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4457b64c-6bed-4f7a-b3c9-2bcfa1f004c0 req-43f5db9a-756d-49c2-a87e-90e9bda32ff3 service nova] Lock "d09cda86-eca1-4c42-8654-758eb6cd30e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:37:59 user nova-compute[71229]: DEBUG nova.compute.manager [req-4457b64c-6bed-4f7a-b3c9-2bcfa1f004c0 req-43f5db9a-756d-49c2-a87e-90e9bda32ff3 service nova] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] No waiting events found dispatching network-vif-unplugged-27d62f09-c938-4a71-be1e-6dc1d6a47382 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:37:59 user nova-compute[71229]: DEBUG nova.compute.manager [req-4457b64c-6bed-4f7a-b3c9-2bcfa1f004c0 req-43f5db9a-756d-49c2-a87e-90e9bda32ff3 service nova] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Received event network-vif-unplugged-27d62f09-c938-4a71-be1e-6dc1d6a47382 for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 15:37:59 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:59 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:59 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:59 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:59 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:59 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:59 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Instance destroyed successfully.
Apr 11 15:37:59 user nova-compute[71229]: DEBUG nova.objects.instance [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lazy-loading 'resources' on Instance uuid d09cda86-eca1-4c42-8654-758eb6cd30e0 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:37:59 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:59 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:32:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-315252386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-315252386',id=23,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:34:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ddc05e9bf5ab426982ccb3092ad596e4',ramdisk_id='',reservation_id='r-x2r0o2x4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1907753459',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:36:13Z,user_data=None,user_id='1d60ce27bfad4d7c9b976e834df35ad4',uuid=d09cda86-eca1-4c42-8654-758eb6cd30e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27d62f09-c938-4a71-be1e-6dc1d6a47382", "address": "fa:16:3e:53:ab:3d", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d62f09-c9", "ovs_interfaceid": "27d62f09-c938-4a71-be1e-6dc1d6a47382", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:37:59 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Converting VIF {"id": "27d62f09-c938-4a71-be1e-6dc1d6a47382", "address": "fa:16:3e:53:ab:3d", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d62f09-c9", "ovs_interfaceid": "27d62f09-c938-4a71-be1e-6dc1d6a47382", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:37:59 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:ab:3d,bridge_name='br-int',has_traffic_filtering=True,id=27d62f09-c938-4a71-be1e-6dc1d6a47382,network=Network(1cf4cec3-ff08-4320-89e4-aa7e8cf75eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27d62f09-c9') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:37:59 user nova-compute[71229]: DEBUG os_vif [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:ab:3d,bridge_name='br-int',has_traffic_filtering=True,id=27d62f09-c938-4a71-be1e-6dc1d6a47382,network=Network(1cf4cec3-ff08-4320-89e4-aa7e8cf75eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27d62f09-c9') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:37:59 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:37:59 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27d62f09-c9, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:37:59 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:37:59 user nova-compute[71229]: INFO os_vif [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:ab:3d,bridge_name='br-int',has_traffic_filtering=True,id=27d62f09-c938-4a71-be1e-6dc1d6a47382,network=Network(1cf4cec3-ff08-4320-89e4-aa7e8cf75eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27d62f09-c9')
Apr 11 15:37:59 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 15:37:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kDmHLYlZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:37:59 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:37:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:37:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:37:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:59 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12aad55-e4fe-4ece-8c6e-d53ed964e3a3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 15:37:59 user nova-compute[71229]: No targets found.
Apr 11 15:37:59 user nova-compute[71229]: iSNS:
Apr 11 15:37:59 user nova-compute[71229]: No targets found.
Apr 11 15:37:59 user nova-compute[71229]: STATIC:
Apr 11 15:37:59 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb
Apr 11 15:37:59 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:37:59 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:37:59 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a
Apr 11 15:37:59 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:37:59 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:37:59 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4
Apr 11 15:37:59 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:37:59 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:37:59 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68
Apr 11 15:37:59 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:37:59 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:37:59 user nova-compute[71229]: FIRMWARE:
Apr 11 15:37:59 user nova-compute[71229]: No targets found.
Apr 11 15:37:59 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:37:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 15:37:59 user nova-compute[71229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 15:37:59 user nova-compute[71229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71229) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 15:37:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4', 0)] {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 15:37:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:59 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09eee00-b354-4a35-a9ea-f84252f1ba7a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:37:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:37:59 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a20344-4b01-4843-95c6-2686ffa05ea3]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:37:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:37:59 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:37:59 user nova-compute[71229]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 (non-flash)
Apr 11 15:37:59 user nova-compute[71229]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a (non-flash)
Apr 11 15:37:59 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:37:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:37:59 user nova-compute[71229]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 (non-flash)
Apr 11 15:37:59 user nova-compute[71229]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 (non-flash)
Apr 11 15:37:59 user nova-compute[71229]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a (non-flash)
Apr 11 15:37:59 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:37:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb67554a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4'): ({'sdd'}, set())}) {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 15:37:59 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Removing single pathed devices sdd {{(pid=71229) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 15:37:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:38:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:38:00 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65ee425-6e70-4f44-a014-c03ddb8d9b96]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:38:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:38:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:38:00 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd9f2de-ce6e-42eb-bc64-6b79d5fc7012]: (4, ('ok\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:38:00 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Flushing IO for device /dev/sdd {{(pid=71229) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 15:38:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:38:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:38:00 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e63a01-3c97-4814-bbed-7846dc95be44]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:38:00 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71229) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 15:38:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:38:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:38:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:38:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.062s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:38:00 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3e4d0e-4cf2-4d40-8d48-d167cc404e75]: (4, ('1', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:38:00 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 15:38:00 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] SCSI volumes sdd have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 15:38:00 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4')] {{(pid=71229) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 15:38:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:38:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:38:00 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bd4c31-cb5e-4789-91f4-1d3d115d4275]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:38:00 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:38:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 -p 172.16.0.220:3260 --logout {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:38:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:38:00 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a263e5d-c58b-4da9-aef3-30fe05bdde3f]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:38:00 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4, portal: 172.16.0.220,3260]
Apr 11 15:38:00 user nova-compute[71229]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4, portal: 172.16.0.220,3260] successful.
Apr 11 15:38:00 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:38:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 -p 172.16.0.220:3260 --op delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:38:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9ef701f-85e1-4a0a-84e9-73468c0792c4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:38:00 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6de515-d90b-4633-8d55-9637ffe7ad11]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:38:00 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:38:00 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:38:00 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] <== disconnect_volume: return (363ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:38:00 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 15:38:00 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Deleting instance files /opt/stack/data/nova/instances/d09cda86-eca1-4c42-8654-758eb6cd30e0_del
Apr 11 15:38:00 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Deletion of /opt/stack/data/nova/instances/d09cda86-eca1-4c42-8654-758eb6cd30e0_del complete
Apr 11 15:38:00 user nova-compute[71229]: INFO nova.compute.manager [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Took 1.37 seconds to destroy the instance on the hypervisor.
Apr 11 15:38:00 user nova-compute[71229]: DEBUG oslo.service.loopingcall [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71229) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 15:38:00 user nova-compute[71229]: DEBUG nova.compute.manager [-] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Deallocating network for instance {{(pid=71229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 15:38:00 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] deallocate_for_instance() {{(pid=71229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 15:38:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:38:01 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:38:01 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Took 0.83 seconds to deallocate network for instance.
Apr 11 15:38:01 user nova-compute[71229]: DEBUG nova.compute.manager [req-c2cb1456-0cab-41b2-addb-b2f96f02fb1b req-9f6fdb82-926d-4100-8dfb-a99d1fce84c8 service nova] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Received event network-vif-plugged-27d62f09-c938-4a71-be1e-6dc1d6a47382 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:38:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c2cb1456-0cab-41b2-addb-b2f96f02fb1b req-9f6fdb82-926d-4100-8dfb-a99d1fce84c8 service nova] Acquiring lock "d09cda86-eca1-4c42-8654-758eb6cd30e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:38:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c2cb1456-0cab-41b2-addb-b2f96f02fb1b req-9f6fdb82-926d-4100-8dfb-a99d1fce84c8 service nova] Lock "d09cda86-eca1-4c42-8654-758eb6cd30e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:38:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c2cb1456-0cab-41b2-addb-b2f96f02fb1b req-9f6fdb82-926d-4100-8dfb-a99d1fce84c8 service nova] Lock "d09cda86-eca1-4c42-8654-758eb6cd30e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:38:01 user nova-compute[71229]: DEBUG nova.compute.manager [req-c2cb1456-0cab-41b2-addb-b2f96f02fb1b req-9f6fdb82-926d-4100-8dfb-a99d1fce84c8 service nova] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] No waiting events found dispatching network-vif-plugged-27d62f09-c938-4a71-be1e-6dc1d6a47382 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:38:01 user nova-compute[71229]: WARNING nova.compute.manager [req-c2cb1456-0cab-41b2-addb-b2f96f02fb1b req-9f6fdb82-926d-4100-8dfb-a99d1fce84c8 service nova] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Received unexpected event network-vif-plugged-27d62f09-c938-4a71-be1e-6dc1d6a47382 for instance with vm_state active and task_state deleting.
Apr 11 15:38:01 user nova-compute[71229]: DEBUG nova.compute.manager [req-c2cb1456-0cab-41b2-addb-b2f96f02fb1b req-9f6fdb82-926d-4100-8dfb-a99d1fce84c8 service nova] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Received event network-vif-plugged-27d62f09-c938-4a71-be1e-6dc1d6a47382 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:38:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c2cb1456-0cab-41b2-addb-b2f96f02fb1b req-9f6fdb82-926d-4100-8dfb-a99d1fce84c8 service nova] Acquiring lock "d09cda86-eca1-4c42-8654-758eb6cd30e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:38:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c2cb1456-0cab-41b2-addb-b2f96f02fb1b req-9f6fdb82-926d-4100-8dfb-a99d1fce84c8 service nova] Lock "d09cda86-eca1-4c42-8654-758eb6cd30e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:38:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c2cb1456-0cab-41b2-addb-b2f96f02fb1b req-9f6fdb82-926d-4100-8dfb-a99d1fce84c8 service nova] Lock "d09cda86-eca1-4c42-8654-758eb6cd30e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:38:01 user nova-compute[71229]: DEBUG nova.compute.manager [req-c2cb1456-0cab-41b2-addb-b2f96f02fb1b req-9f6fdb82-926d-4100-8dfb-a99d1fce84c8 service nova] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] No waiting events found dispatching network-vif-plugged-27d62f09-c938-4a71-be1e-6dc1d6a47382 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:38:01 user nova-compute[71229]: WARNING nova.compute.manager [req-c2cb1456-0cab-41b2-addb-b2f96f02fb1b req-9f6fdb82-926d-4100-8dfb-a99d1fce84c8 service nova] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Received unexpected event network-vif-plugged-27d62f09-c938-4a71-be1e-6dc1d6a47382 for instance with vm_state active and task_state deleting.
Apr 11 15:38:01 user nova-compute[71229]: DEBUG nova.compute.manager [req-c2cb1456-0cab-41b2-addb-b2f96f02fb1b req-9f6fdb82-926d-4100-8dfb-a99d1fce84c8 service nova] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Received event network-vif-plugged-27d62f09-c938-4a71-be1e-6dc1d6a47382 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:38:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c2cb1456-0cab-41b2-addb-b2f96f02fb1b req-9f6fdb82-926d-4100-8dfb-a99d1fce84c8 service nova] Acquiring lock "d09cda86-eca1-4c42-8654-758eb6cd30e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:38:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c2cb1456-0cab-41b2-addb-b2f96f02fb1b req-9f6fdb82-926d-4100-8dfb-a99d1fce84c8 service nova] Lock "d09cda86-eca1-4c42-8654-758eb6cd30e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:38:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c2cb1456-0cab-41b2-addb-b2f96f02fb1b req-9f6fdb82-926d-4100-8dfb-a99d1fce84c8 service nova] Lock "d09cda86-eca1-4c42-8654-758eb6cd30e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:38:01 user nova-compute[71229]: DEBUG nova.compute.manager [req-c2cb1456-0cab-41b2-addb-b2f96f02fb1b req-9f6fdb82-926d-4100-8dfb-a99d1fce84c8 service nova] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] No waiting events found dispatching network-vif-plugged-27d62f09-c938-4a71-be1e-6dc1d6a47382 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:38:01 user nova-compute[71229]: WARNING nova.compute.manager [req-c2cb1456-0cab-41b2-addb-b2f96f02fb1b req-9f6fdb82-926d-4100-8dfb-a99d1fce84c8 service nova] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Received unexpected event network-vif-plugged-27d62f09-c938-4a71-be1e-6dc1d6a47382 for instance with vm_state active and task_state deleting.
Apr 11 15:38:01 user nova-compute[71229]: DEBUG nova.compute.manager [req-c2cb1456-0cab-41b2-addb-b2f96f02fb1b req-9f6fdb82-926d-4100-8dfb-a99d1fce84c8 service nova] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Received event network-vif-plugged-27d62f09-c938-4a71-be1e-6dc1d6a47382 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:38:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c2cb1456-0cab-41b2-addb-b2f96f02fb1b req-9f6fdb82-926d-4100-8dfb-a99d1fce84c8 service nova] Acquiring lock "d09cda86-eca1-4c42-8654-758eb6cd30e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:38:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c2cb1456-0cab-41b2-addb-b2f96f02fb1b req-9f6fdb82-926d-4100-8dfb-a99d1fce84c8 service nova] Lock "d09cda86-eca1-4c42-8654-758eb6cd30e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:38:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c2cb1456-0cab-41b2-addb-b2f96f02fb1b req-9f6fdb82-926d-4100-8dfb-a99d1fce84c8 service nova] Lock "d09cda86-eca1-4c42-8654-758eb6cd30e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:38:01 user nova-compute[71229]: DEBUG nova.compute.manager [req-c2cb1456-0cab-41b2-addb-b2f96f02fb1b req-9f6fdb82-926d-4100-8dfb-a99d1fce84c8 service nova] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] No waiting events found dispatching network-vif-plugged-27d62f09-c938-4a71-be1e-6dc1d6a47382 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:38:01 user nova-compute[71229]: WARNING nova.compute.manager [req-c2cb1456-0cab-41b2-addb-b2f96f02fb1b req-9f6fdb82-926d-4100-8dfb-a99d1fce84c8 service nova] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Received unexpected event network-vif-plugged-27d62f09-c938-4a71-be1e-6dc1d6a47382 for instance with vm_state active and task_state deleting.
Apr 11 15:38:01 user nova-compute[71229]: DEBUG nova.compute.manager [req-c2cb1456-0cab-41b2-addb-b2f96f02fb1b req-9f6fdb82-926d-4100-8dfb-a99d1fce84c8 service nova] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Received event network-vif-deleted-27d62f09-c938-4a71-be1e-6dc1d6a47382 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:38:01 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:38:01 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 15:38:02 user nova-compute[71229]: INFO nova.compute.manager [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Took 0.83 seconds to detach 1 volumes for instance.
Apr 11 15:38:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:38:02 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:38:02 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:38:02 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Refreshing inventories for resource provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 15:38:02 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Updating ProviderTree inventory for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 15:38:02 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Updating inventory in ProviderTree for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 15:38:02 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Refreshing aggregate associations for resource provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de, aggregates: None {{(pid=71229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 15:38:02 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Refreshing trait associations for resource provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de, traits: COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=71229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 15:38:02 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:38:02 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:38:02 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.481s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:38:02 user nova-compute[71229]: INFO nova.scheduler.client.report [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Deleted allocations for instance d09cda86-eca1-4c42-8654-758eb6cd30e0
Apr 11 15:38:02 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ed6ed0a8-bb10-4008-b944-301de1986a11 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "d09cda86-eca1-4c42-8654-758eb6cd30e0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.695s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:38:03 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:38:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:38:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:38:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:38:03 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 15:38:03 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:38:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:38:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:38:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:38:04 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:38:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:38:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:38:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:38:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:38:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:38:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:38:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:38:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:38:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:38:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:38:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:38:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:38:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:38:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85658a44-9ff2-4553-b9fd-686bf35fd6ec/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:38:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85658a44-9ff2-4553-b9fd-686bf35fd6ec/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:38:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85658a44-9ff2-4553-b9fd-686bf35fd6ec/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:38:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85658a44-9ff2-4553-b9fd-686bf35fd6ec/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:38:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:38:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:38:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:38:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:38:05 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:38:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:38:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:38:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:38:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:38:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:38:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:38:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:38:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:38:06 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:38:06 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:38:06 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:38:06 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=7993MB free_disk=25.777076721191406GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 15:38:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:38:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:38:06 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance de1a45fd-27be-4438-80a4-2f3a100643c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:38:06 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance b0d90fd2-6a95-43c4-8756-e82071d99154 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:38:06 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 7c4329ae-07cb-4f28-9fd6-29b398517d2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:38:06 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 85658a44-9ff2-4553-b9fd-686bf35fd6ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:38:06 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance dcbfcbfd-7e96-4271-94ee-60ef937e3b7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:38:06 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:38:06 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 6f6ae64a-c760-4ba3-8a50-d380835d9913 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:38:06 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 058df5ba-07ab-4bdd-9a47-907e7b0e0e59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:38:06 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance ffce2921-d4a5-4bcb-8032-62a6dc321fb4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:38:06 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 15:38:06 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 15:38:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:38:07 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:38:07 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:38:07 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 15:38:07 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.447s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:38:08 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:38:08 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:38:08 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 15:38:08 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Rebuilding the list of instances to heal {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 15:38:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "refresh_cache-de1a45fd-27be-4438-80a4-2f3a100643c9" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:38:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquired lock "refresh_cache-de1a45fd-27be-4438-80a4-2f3a100643c9" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:38:08 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Forcefully refreshing network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 15:38:08 user nova-compute[71229]: DEBUG nova.objects.instance [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lazy-loading 'info_cache' on Instance uuid de1a45fd-27be-4438-80a4-2f3a100643c9 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:38:08 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Updating instance_info_cache with network_info: [{"id": "197ae974-459a-49ab-9d70-89bfaa073f50", "address": "fa:16:3e:03:bb:91", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ae974-45", "ovs_interfaceid": "197ae974-459a-49ab-9d70-89bfaa073f50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:38:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Releasing lock "refresh_cache-de1a45fd-27be-4438-80a4-2f3a100643c9" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:38:08 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Updated the network info_cache for instance {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 15:38:08 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:38:08 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:38:08 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:38:08 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:38:08 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:38:09 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:38:12 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:38:14 user nova-compute[71229]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681227479.8291092, d09cda86-eca1-4c42-8654-758eb6cd30e0 => Stopped> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:38:14 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] VM Stopped (Lifecycle Event)
Apr 11 15:38:14 user nova-compute[71229]: DEBUG nova.compute.manager [None req-876f7f79-e0a5-4a84-9535-a7df8eb9cc10 None None] [instance: d09cda86-eca1-4c42-8654-758eb6cd30e0] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:38:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:38:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:38:18 user nova-compute[71229]: DEBUG nova.compute.manager [req-8bef57d3-7cde-45f1-ada2-a6e77dc91965 req-0a6c9d63-f9fa-4bbf-845b-2f292e71a154 service nova] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Received event network-changed-c6826c01-eadd-49db-a842-accd25f7534a {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:38:18 user nova-compute[71229]: DEBUG nova.compute.manager [req-8bef57d3-7cde-45f1-ada2-a6e77dc91965 req-0a6c9d63-f9fa-4bbf-845b-2f292e71a154 service nova] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Refreshing instance network info cache due to event network-changed-c6826c01-eadd-49db-a842-accd25f7534a. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:38:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-8bef57d3-7cde-45f1-ada2-a6e77dc91965 req-0a6c9d63-f9fa-4bbf-845b-2f292e71a154 service nova] Acquiring lock "refresh_cache-85658a44-9ff2-4553-b9fd-686bf35fd6ec" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:38:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-8bef57d3-7cde-45f1-ada2-a6e77dc91965 req-0a6c9d63-f9fa-4bbf-845b-2f292e71a154 service nova] Acquired lock "refresh_cache-85658a44-9ff2-4553-b9fd-686bf35fd6ec" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:38:18 user nova-compute[71229]: DEBUG nova.network.neutron [req-8bef57d3-7cde-45f1-ada2-a6e77dc91965 req-0a6c9d63-f9fa-4bbf-845b-2f292e71a154 service nova] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Refreshing network info cache for port c6826c01-eadd-49db-a842-accd25f7534a {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:38:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-2f33d7ae-c92d-48be-9cf8-74ad326388c2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "85658a44-9ff2-4553-b9fd-686bf35fd6ec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:38:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-2f33d7ae-c92d-48be-9cf8-74ad326388c2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "85658a44-9ff2-4553-b9fd-686bf35fd6ec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:38:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-2f33d7ae-c92d-48be-9cf8-74ad326388c2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "85658a44-9ff2-4553-b9fd-686bf35fd6ec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:38:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-2f33d7ae-c92d-48be-9cf8-74ad326388c2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "85658a44-9ff2-4553-b9fd-686bf35fd6ec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:38:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-2f33d7ae-c92d-48be-9cf8-74ad326388c2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "85658a44-9ff2-4553-b9fd-686bf35fd6ec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:38:18 user nova-compute[71229]: INFO nova.compute.manager [None req-2f33d7ae-c92d-48be-9cf8-74ad326388c2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Terminating instance
Apr 11 15:38:18 user nova-compute[71229]: DEBUG nova.compute.manager [None req-2f33d7ae-c92d-48be-9cf8-74ad326388c2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Start destroying the instance on the hypervisor. {{(pid=71229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 15:38:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:38:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:38:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:38:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:38:18 user nova-compute[71229]: DEBUG nova.compute.manager [req-da870bb4-232f-472a-9794-0b7d1fa42889 req-ebad6eb2-5789-4090-8b72-f9fb1c5e556f service nova] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Received event network-vif-unplugged-c6826c01-eadd-49db-a842-accd25f7534a {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:38:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-da870bb4-232f-472a-9794-0b7d1fa42889 req-ebad6eb2-5789-4090-8b72-f9fb1c5e556f service nova] Acquiring lock "85658a44-9ff2-4553-b9fd-686bf35fd6ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:38:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-da870bb4-232f-472a-9794-0b7d1fa42889 req-ebad6eb2-5789-4090-8b72-f9fb1c5e556f service nova] Lock "85658a44-9ff2-4553-b9fd-686bf35fd6ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:38:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-da870bb4-232f-472a-9794-0b7d1fa42889 req-ebad6eb2-5789-4090-8b72-f9fb1c5e556f service nova] Lock "85658a44-9ff2-4553-b9fd-686bf35fd6ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:38:18 user nova-compute[71229]: DEBUG nova.compute.manager [req-da870bb4-232f-472a-9794-0b7d1fa42889 req-ebad6eb2-5789-4090-8b72-f9fb1c5e556f service nova] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] No waiting events found dispatching network-vif-unplugged-c6826c01-eadd-49db-a842-accd25f7534a {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:38:18 user nova-compute[71229]: DEBUG nova.compute.manager [req-da870bb4-232f-472a-9794-0b7d1fa42889 req-ebad6eb2-5789-4090-8b72-f9fb1c5e556f service nova] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Received event network-vif-unplugged-c6826c01-eadd-49db-a842-accd25f7534a for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 15:38:19 user nova-compute[71229]: DEBUG nova.network.neutron [req-8bef57d3-7cde-45f1-ada2-a6e77dc91965 req-0a6c9d63-f9fa-4bbf-845b-2f292e71a154 service nova] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Updated VIF entry in instance network info cache for port c6826c01-eadd-49db-a842-accd25f7534a. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:38:19 user nova-compute[71229]: DEBUG nova.network.neutron [req-8bef57d3-7cde-45f1-ada2-a6e77dc91965 req-0a6c9d63-f9fa-4bbf-845b-2f292e71a154 service nova] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Updating instance_info_cache with network_info: [{"id": "c6826c01-eadd-49db-a842-accd25f7534a", "address": "fa:16:3e:0d:20:92", "network": {"id": "8dd93667-4f8b-4d89-b7be-056f5f39bffe", "bridge": "br-int", "label": "tempest-TestStampPattern-1555823894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0f7abe5e3144c7ab354ffaba1748616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6826c01-ea", "ovs_interfaceid": "c6826c01-eadd-49db-a842-accd25f7534a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:38:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-8bef57d3-7cde-45f1-ada2-a6e77dc91965 req-0a6c9d63-f9fa-4bbf-845b-2f292e71a154 service nova] Releasing lock "refresh_cache-85658a44-9ff2-4553-b9fd-686bf35fd6ec" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:38:19 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Instance destroyed successfully.
Apr 11 15:38:19 user nova-compute[71229]: DEBUG nova.objects.instance [None req-2f33d7ae-c92d-48be-9cf8-74ad326388c2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lazy-loading 'resources' on Instance uuid 85658a44-9ff2-4553-b9fd-686bf35fd6ec {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:38:19 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-2f33d7ae-c92d-48be-9cf8-74ad326388c2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:31:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1021680630',display_name='tempest-TestStampPattern-server-1021680630',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1021680630',id=22,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3FSQFz663lRbqzNxmPBbu9uJ3msIEfoeqvzCwilWtgPX+8lEdFmI1HaDVmQnOzGM0qsSCbXPgFMVYIHe6QVLQ+qXsBEhvf3WHKTsTkVBdGgOn/xo5dIBdvrA6jCgt/VA==',key_name='tempest-TestStampPattern-416277054',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:31:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f0f7abe5e3144c7ab354ffaba1748616',ramdisk_id='',reservation_id='r-p3qyc5ea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-344874523',owner_user_name='tempest-TestStampPattern-344874523-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:34:30Z,user_data=None,user_id='402ec212c8a64a559f82c166070a92ef',uuid=85658a44-9ff2-4553-b9fd-686bf35fd6ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c6826c01-eadd-49db-a842-accd25f7534a", "address": "fa:16:3e:0d:20:92", "network": {"id": "8dd93667-4f8b-4d89-b7be-056f5f39bffe", "bridge": "br-int", "label": "tempest-TestStampPattern-1555823894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0f7abe5e3144c7ab354ffaba1748616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6826c01-ea", "ovs_interfaceid": "c6826c01-eadd-49db-a842-accd25f7534a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:38:19 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-2f33d7ae-c92d-48be-9cf8-74ad326388c2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Converting VIF {"id": "c6826c01-eadd-49db-a842-accd25f7534a", "address": "fa:16:3e:0d:20:92", "network": {"id": "8dd93667-4f8b-4d89-b7be-056f5f39bffe", "bridge": "br-int", "label": "tempest-TestStampPattern-1555823894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0f7abe5e3144c7ab354ffaba1748616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6826c01-ea", "ovs_interfaceid": "c6826c01-eadd-49db-a842-accd25f7534a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:38:19 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-2f33d7ae-c92d-48be-9cf8-74ad326388c2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:20:92,bridge_name='br-int',has_traffic_filtering=True,id=c6826c01-eadd-49db-a842-accd25f7534a,network=Network(8dd93667-4f8b-4d89-b7be-056f5f39bffe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6826c01-ea') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:38:19 user nova-compute[71229]: DEBUG os_vif [None req-2f33d7ae-c92d-48be-9cf8-74ad326388c2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:20:92,bridge_name='br-int',has_traffic_filtering=True,id=c6826c01-eadd-49db-a842-accd25f7534a,network=Network(8dd93667-4f8b-4d89-b7be-056f5f39bffe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6826c01-ea') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:38:19 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:38:19 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc6826c01-ea, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:38:19 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:38:19 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:38:19 user nova-compute[71229]: INFO os_vif [None req-2f33d7ae-c92d-48be-9cf8-74ad326388c2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:20:92,bridge_name='br-int',has_traffic_filtering=True,id=c6826c01-eadd-49db-a842-accd25f7534a,network=Network(8dd93667-4f8b-4d89-b7be-056f5f39bffe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6826c01-ea')
Apr 11 15:38:19 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-2f33d7ae-c92d-48be-9cf8-74ad326388c2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Deleting instance files /opt/stack/data/nova/instances/85658a44-9ff2-4553-b9fd-686bf35fd6ec_del
Apr 11 15:38:19 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-2f33d7ae-c92d-48be-9cf8-74ad326388c2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Deletion of /opt/stack/data/nova/instances/85658a44-9ff2-4553-b9fd-686bf35fd6ec_del complete
Apr 11 15:38:19 user nova-compute[71229]: INFO nova.compute.manager [None req-2f33d7ae-c92d-48be-9cf8-74ad326388c2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 11 15:38:19 user nova-compute[71229]: DEBUG oslo.service.loopingcall [None req-2f33d7ae-c92d-48be-9cf8-74ad326388c2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71229) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 15:38:19 user nova-compute[71229]: DEBUG nova.compute.manager [-] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Deallocating network for instance {{(pid=71229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 15:38:19 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] deallocate_for_instance() {{(pid=71229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 15:38:19 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:38:19 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Took 0.45 seconds to deallocate network for instance.
Apr 11 15:38:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-2f33d7ae-c92d-48be-9cf8-74ad326388c2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:38:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-2f33d7ae-c92d-48be-9cf8-74ad326388c2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:38:20 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-2f33d7ae-c92d-48be-9cf8-74ad326388c2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:38:20 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-2f33d7ae-c92d-48be-9cf8-74ad326388c2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:38:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-2f33d7ae-c92d-48be-9cf8-74ad326388c2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.303s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:38:20 user nova-compute[71229]: INFO nova.scheduler.client.report [None req-2f33d7ae-c92d-48be-9cf8-74ad326388c2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Deleted allocations for instance 85658a44-9ff2-4553-b9fd-686bf35fd6ec
Apr 11 15:38:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-2f33d7ae-c92d-48be-9cf8-74ad326388c2 tempest-TestStampPattern-344874523 tempest-TestStampPattern-344874523-project-member] Lock "85658a44-9ff2-4553-b9fd-686bf35fd6ec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.806s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:38:20 user nova-compute[71229]: DEBUG nova.compute.manager [req-c902a5d1-c35f-4eea-bb2b-c3c7570c5e6a req-1206109b-8edb-4559-a90b-495227fe1511 service nova] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Received event network-vif-plugged-c6826c01-eadd-49db-a842-accd25f7534a {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:38:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c902a5d1-c35f-4eea-bb2b-c3c7570c5e6a req-1206109b-8edb-4559-a90b-495227fe1511 service nova] Acquiring lock "85658a44-9ff2-4553-b9fd-686bf35fd6ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:38:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c902a5d1-c35f-4eea-bb2b-c3c7570c5e6a req-1206109b-8edb-4559-a90b-495227fe1511 service nova] Lock "85658a44-9ff2-4553-b9fd-686bf35fd6ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:38:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c902a5d1-c35f-4eea-bb2b-c3c7570c5e6a req-1206109b-8edb-4559-a90b-495227fe1511 service nova] Lock "85658a44-9ff2-4553-b9fd-686bf35fd6ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:38:20 user nova-compute[71229]: DEBUG nova.compute.manager [req-c902a5d1-c35f-4eea-bb2b-c3c7570c5e6a req-1206109b-8edb-4559-a90b-495227fe1511 service nova] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] No waiting events found dispatching network-vif-plugged-c6826c01-eadd-49db-a842-accd25f7534a {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:38:20 user nova-compute[71229]: WARNING nova.compute.manager [req-c902a5d1-c35f-4eea-bb2b-c3c7570c5e6a req-1206109b-8edb-4559-a90b-495227fe1511 service nova] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Received unexpected event network-vif-plugged-c6826c01-eadd-49db-a842-accd25f7534a for instance with vm_state deleted and task_state None.
Apr 11 15:38:20 user nova-compute[71229]: DEBUG nova.compute.manager [req-c902a5d1-c35f-4eea-bb2b-c3c7570c5e6a req-1206109b-8edb-4559-a90b-495227fe1511 service nova] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Received event network-vif-deleted-c6826c01-eadd-49db-a842-accd25f7534a {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:38:24 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:38:27 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:38:29 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:38:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:38:34 user nova-compute[71229]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681227499.2723527, 85658a44-9ff2-4553-b9fd-686bf35fd6ec => Stopped> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:38:34 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] VM Stopped (Lifecycle Event)
Apr 11 15:38:34 user nova-compute[71229]: DEBUG nova.compute.manager [None req-1c68ad70-34c5-4e8c-a370-53a9f33f2544 None None] [instance: 85658a44-9ff2-4553-b9fd-686bf35fd6ec] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:38:34 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:38:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:38:42 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:38:44 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:38:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:38:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:38:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-cfafda6b-0bb4-434b-86d6-fe3cfdffa504 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "7c4329ae-07cb-4f28-9fd6-29b398517d2b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:38:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-cfafda6b-0bb4-434b-86d6-fe3cfdffa504 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "7c4329ae-07cb-4f28-9fd6-29b398517d2b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:38:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-cfafda6b-0bb4-434b-86d6-fe3cfdffa504 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "7c4329ae-07cb-4f28-9fd6-29b398517d2b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:38:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-cfafda6b-0bb4-434b-86d6-fe3cfdffa504 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "7c4329ae-07cb-4f28-9fd6-29b398517d2b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:38:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-cfafda6b-0bb4-434b-86d6-fe3cfdffa504 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "7c4329ae-07cb-4f28-9fd6-29b398517d2b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:38:49 user nova-compute[71229]: INFO nova.compute.manager [None req-cfafda6b-0bb4-434b-86d6-fe3cfdffa504 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Terminating instance
Apr 11 15:38:49 user nova-compute[71229]: DEBUG nova.compute.manager [None req-cfafda6b-0bb4-434b-86d6-fe3cfdffa504 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Start destroying the instance on the hypervisor. {{(pid=71229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 15:38:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:38:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:38:49 user nova-compute[71229]: DEBUG nova.compute.manager [req-c3afda89-adfb-4327-a30f-c70ddb9ff15f req-5848c47d-95e3-4188-a8b4-2d376d023e11 service nova] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Received event network-vif-unplugged-37d248cb-99ae-4dcd-adfe-46bce9920d3e {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:38:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c3afda89-adfb-4327-a30f-c70ddb9ff15f req-5848c47d-95e3-4188-a8b4-2d376d023e11 service nova] Acquiring lock "7c4329ae-07cb-4f28-9fd6-29b398517d2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:38:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c3afda89-adfb-4327-a30f-c70ddb9ff15f req-5848c47d-95e3-4188-a8b4-2d376d023e11 service nova] Lock "7c4329ae-07cb-4f28-9fd6-29b398517d2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:38:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c3afda89-adfb-4327-a30f-c70ddb9ff15f req-5848c47d-95e3-4188-a8b4-2d376d023e11 service nova] Lock "7c4329ae-07cb-4f28-9fd6-29b398517d2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:38:49 user nova-compute[71229]: DEBUG nova.compute.manager [req-c3afda89-adfb-4327-a30f-c70ddb9ff15f req-5848c47d-95e3-4188-a8b4-2d376d023e11 service nova] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] No waiting events found dispatching network-vif-unplugged-37d248cb-99ae-4dcd-adfe-46bce9920d3e {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:38:49 user nova-compute[71229]: DEBUG nova.compute.manager [req-c3afda89-adfb-4327-a30f-c70ddb9ff15f req-5848c47d-95e3-4188-a8b4-2d376d023e11 service nova] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Received event network-vif-unplugged-37d248cb-99ae-4dcd-adfe-46bce9920d3e for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 15:38:50 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:38:50 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:38:50 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:38:50 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:38:50 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:38:50 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Instance destroyed successfully.
Apr 11 15:38:50 user nova-compute[71229]: DEBUG nova.objects.instance [None req-cfafda6b-0bb4-434b-86d6-fe3cfdffa504 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lazy-loading 'resources' on Instance uuid 7c4329ae-07cb-4f28-9fd6-29b398517d2b {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:38:50 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-cfafda6b-0bb4-434b-86d6-fe3cfdffa504 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-858493461',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-858493461',id=20,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:29:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ddc05e9bf5ab426982ccb3092ad596e4',ramdisk_id='',reservation_id='r-axycit9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1907753459',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:31:24Z,user_data=None,user_id='1d60ce27bfad4d7c9b976e834df35ad4',uuid=7c4329ae-07cb-4f28-9fd6-29b398517d2b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37d248cb-99ae-4dcd-adfe-46bce9920d3e", "address": "fa:16:3e:c2:89:8a", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d248cb-99", "ovs_interfaceid": "37d248cb-99ae-4dcd-adfe-46bce9920d3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:38:50 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-cfafda6b-0bb4-434b-86d6-fe3cfdffa504 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Converting VIF {"id": "37d248cb-99ae-4dcd-adfe-46bce9920d3e", "address": "fa:16:3e:c2:89:8a", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d248cb-99", "ovs_interfaceid": "37d248cb-99ae-4dcd-adfe-46bce9920d3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:38:50 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-cfafda6b-0bb4-434b-86d6-fe3cfdffa504 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:89:8a,bridge_name='br-int',has_traffic_filtering=True,id=37d248cb-99ae-4dcd-adfe-46bce9920d3e,network=Network(1cf4cec3-ff08-4320-89e4-aa7e8cf75eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37d248cb-99') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:38:50 user nova-compute[71229]: DEBUG os_vif [None req-cfafda6b-0bb4-434b-86d6-fe3cfdffa504 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:89:8a,bridge_name='br-int',has_traffic_filtering=True,id=37d248cb-99ae-4dcd-adfe-46bce9920d3e,network=Network(1cf4cec3-ff08-4320-89e4-aa7e8cf75eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37d248cb-99') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:38:50 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:38:50 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37d248cb-99, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:38:50 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:38:50 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:38:50 user nova-compute[71229]: INFO os_vif [None req-cfafda6b-0bb4-434b-86d6-fe3cfdffa504 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:89:8a,bridge_name='br-int',has_traffic_filtering=True,id=37d248cb-99ae-4dcd-adfe-46bce9920d3e,network=Network(1cf4cec3-ff08-4320-89e4-aa7e8cf75eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37d248cb-99')
Apr 11 15:38:50 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-cfafda6b-0bb4-434b-86d6-fe3cfdffa504 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Deleting instance files /opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b_del
Apr 11 15:38:50 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-cfafda6b-0bb4-434b-86d6-fe3cfdffa504 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Deletion of /opt/stack/data/nova/instances/7c4329ae-07cb-4f28-9fd6-29b398517d2b_del complete
Apr 11 15:38:50 user nova-compute[71229]: INFO nova.compute.manager [None req-cfafda6b-0bb4-434b-86d6-fe3cfdffa504 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Took 0.67 seconds to destroy the instance on the hypervisor.
Apr 11 15:38:50 user nova-compute[71229]: DEBUG oslo.service.loopingcall [None req-cfafda6b-0bb4-434b-86d6-fe3cfdffa504 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71229) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 15:38:50 user nova-compute[71229]: DEBUG nova.compute.manager [-] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Deallocating network for instance {{(pid=71229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 15:38:50 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] deallocate_for_instance() {{(pid=71229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 15:38:50 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:38:50 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:38:50 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:38:50 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Took 0.65 seconds to deallocate network for instance.
Apr 11 15:38:50 user nova-compute[71229]: DEBUG nova.compute.manager [req-a9b1c5f4-fa2d-480d-9f52-e29171480f50 req-5eeb9b3d-af6c-4d0f-8001-902b4c7e77d5 service nova] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Received event network-vif-deleted-37d248cb-99ae-4dcd-adfe-46bce9920d3e {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:38:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-cfafda6b-0bb4-434b-86d6-fe3cfdffa504 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:38:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-cfafda6b-0bb4-434b-86d6-fe3cfdffa504 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:38:51 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-cfafda6b-0bb4-434b-86d6-fe3cfdffa504 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:38:51 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-cfafda6b-0bb4-434b-86d6-fe3cfdffa504 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:38:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-cfafda6b-0bb4-434b-86d6-fe3cfdffa504 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.262s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:38:51 user nova-compute[71229]: INFO nova.scheduler.client.report [None req-cfafda6b-0bb4-434b-86d6-fe3cfdffa504 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Deleted allocations for instance 7c4329ae-07cb-4f28-9fd6-29b398517d2b
Apr 11 15:38:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-cfafda6b-0bb4-434b-86d6-fe3cfdffa504 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "7c4329ae-07cb-4f28-9fd6-29b398517d2b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.784s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:38:51 user nova-compute[71229]: DEBUG nova.compute.manager [req-739e6aac-c587-4df7-a04c-034f6a8e6ce4 req-d197879c-13ed-49b9-a80e-3af0abd8e835 service nova] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Received event network-vif-plugged-37d248cb-99ae-4dcd-adfe-46bce9920d3e {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:38:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-739e6aac-c587-4df7-a04c-034f6a8e6ce4 req-d197879c-13ed-49b9-a80e-3af0abd8e835 service nova] Acquiring lock "7c4329ae-07cb-4f28-9fd6-29b398517d2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:38:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-739e6aac-c587-4df7-a04c-034f6a8e6ce4 req-d197879c-13ed-49b9-a80e-3af0abd8e835 service nova] Lock "7c4329ae-07cb-4f28-9fd6-29b398517d2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:38:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-739e6aac-c587-4df7-a04c-034f6a8e6ce4 req-d197879c-13ed-49b9-a80e-3af0abd8e835 service nova] Lock "7c4329ae-07cb-4f28-9fd6-29b398517d2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:38:51 user nova-compute[71229]: DEBUG nova.compute.manager [req-739e6aac-c587-4df7-a04c-034f6a8e6ce4 req-d197879c-13ed-49b9-a80e-3af0abd8e835 service nova] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] No waiting events found dispatching network-vif-plugged-37d248cb-99ae-4dcd-adfe-46bce9920d3e {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:38:51 user nova-compute[71229]: WARNING nova.compute.manager [req-739e6aac-c587-4df7-a04c-034f6a8e6ce4 req-d197879c-13ed-49b9-a80e-3af0abd8e835 service nova] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Received unexpected event network-vif-plugged-37d248cb-99ae-4dcd-adfe-46bce9920d3e for instance with vm_state deleted and task_state None.
Apr 11 15:38:51 user nova-compute[71229]: DEBUG nova.compute.manager [req-739e6aac-c587-4df7-a04c-034f6a8e6ce4 req-d197879c-13ed-49b9-a80e-3af0abd8e835 service nova] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Received event network-vif-plugged-37d248cb-99ae-4dcd-adfe-46bce9920d3e {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:38:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-739e6aac-c587-4df7-a04c-034f6a8e6ce4 req-d197879c-13ed-49b9-a80e-3af0abd8e835 service nova] Acquiring lock "7c4329ae-07cb-4f28-9fd6-29b398517d2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:38:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-739e6aac-c587-4df7-a04c-034f6a8e6ce4 req-d197879c-13ed-49b9-a80e-3af0abd8e835 service nova] Lock "7c4329ae-07cb-4f28-9fd6-29b398517d2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:38:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-739e6aac-c587-4df7-a04c-034f6a8e6ce4 req-d197879c-13ed-49b9-a80e-3af0abd8e835 service nova] Lock "7c4329ae-07cb-4f28-9fd6-29b398517d2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:38:51 user nova-compute[71229]: DEBUG nova.compute.manager [req-739e6aac-c587-4df7-a04c-034f6a8e6ce4 req-d197879c-13ed-49b9-a80e-3af0abd8e835 service nova] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] No waiting events found dispatching network-vif-plugged-37d248cb-99ae-4dcd-adfe-46bce9920d3e {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:38:51 user nova-compute[71229]: WARNING nova.compute.manager [req-739e6aac-c587-4df7-a04c-034f6a8e6ce4 req-d197879c-13ed-49b9-a80e-3af0abd8e835 service nova] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Received unexpected event network-vif-plugged-37d248cb-99ae-4dcd-adfe-46bce9920d3e for instance with vm_state deleted and task_state None.
Apr 11 15:38:51 user nova-compute[71229]: DEBUG nova.compute.manager [req-739e6aac-c587-4df7-a04c-034f6a8e6ce4 req-d197879c-13ed-49b9-a80e-3af0abd8e835 service nova] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Received event network-vif-plugged-37d248cb-99ae-4dcd-adfe-46bce9920d3e {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:38:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-739e6aac-c587-4df7-a04c-034f6a8e6ce4 req-d197879c-13ed-49b9-a80e-3af0abd8e835 service nova] Acquiring lock "7c4329ae-07cb-4f28-9fd6-29b398517d2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:38:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-739e6aac-c587-4df7-a04c-034f6a8e6ce4 req-d197879c-13ed-49b9-a80e-3af0abd8e835 service nova] Lock "7c4329ae-07cb-4f28-9fd6-29b398517d2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:38:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-739e6aac-c587-4df7-a04c-034f6a8e6ce4 req-d197879c-13ed-49b9-a80e-3af0abd8e835 service nova] Lock "7c4329ae-07cb-4f28-9fd6-29b398517d2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:38:51 user nova-compute[71229]: DEBUG nova.compute.manager [req-739e6aac-c587-4df7-a04c-034f6a8e6ce4 req-d197879c-13ed-49b9-a80e-3af0abd8e835 service nova] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] No waiting events found dispatching network-vif-plugged-37d248cb-99ae-4dcd-adfe-46bce9920d3e {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:38:51 user nova-compute[71229]: WARNING nova.compute.manager [req-739e6aac-c587-4df7-a04c-034f6a8e6ce4 req-d197879c-13ed-49b9-a80e-3af0abd8e835 service nova] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Received unexpected event network-vif-plugged-37d248cb-99ae-4dcd-adfe-46bce9920d3e for instance with vm_state deleted and task_state None.
Apr 11 15:38:51 user nova-compute[71229]: DEBUG nova.compute.manager [req-739e6aac-c587-4df7-a04c-034f6a8e6ce4 req-d197879c-13ed-49b9-a80e-3af0abd8e835 service nova] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Received event network-vif-unplugged-37d248cb-99ae-4dcd-adfe-46bce9920d3e {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:38:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-739e6aac-c587-4df7-a04c-034f6a8e6ce4 req-d197879c-13ed-49b9-a80e-3af0abd8e835 service nova] Acquiring lock "7c4329ae-07cb-4f28-9fd6-29b398517d2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:38:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-739e6aac-c587-4df7-a04c-034f6a8e6ce4 req-d197879c-13ed-49b9-a80e-3af0abd8e835 service nova] Lock "7c4329ae-07cb-4f28-9fd6-29b398517d2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:38:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-739e6aac-c587-4df7-a04c-034f6a8e6ce4 req-d197879c-13ed-49b9-a80e-3af0abd8e835 service nova] Lock "7c4329ae-07cb-4f28-9fd6-29b398517d2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:38:51 user nova-compute[71229]: DEBUG nova.compute.manager [req-739e6aac-c587-4df7-a04c-034f6a8e6ce4 req-d197879c-13ed-49b9-a80e-3af0abd8e835 service nova] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] No waiting events found dispatching network-vif-unplugged-37d248cb-99ae-4dcd-adfe-46bce9920d3e {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:38:51 user nova-compute[71229]: WARNING nova.compute.manager [req-739e6aac-c587-4df7-a04c-034f6a8e6ce4 req-d197879c-13ed-49b9-a80e-3af0abd8e835 service nova] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Received unexpected event network-vif-unplugged-37d248cb-99ae-4dcd-adfe-46bce9920d3e for instance with vm_state deleted and task_state None.
Apr 11 15:38:51 user nova-compute[71229]: DEBUG nova.compute.manager [req-739e6aac-c587-4df7-a04c-034f6a8e6ce4 req-d197879c-13ed-49b9-a80e-3af0abd8e835 service nova] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Received event network-vif-plugged-37d248cb-99ae-4dcd-adfe-46bce9920d3e {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:38:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-739e6aac-c587-4df7-a04c-034f6a8e6ce4 req-d197879c-13ed-49b9-a80e-3af0abd8e835 service nova] Acquiring lock "7c4329ae-07cb-4f28-9fd6-29b398517d2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:38:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-739e6aac-c587-4df7-a04c-034f6a8e6ce4 req-d197879c-13ed-49b9-a80e-3af0abd8e835 service nova] Lock "7c4329ae-07cb-4f28-9fd6-29b398517d2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:38:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-739e6aac-c587-4df7-a04c-034f6a8e6ce4 req-d197879c-13ed-49b9-a80e-3af0abd8e835 service nova] Lock "7c4329ae-07cb-4f28-9fd6-29b398517d2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:38:51 user nova-compute[71229]: DEBUG nova.compute.manager [req-739e6aac-c587-4df7-a04c-034f6a8e6ce4 req-d197879c-13ed-49b9-a80e-3af0abd8e835 service nova] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] No waiting events found dispatching network-vif-plugged-37d248cb-99ae-4dcd-adfe-46bce9920d3e {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:38:51 user nova-compute[71229]: WARNING nova.compute.manager [req-739e6aac-c587-4df7-a04c-034f6a8e6ce4 req-d197879c-13ed-49b9-a80e-3af0abd8e835 service nova] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Received unexpected event network-vif-plugged-37d248cb-99ae-4dcd-adfe-46bce9920d3e for instance with vm_state deleted and task_state None.
Apr 11 15:38:55 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:39:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:39:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:39:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 15:39:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 15:39:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 15:39:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:39:01 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:39:01 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 15:39:04 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:39:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:39:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:39:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:39:04 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 15:39:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:05 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:39:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:05 user nova-compute[71229]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681227530.2029006, 7c4329ae-07cb-4f28-9fd6-29b398517d2b => Stopped> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:39:05 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] VM Stopped (Lifecycle Event)
Apr 11 15:39:05 user nova-compute[71229]: DEBUG nova.compute.manager [None req-2ef0e70c-42fc-41d3-8c94-659768931f52 None None] [instance: 7c4329ae-07cb-4f28-9fd6-29b398517d2b] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:39:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:39:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:06 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:39:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:06 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:39:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:39:07 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:39:07 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:39:07 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8204MB free_disk=25.950057983398438GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 15:39:07 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:39:07 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:39:07 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance de1a45fd-27be-4438-80a4-2f3a100643c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:39:07 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance b0d90fd2-6a95-43c4-8756-e82071d99154 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:39:07 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance dcbfcbfd-7e96-4271-94ee-60ef937e3b7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:39:07 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:39:07 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 6f6ae64a-c760-4ba3-8a50-d380835d9913 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:39:07 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 058df5ba-07ab-4bdd-9a47-907e7b0e0e59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:39:07 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance ffce2921-d4a5-4bcb-8032-62a6dc321fb4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:39:07 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 15:39:07 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 15:39:07 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:39:07 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:39:07 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 15:39:07 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.541s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:39:08 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:39:08 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:39:08 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 15:39:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "refresh_cache-b0d90fd2-6a95-43c4-8756-e82071d99154" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:39:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquired lock "refresh_cache-b0d90fd2-6a95-43c4-8756-e82071d99154" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:39:08 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Forcefully refreshing network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 15:39:09 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Updating instance_info_cache with network_info: [{"id": "4718fa68-0eb9-4592-8c43-981438e3d0b8", "address": "fa:16:3e:e4:28:3b", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4718fa68-0e", "ovs_interfaceid": "4718fa68-0eb9-4592-8c43-981438e3d0b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:39:09 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Releasing lock "refresh_cache-b0d90fd2-6a95-43c4-8756-e82071d99154" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:39:09 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Updated the network info_cache for instance {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 15:39:09 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:39:09 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:39:09 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:39:09 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:39:09 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:39:10 user nova-compute[71229]: DEBUG nova.compute.manager [req-db7b6587-3cab-4c10-8cc9-0512603d8fd7 req-80cb05f3-a719-4665-9a12-f564382c7465 service nova] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Received event network-changed-32c006ee-14e2-47d8-b999-bafc729aa67a {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:39:10 user nova-compute[71229]: DEBUG nova.compute.manager [req-db7b6587-3cab-4c10-8cc9-0512603d8fd7 req-80cb05f3-a719-4665-9a12-f564382c7465 service nova] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Refreshing instance network info cache due to event network-changed-32c006ee-14e2-47d8-b999-bafc729aa67a. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:39:10 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-db7b6587-3cab-4c10-8cc9-0512603d8fd7 req-80cb05f3-a719-4665-9a12-f564382c7465 service nova] Acquiring lock "refresh_cache-dcbfcbfd-7e96-4271-94ee-60ef937e3b7e" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:39:10 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-db7b6587-3cab-4c10-8cc9-0512603d8fd7 req-80cb05f3-a719-4665-9a12-f564382c7465 service nova] Acquired lock "refresh_cache-dcbfcbfd-7e96-4271-94ee-60ef937e3b7e" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:39:10 user nova-compute[71229]: DEBUG nova.network.neutron [req-db7b6587-3cab-4c10-8cc9-0512603d8fd7 req-80cb05f3-a719-4665-9a12-f564382c7465 service nova] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Refreshing network info cache for port 32c006ee-14e2-47d8-b999-bafc729aa67a {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:39:10 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:39:10 user nova-compute[71229]: DEBUG nova.network.neutron [req-db7b6587-3cab-4c10-8cc9-0512603d8fd7 req-80cb05f3-a719-4665-9a12-f564382c7465 service nova] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Updated VIF entry in instance network info cache for port 32c006ee-14e2-47d8-b999-bafc729aa67a. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:39:10 user nova-compute[71229]: DEBUG nova.network.neutron [req-db7b6587-3cab-4c10-8cc9-0512603d8fd7 req-80cb05f3-a719-4665-9a12-f564382c7465 service nova] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Updating instance_info_cache with network_info: [{"id": "32c006ee-14e2-47d8-b999-bafc729aa67a", "address": "fa:16:3e:1a:bd:54", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c006ee-14", "ovs_interfaceid": "32c006ee-14e2-47d8-b999-bafc729aa67a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:39:10 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-db7b6587-3cab-4c10-8cc9-0512603d8fd7 req-80cb05f3-a719-4665-9a12-f564382c7465 service nova] Releasing lock "refresh_cache-dcbfcbfd-7e96-4271-94ee-60ef937e3b7e" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:39:11 user nova-compute[71229]: DEBUG nova.compute.manager [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Stashing vm_state: active {{(pid=71229) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 11 15:39:11 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:39:11 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:39:11 user nova-compute[71229]: DEBUG nova.objects.instance [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lazy-loading 'pci_requests' on Instance uuid ffce2921-d4a5-4bcb-8032-62a6dc321fb4 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:39:11 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 15:39:11 user nova-compute[71229]: INFO nova.compute.claims [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Claim successful on node user
Apr 11 15:39:11 user nova-compute[71229]: DEBUG nova.objects.instance [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lazy-loading 'resources' on Instance uuid ffce2921-d4a5-4bcb-8032-62a6dc321fb4 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:39:11 user nova-compute[71229]: DEBUG nova.objects.instance [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lazy-loading 'pci_devices' on Instance uuid ffce2921-d4a5-4bcb-8032-62a6dc321fb4 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:39:11 user nova-compute[71229]: INFO nova.compute.resource_tracker [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Updating resource usage from migration 71b2eb17-0495-4112-b141-1e859cc7b24b
Apr 11 15:39:11 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:39:11 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:39:11 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.394s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:39:11 user nova-compute[71229]: INFO nova.compute.manager [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Migrating
Apr 11 15:39:11 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "refresh_cache-ffce2921-d4a5-4bcb-8032-62a6dc321fb4" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:39:11 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquired lock "refresh_cache-ffce2921-d4a5-4bcb-8032-62a6dc321fb4" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:39:11 user nova-compute[71229]: DEBUG nova.network.neutron [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:39:12 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:39:12 user nova-compute[71229]: DEBUG nova.compute.manager [req-4b6ca4d0-fba3-4d91-b6be-3bdbb8800844 req-b1fec393-2f37-4f5b-87fa-c4d87ca89c19 service nova] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Received event network-changed-910fb3d4-3965-41a2-8f97-9de79ee78c78 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:39:12 user nova-compute[71229]: DEBUG nova.compute.manager [req-4b6ca4d0-fba3-4d91-b6be-3bdbb8800844 req-b1fec393-2f37-4f5b-87fa-c4d87ca89c19 service nova] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Refreshing instance network info cache due to event network-changed-910fb3d4-3965-41a2-8f97-9de79ee78c78. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:39:12 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4b6ca4d0-fba3-4d91-b6be-3bdbb8800844 req-b1fec393-2f37-4f5b-87fa-c4d87ca89c19 service nova] Acquiring lock "refresh_cache-ffce2921-d4a5-4bcb-8032-62a6dc321fb4" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:39:13 user nova-compute[71229]: DEBUG nova.network.neutron [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Updating instance_info_cache with network_info: [{"id": "910fb3d4-3965-41a2-8f97-9de79ee78c78", "address": "fa:16:3e:50:1e:37", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap910fb3d4-39", "ovs_interfaceid": "910fb3d4-3965-41a2-8f97-9de79ee78c78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:39:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Releasing lock "refresh_cache-ffce2921-d4a5-4bcb-8032-62a6dc321fb4" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:39:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4b6ca4d0-fba3-4d91-b6be-3bdbb8800844 req-b1fec393-2f37-4f5b-87fa-c4d87ca89c19 service nova] Acquired lock "refresh_cache-ffce2921-d4a5-4bcb-8032-62a6dc321fb4" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:39:13 user nova-compute[71229]: DEBUG nova.network.neutron [req-4b6ca4d0-fba3-4d91-b6be-3bdbb8800844 req-b1fec393-2f37-4f5b-87fa-c4d87ca89c19 service nova] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Refreshing network info cache for port 910fb3d4-3965-41a2-8f97-9de79ee78c78 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:39:13 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:39:13 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Starting migrate_disk_and_power_off {{(pid=71229) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 11 15:39:13 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:39:13 user nova-compute[71229]: DEBUG nova.compute.manager [req-3c66c8f9-44fd-45dd-955c-dab76aa964a5 req-4fd92a9b-e45a-4662-a5ef-74436639d48e service nova] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Received event network-vif-unplugged-910fb3d4-3965-41a2-8f97-9de79ee78c78 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:39:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3c66c8f9-44fd-45dd-955c-dab76aa964a5 req-4fd92a9b-e45a-4662-a5ef-74436639d48e service nova] Acquiring lock "ffce2921-d4a5-4bcb-8032-62a6dc321fb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:39:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3c66c8f9-44fd-45dd-955c-dab76aa964a5 req-4fd92a9b-e45a-4662-a5ef-74436639d48e service nova] Lock "ffce2921-d4a5-4bcb-8032-62a6dc321fb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:39:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3c66c8f9-44fd-45dd-955c-dab76aa964a5 req-4fd92a9b-e45a-4662-a5ef-74436639d48e service nova] Lock "ffce2921-d4a5-4bcb-8032-62a6dc321fb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:39:13 user nova-compute[71229]: DEBUG nova.compute.manager [req-3c66c8f9-44fd-45dd-955c-dab76aa964a5 req-4fd92a9b-e45a-4662-a5ef-74436639d48e service nova] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] No waiting events found dispatching network-vif-unplugged-910fb3d4-3965-41a2-8f97-9de79ee78c78 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:39:13 user nova-compute[71229]: WARNING nova.compute.manager [req-3c66c8f9-44fd-45dd-955c-dab76aa964a5 req-4fd92a9b-e45a-4662-a5ef-74436639d48e service nova] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Received unexpected event network-vif-unplugged-910fb3d4-3965-41a2-8f97-9de79ee78c78 for instance with vm_state active and task_state resize_migrating.
Apr 11 15:39:13 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:39:13 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:39:13 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:39:13 user nova-compute[71229]: DEBUG nova.network.neutron [req-4b6ca4d0-fba3-4d91-b6be-3bdbb8800844 req-b1fec393-2f37-4f5b-87fa-c4d87ca89c19 service nova] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Updated VIF entry in instance network info cache for port 910fb3d4-3965-41a2-8f97-9de79ee78c78. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:39:13 user nova-compute[71229]: DEBUG nova.network.neutron [req-4b6ca4d0-fba3-4d91-b6be-3bdbb8800844 req-b1fec393-2f37-4f5b-87fa-c4d87ca89c19 service nova] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Updating instance_info_cache with network_info: [{"id": "910fb3d4-3965-41a2-8f97-9de79ee78c78", "address": "fa:16:3e:50:1e:37", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap910fb3d4-39", "ovs_interfaceid": "910fb3d4-3965-41a2-8f97-9de79ee78c78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:39:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4b6ca4d0-fba3-4d91-b6be-3bdbb8800844 req-b1fec393-2f37-4f5b-87fa-c4d87ca89c19 service nova] Releasing lock "refresh_cache-ffce2921-d4a5-4bcb-8032-62a6dc321fb4" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:39:13 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Instance destroyed successfully.
Apr 11 15:39:13 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:37:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-794339141',display_name='tempest-ServerActionsTestJSON-server-794339141',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-794339141',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfAJGQ+GOa8zW+jlKgD9Kz6/k6iEv9pZIOIjICzcstJ92AAS94+47mc3fRsqyx5FaTMV9P4lTsW4Fy7tKIAtMpRx0Sl7sa6ttQnPbPhlcYqfbdWbTqmmKi6+BuZpqSknA==',key_name='tempest-keypair-1137963694',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:37:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bb7660e8f76b471487136806ee9eec62',ramdisk_id='',reservation_id='r-g3c0fmpg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1659503440',owner_user_name='tempest-ServerActionsTestJSON-1659503440-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:39:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10720df0ac4f4e62a0a5c9883d600add',uuid=ffce2921-d4a5-4bcb-8032-62a6dc321fb4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "910fb3d4-3965-41a2-8f97-9de79ee78c78", "address": "fa:16:3e:50:1e:37", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-665410087-network", "vif_mac": "fa:16:3e:50:1e:37"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap910fb3d4-39", "ovs_interfaceid": "910fb3d4-3965-41a2-8f97-9de79ee78c78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:39:13 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Converting VIF {"id": "910fb3d4-3965-41a2-8f97-9de79ee78c78", "address": "fa:16:3e:50:1e:37", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-665410087-network", "vif_mac": "fa:16:3e:50:1e:37"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap910fb3d4-39", "ovs_interfaceid": "910fb3d4-3965-41a2-8f97-9de79ee78c78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:39:13 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:1e:37,bridge_name='br-int',has_traffic_filtering=True,id=910fb3d4-3965-41a2-8f97-9de79ee78c78,network=Network(1bd215e8-0459-4dd2-893b-096b6e31ac08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap910fb3d4-39') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:39:13 user nova-compute[71229]: DEBUG os_vif [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:1e:37,bridge_name='br-int',has_traffic_filtering=True,id=910fb3d4-3965-41a2-8f97-9de79ee78c78,network=Network(1bd215e8-0459-4dd2-893b-096b6e31ac08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap910fb3d4-39') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:39:13 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:39:13 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap910fb3d4-39, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:39:13 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:39:13 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:39:13 user nova-compute[71229]: INFO os_vif [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:1e:37,bridge_name='br-int',has_traffic_filtering=True,id=910fb3d4-3965-41a2-8f97-9de79ee78c78,network=Network(1bd215e8-0459-4dd2-893b-096b6e31ac08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap910fb3d4-39')
Apr 11 15:39:13 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 15:39:13 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gSNaBYAr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:39:13 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:39:13 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:39:13 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:39:13 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:13 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:13 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b195d13-4df0-42ae-a569-0c8c0ae4b5da]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:39:13 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 15:39:13 user nova-compute[71229]: No targets found.
Apr 11 15:39:13 user nova-compute[71229]: iSNS:
Apr 11 15:39:13 user nova-compute[71229]: No targets found.
Apr 11 15:39:13 user nova-compute[71229]: STATIC:
Apr 11 15:39:13 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb
Apr 11 15:39:13 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:39:13 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:39:13 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a
Apr 11 15:39:13 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:39:13 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:39:13 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68
Apr 11 15:39:13 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:39:13 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:39:13 user nova-compute[71229]: FIRMWARE:
Apr 11 15:39:13 user nova-compute[71229]: No targets found.
Apr 11 15:39:13 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:39:13 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 15:39:13 user nova-compute[71229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 15:39:13 user nova-compute[71229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71229) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 15:39:13 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68', 0)] {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 15:39:13 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:13 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:13 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbfece9-d886-4aa4-9aa2-67d40973ef7a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:39:13 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:14 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:14 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[439a8130-e110-42ef-8dc7-894dff9a4872]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:39:14 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:39:14 user nova-compute[71229]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 (non-flash)
Apr 11 15:39:14 user nova-compute[71229]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a (non-flash)
Apr 11 15:39:14 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:39:14 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:39:14 user nova-compute[71229]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 (non-flash)
Apr 11 15:39:14 user nova-compute[71229]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a (non-flash)
Apr 11 15:39:14 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:39:14 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb643a39a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68'): ({'sdc'}, set())}) {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 15:39:14 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Removing single pathed devices sdc {{(pid=71229) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 15:39:14 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:14 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:14 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[57558ed0-c948-4fd4-8b41-16d922e0a363]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:39:14 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:14 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:14 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1902175f-0b63-406f-bd44-1472fb6a3075]: (4, ('ok\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:39:14 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Flushing IO for device /dev/sdc {{(pid=71229) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 15:39:14 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:14 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:14 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[65537e93-46f6-4413-9855-5e7120b54310]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:39:14 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71229) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 15:39:14 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:14 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:14 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0ee64e-8787-45e7-9d58-2e9736afa0ff]: (4, ('1', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:39:14 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 15:39:14 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] SCSI volumes sdc have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 15:39:14 user nova-compute[71229]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_358ab0ac', '/dev/disk/by-id/scsi-1SCST_BIO358ab0ac-f021e73f26791605', '/dev/disk/by-id/scsi-26630323165373366') {{(pid=81310) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 11 15:39:14 user nova-compute[71229]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_358ab0ac
Apr 11 15:39:14 user nova-compute[71229]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO358ab0ac-f021e73f26791605
Apr 11 15:39:14 user nova-compute[71229]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26630323165373366
Apr 11 15:39:14 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c12b2d0-923b-4395-be47-07470c904f14]: (4, None) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:39:14 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68')] {{(pid=71229) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 15:39:14 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:14 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:14 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6124905-6275-487b-b39c-d58eb619de05]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:39:14 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:39:14 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 -p 172.16.0.220:3260 --logout {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:14 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:14 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[db87b8fa-fd44-4ce4-b6f3-089b617aae38]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:39:14 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68, portal: 172.16.0.220,3260]
Apr 11 15:39:14 user nova-compute[71229]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68, portal: 172.16.0.220,3260] successful.
Apr 11 15:39:14 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:39:14 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 -p 172.16.0.220:3260 --op delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:14 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:14 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf95a20-6eeb-4614-b6b4-1e2fbee38274]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:39:14 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:39:14 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:39:14 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] <== disconnect_volume: return (338ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:39:14 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 15:39:14 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:39:15 user nova-compute[71229]: DEBUG nova.network.neutron [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Port 910fb3d4-3965-41a2-8f97-9de79ee78c78 binding to destination host user is already ACTIVE {{(pid=71229) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 11 15:39:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ffce2921-d4a5-4bcb-8032-62a6dc321fb4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:39:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ffce2921-d4a5-4bcb-8032-62a6dc321fb4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:39:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ffce2921-d4a5-4bcb-8032-62a6dc321fb4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:39:15 user nova-compute[71229]: DEBUG nova.compute.manager [req-de7efa11-2283-4ccb-b79f-39283828086a req-76d273f2-72f2-4b8a-b8cf-9a01f7a42560 service nova] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Received event network-vif-plugged-910fb3d4-3965-41a2-8f97-9de79ee78c78 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:39:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-de7efa11-2283-4ccb-b79f-39283828086a req-76d273f2-72f2-4b8a-b8cf-9a01f7a42560 service nova] Acquiring lock "ffce2921-d4a5-4bcb-8032-62a6dc321fb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:39:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-de7efa11-2283-4ccb-b79f-39283828086a req-76d273f2-72f2-4b8a-b8cf-9a01f7a42560 service nova] Lock "ffce2921-d4a5-4bcb-8032-62a6dc321fb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:39:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-de7efa11-2283-4ccb-b79f-39283828086a req-76d273f2-72f2-4b8a-b8cf-9a01f7a42560 service nova] Lock "ffce2921-d4a5-4bcb-8032-62a6dc321fb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:39:15 user nova-compute[71229]: DEBUG nova.compute.manager [req-de7efa11-2283-4ccb-b79f-39283828086a req-76d273f2-72f2-4b8a-b8cf-9a01f7a42560 service nova] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] No waiting events found dispatching network-vif-plugged-910fb3d4-3965-41a2-8f97-9de79ee78c78 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:39:15 user nova-compute[71229]: WARNING nova.compute.manager [req-de7efa11-2283-4ccb-b79f-39283828086a req-76d273f2-72f2-4b8a-b8cf-9a01f7a42560 service nova] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Received unexpected event network-vif-plugged-910fb3d4-3965-41a2-8f97-9de79ee78c78 for instance with vm_state active and task_state resize_migrated.
Apr 11 15:39:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "refresh_cache-ffce2921-d4a5-4bcb-8032-62a6dc321fb4" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:39:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquired lock "refresh_cache-ffce2921-d4a5-4bcb-8032-62a6dc321fb4" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:39:15 user nova-compute[71229]: DEBUG nova.network.neutron [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:39:16 user nova-compute[71229]: DEBUG nova.network.neutron [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Updating instance_info_cache with network_info: [{"id": "910fb3d4-3965-41a2-8f97-9de79ee78c78", "address": "fa:16:3e:50:1e:37", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap910fb3d4-39", "ovs_interfaceid": "910fb3d4-3965-41a2-8f97-9de79ee78c78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:39:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Releasing lock "refresh_cache-ffce2921-d4a5-4bcb-8032-62a6dc321fb4" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:39:16 user nova-compute[71229]: DEBUG os_brick.utils [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:39:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:16 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8226e2e8-e800-484b-b0dc-daac314b9172]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d55e24a97c90\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:39:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:16 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f269c6-8d4a-409a-a3fc-35648d086fe4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:39:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:16 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[736118f7-1558-4986-ba65-ab3566efc41d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:39:16 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8696db-d74e-46b1-8a01-6a50e5b9365b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:39:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Running cmd (subprocess): nvme version {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] 'nvme version' failed. Not Retrying. {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:39:16 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] nvme not present on system {{(pid=71229) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 15:39:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:39:16 user nova-compute[71229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 15:39:16 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47bf404-0251-45d2-871a-6393c4b8f865]: (4, '') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:39:16 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71229) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 15:39:16 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 15:39:16 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] LIGHTOS: no hostnqn found. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 15:39:16 user nova-compute[71229]: DEBUG os_brick.utils [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d55e24a97c90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:39:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:39:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Starting finish_migration {{(pid=71229) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Instance directory exists: not creating {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 15:39:21 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Creating image(s)
Apr 11 15:39:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Did not create local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Ensure instance console log exists: /opt/stack/data/nova/instances/ffce2921-d4a5-4bcb-8032-62a6dc321fb4/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Start _get_guest_xml network_info=[{"id": "910fb3d4-3965-41a2-8f97-9de79ee78c78", "address": "fa:16:3e:50:1e:37", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-665410087-network", "vif_mac": "fa:16:3e:50:1e:37"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap910fb3d4-39", "ovs_interfaceid": "910fb3d4-3965-41a2-8f97-9de79ee78c78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gSNaBYAr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'ffce2921-d4a5-4bcb-8032-62a6dc321fb4', 'attached_at': '2023-04-11T15:39:21.000000', 'detached_at': '', 'volume_id': '98d29c73-7b06-45f4-90e0-01a41825cc68', 'serial': '98d29c73-7b06-45f4-90e0-01a41825cc68'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'cc4650cf-1b7b-4bd9-b1ee-7a158a372a48', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:39:21 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:39:21 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:39:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG nova.objects.instance [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lazy-loading 'vcpu_model' on Instance uuid ffce2921-d4a5-4bcb-8032-62a6dc321fb4 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gSNaBYAr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:39:21 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:39:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:39:21 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:39:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:39:21 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 15:39:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e681cf-b2f8-4859-b6b3-5800114e03fb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 15:39:21 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 -p 172.16.0.220:3260 --interface default --op new {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[15363eac-81ea-4d9e-90b8-98c33e5a9e60]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68] added\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68] added
Apr 11 15:39:21 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2719c49-3746-4cdc-aeda-5807a19f18e2]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[129fe6b6-456a-43a6-9bfd-e3d8f0e3d305]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gSNaBYAr {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gSNaBYAr" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[996d3703-c3d5-4f9e-a712-0ae608beb2b9]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gSNaBYAr'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2392d9-fc73-468e-92a1-bc0fad45a7c3]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[836688a6-0d8a-470d-989f-65ad2fe9eb17]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:39:21 user nova-compute[71229]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a (non-flash)
Apr 11 15:39:21 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:39:21 user nova-compute[71229]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a (non-flash)
Apr 11 15:39:21 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 -p 172.16.0.220:3260 --login {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d92f795-0edd-414c-a767-4b36e72bd449]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68, portal: 172.16.0.220,3260]
Apr 11 15:39:21 user nova-compute[71229]: Login to [iface: default, target: iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68, portal: 172.16.0.220,3260] successful.
Apr 11 15:39:21 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf090fde-b8de-4784-b316-57e80c10a242]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd498fd6-9c80-4a6c-b56d-d42ca2dabb71]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:39:21 user nova-compute[71229]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a (non-flash)
Apr 11 15:39:21 user nova-compute[71229]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 (non-flash)
Apr 11 15:39:21 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:39:21 user nova-compute[71229]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a (non-flash)
Apr 11 15:39:21 user nova-compute[71229]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 (non-flash)
Apr 11 15:39:21 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de77f5a-c083-4ab6-b92b-212c15373bab]: (4, ('- - 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:39:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gSNaBYAr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 15:39:22 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:39:22 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '26630323165373366', 'path': '/dev/sdc'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:39:22 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630323165373366', 'path': '/dev/sdc'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 15:39:22 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:37:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-794339141',display_name='tempest-ServerActionsTestJSON-server-794339141',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-794339141',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfAJGQ+GOa8zW+jlKgD9Kz6/k6iEv9pZIOIjICzcstJ92AAS94+47mc3fRsqyx5FaTMV9P4lTsW4Fy7tKIAtMpRx0Sl7sa6ttQnPbPhlcYqfbdWbTqmmKi6+BuZpqSknA==',key_name='tempest-keypair-1137963694',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:37:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bb7660e8f76b471487136806ee9eec62',ramdisk_id='',reservation_id='r-g3c0fmpg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1659503440',owner_user_name='tempest-ServerActionsTestJSON-1659503440-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:39:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10720df0ac4f4e62a0a5c9883d600add',uuid=ffce2921-d4a5-4bcb-8032-62a6dc321fb4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "910fb3d4-3965-41a2-8f97-9de79ee78c78", "address": "fa:16:3e:50:1e:37", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-665410087-network", "vif_mac": "fa:16:3e:50:1e:37"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap910fb3d4-39", "ovs_interfaceid": "910fb3d4-3965-41a2-8f97-9de79ee78c78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:39:22 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Converting VIF {"id": "910fb3d4-3965-41a2-8f97-9de79ee78c78", "address": "fa:16:3e:50:1e:37", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-665410087-network", "vif_mac": "fa:16:3e:50:1e:37"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap910fb3d4-39", "ovs_interfaceid": "910fb3d4-3965-41a2-8f97-9de79ee78c78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:39:22 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:1e:37,bridge_name='br-int',has_traffic_filtering=True,id=910fb3d4-3965-41a2-8f97-9de79ee78c78,network=Network(1bd215e8-0459-4dd2-893b-096b6e31ac08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap910fb3d4-39') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:39:22 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:39:22 user nova-compute[71229]:   <uuid>ffce2921-d4a5-4bcb-8032-62a6dc321fb4</uuid>
Apr 11 15:39:22 user nova-compute[71229]:   <name>instance-0000001e</name>
Apr 11 15:39:22 user nova-compute[71229]:   <memory>196608</memory>
Apr 11 15:39:22 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:39:22 user nova-compute[71229]:   <metadata>
Apr 11 15:39:22 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:39:22 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:39:22 user nova-compute[71229]:       <nova:name>tempest-ServerActionsTestJSON-server-794339141</nova:name>
Apr 11 15:39:22 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:39:21</nova:creationTime>
Apr 11 15:39:22 user nova-compute[71229]:       <nova:flavor name="m1.micro">
Apr 11 15:39:22 user nova-compute[71229]:         <nova:memory>192</nova:memory>
Apr 11 15:39:22 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:39:22 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:39:22 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:39:22 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:39:22 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:39:22 user nova-compute[71229]:       <nova:owner>
Apr 11 15:39:22 user nova-compute[71229]:         <nova:user uuid="10720df0ac4f4e62a0a5c9883d600add">tempest-ServerActionsTestJSON-1659503440-project-member</nova:user>
Apr 11 15:39:22 user nova-compute[71229]:         <nova:project uuid="bb7660e8f76b471487136806ee9eec62">tempest-ServerActionsTestJSON-1659503440</nova:project>
Apr 11 15:39:22 user nova-compute[71229]:       </nova:owner>
Apr 11 15:39:22 user nova-compute[71229]:       <nova:ports>
Apr 11 15:39:22 user nova-compute[71229]:         <nova:port uuid="910fb3d4-3965-41a2-8f97-9de79ee78c78">
Apr 11 15:39:22 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 11 15:39:22 user nova-compute[71229]:         </nova:port>
Apr 11 15:39:22 user nova-compute[71229]:       </nova:ports>
Apr 11 15:39:22 user nova-compute[71229]:     </nova:instance>
Apr 11 15:39:22 user nova-compute[71229]:   </metadata>
Apr 11 15:39:22 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:39:22 user nova-compute[71229]:     <system>
Apr 11 15:39:22 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:39:22 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:39:22 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:39:22 user nova-compute[71229]:       <entry name="serial">ffce2921-d4a5-4bcb-8032-62a6dc321fb4</entry>
Apr 11 15:39:22 user nova-compute[71229]:       <entry name="uuid">ffce2921-d4a5-4bcb-8032-62a6dc321fb4</entry>
Apr 11 15:39:22 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:39:22 user nova-compute[71229]:     </system>
Apr 11 15:39:22 user nova-compute[71229]:   </sysinfo>
Apr 11 15:39:22 user nova-compute[71229]:   <os>
Apr 11 15:39:22 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:39:22 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 15:39:22 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:39:22 user nova-compute[71229]:   </os>
Apr 11 15:39:22 user nova-compute[71229]:   <features>
Apr 11 15:39:22 user nova-compute[71229]:     <acpi/>
Apr 11 15:39:22 user nova-compute[71229]:     <apic/>
Apr 11 15:39:22 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:39:22 user nova-compute[71229]:   </features>
Apr 11 15:39:22 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:39:22 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:39:22 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:39:22 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:39:22 user nova-compute[71229]:   </clock>
Apr 11 15:39:22 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:39:22 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:39:22 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:39:22 user nova-compute[71229]:   </cpu>
Apr 11 15:39:22 user nova-compute[71229]:   <devices>
Apr 11 15:39:22 user nova-compute[71229]:     <disk type="block" device="disk">
Apr 11 15:39:22 user nova-compute[71229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:39:22 user nova-compute[71229]:       <source dev="/dev/sdc"/>
Apr 11 15:39:22 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:39:22 user nova-compute[71229]:       <serial>98d29c73-7b06-45f4-90e0-01a41825cc68</serial>
Apr 11 15:39:22 user nova-compute[71229]:     </disk>
Apr 11 15:39:22 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:39:22 user nova-compute[71229]:       <mac address="fa:16:3e:50:1e:37"/>
Apr 11 15:39:22 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:39:22 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:39:22 user nova-compute[71229]:       <target dev="tap910fb3d4-39"/>
Apr 11 15:39:22 user nova-compute[71229]:     </interface>
Apr 11 15:39:22 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:39:22 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/ffce2921-d4a5-4bcb-8032-62a6dc321fb4/console.log" append="off"/>
Apr 11 15:39:22 user nova-compute[71229]:     </serial>
Apr 11 15:39:22 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:39:22 user nova-compute[71229]:     <video>
Apr 11 15:39:22 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:39:22 user nova-compute[71229]:     </video>
Apr 11 15:39:22 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:39:22 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:39:22 user nova-compute[71229]:     </rng>
Apr 11 15:39:22 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:39:22 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:39:22 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:39:22 user nova-compute[71229]:     </memballoon>
Apr 11 15:39:22 user nova-compute[71229]:   </devices>
Apr 11 15:39:22 user nova-compute[71229]: </domain>
Apr 11 15:39:22 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:39:22 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:37:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-794339141',display_name='tempest-ServerActionsTestJSON-server-794339141',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-794339141',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfAJGQ+GOa8zW+jlKgD9Kz6/k6iEv9pZIOIjICzcstJ92AAS94+47mc3fRsqyx5FaTMV9P4lTsW4Fy7tKIAtMpRx0Sl7sa6ttQnPbPhlcYqfbdWbTqmmKi6+BuZpqSknA==',key_name='tempest-keypair-1137963694',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:37:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bb7660e8f76b471487136806ee9eec62',ramdisk_id='',reservation_id='r-g3c0fmpg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1659503440',owner_user_name='tempest-ServerActionsTestJSON-1659503440-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:39:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10720df0ac4f4e62a0a5c9883d600add',uuid=ffce2921-d4a5-4bcb-8032-62a6dc321fb4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "910fb3d4-3965-41a2-8f97-9de79ee78c78", "address": "fa:16:3e:50:1e:37", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-665410087-network", "vif_mac": "fa:16:3e:50:1e:37"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap910fb3d4-39", "ovs_interfaceid": "910fb3d4-3965-41a2-8f97-9de79ee78c78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:39:22 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Converting VIF {"id": "910fb3d4-3965-41a2-8f97-9de79ee78c78", "address": "fa:16:3e:50:1e:37", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-665410087-network", "vif_mac": "fa:16:3e:50:1e:37"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap910fb3d4-39", "ovs_interfaceid": "910fb3d4-3965-41a2-8f97-9de79ee78c78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:39:22 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:1e:37,bridge_name='br-int',has_traffic_filtering=True,id=910fb3d4-3965-41a2-8f97-9de79ee78c78,network=Network(1bd215e8-0459-4dd2-893b-096b6e31ac08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap910fb3d4-39') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:39:22 user nova-compute[71229]: DEBUG os_vif [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:1e:37,bridge_name='br-int',has_traffic_filtering=True,id=910fb3d4-3965-41a2-8f97-9de79ee78c78,network=Network(1bd215e8-0459-4dd2-893b-096b6e31ac08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap910fb3d4-39') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:39:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:39:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:39:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:39:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:39:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap910fb3d4-39, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:39:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap910fb3d4-39, col_values=(('external_ids', {'iface-id': '910fb3d4-3965-41a2-8f97-9de79ee78c78', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:1e:37', 'vm-uuid': 'ffce2921-d4a5-4bcb-8032-62a6dc321fb4'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:39:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:39:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:39:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:39:22 user nova-compute[71229]: INFO os_vif [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:1e:37,bridge_name='br-int',has_traffic_filtering=True,id=910fb3d4-3965-41a2-8f97-9de79ee78c78,network=Network(1bd215e8-0459-4dd2-893b-096b6e31ac08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap910fb3d4-39')
Apr 11 15:39:22 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:39:22 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] No VIF found with MAC fa:16:3e:50:1e:37, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:39:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:39:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:39:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:39:24 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:39:24 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:39:24 user nova-compute[71229]: DEBUG nova.compute.manager [req-3d899e06-9d62-4b25-850d-b1f27de9c83b req-6c23af19-2133-4d26-a250-3bfd83c8f623 service nova] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Received event network-vif-plugged-910fb3d4-3965-41a2-8f97-9de79ee78c78 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:39:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3d899e06-9d62-4b25-850d-b1f27de9c83b req-6c23af19-2133-4d26-a250-3bfd83c8f623 service nova] Acquiring lock "ffce2921-d4a5-4bcb-8032-62a6dc321fb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:39:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3d899e06-9d62-4b25-850d-b1f27de9c83b req-6c23af19-2133-4d26-a250-3bfd83c8f623 service nova] Lock "ffce2921-d4a5-4bcb-8032-62a6dc321fb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:39:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3d899e06-9d62-4b25-850d-b1f27de9c83b req-6c23af19-2133-4d26-a250-3bfd83c8f623 service nova] Lock "ffce2921-d4a5-4bcb-8032-62a6dc321fb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:39:24 user nova-compute[71229]: DEBUG nova.compute.manager [req-3d899e06-9d62-4b25-850d-b1f27de9c83b req-6c23af19-2133-4d26-a250-3bfd83c8f623 service nova] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] No waiting events found dispatching network-vif-plugged-910fb3d4-3965-41a2-8f97-9de79ee78c78 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:39:24 user nova-compute[71229]: WARNING nova.compute.manager [req-3d899e06-9d62-4b25-850d-b1f27de9c83b req-6c23af19-2133-4d26-a250-3bfd83c8f623 service nova] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Received unexpected event network-vif-plugged-910fb3d4-3965-41a2-8f97-9de79ee78c78 for instance with vm_state active and task_state resize_finish.
Apr 11 15:39:25 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Removed pending event for ffce2921-d4a5-4bcb-8032-62a6dc321fb4 due to event {{(pid=71229) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 15:39:26 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227565.9986215, ffce2921-d4a5-4bcb-8032-62a6dc321fb4 => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:39:26 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] VM Resumed (Lifecycle Event)
Apr 11 15:39:26 user nova-compute[71229]: DEBUG nova.compute.manager [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 15:39:26 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Instance running successfully.
Apr 11 15:39:26 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Failed to set time: agent not configured {{(pid=71229) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 11 15:39:26 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-e36f8922-4ceb-4e61-98db-93b3934aeb43 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] finish_migration finished successfully. {{(pid=71229) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 11 15:39:26 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:39:26 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:39:26 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 11 15:39:26 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227566.0010269, ffce2921-d4a5-4bcb-8032-62a6dc321fb4 => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:39:26 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] VM Started (Lifecycle Event)
Apr 11 15:39:26 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:39:26 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:39:26 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 11 15:39:26 user nova-compute[71229]: DEBUG nova.compute.manager [req-124a8bfc-ec8d-491c-a44e-bb102d167a0e req-430d2938-04b9-44c9-8038-b9c6b5aa98c2 service nova] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Received event network-vif-plugged-910fb3d4-3965-41a2-8f97-9de79ee78c78 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:39:26 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-124a8bfc-ec8d-491c-a44e-bb102d167a0e req-430d2938-04b9-44c9-8038-b9c6b5aa98c2 service nova] Acquiring lock "ffce2921-d4a5-4bcb-8032-62a6dc321fb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:39:26 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-124a8bfc-ec8d-491c-a44e-bb102d167a0e req-430d2938-04b9-44c9-8038-b9c6b5aa98c2 service nova] Lock "ffce2921-d4a5-4bcb-8032-62a6dc321fb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:39:26 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-124a8bfc-ec8d-491c-a44e-bb102d167a0e req-430d2938-04b9-44c9-8038-b9c6b5aa98c2 service nova] Lock "ffce2921-d4a5-4bcb-8032-62a6dc321fb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:39:26 user nova-compute[71229]: DEBUG nova.compute.manager [req-124a8bfc-ec8d-491c-a44e-bb102d167a0e req-430d2938-04b9-44c9-8038-b9c6b5aa98c2 service nova] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] No waiting events found dispatching network-vif-plugged-910fb3d4-3965-41a2-8f97-9de79ee78c78 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:39:26 user nova-compute[71229]: WARNING nova.compute.manager [req-124a8bfc-ec8d-491c-a44e-bb102d167a0e req-430d2938-04b9-44c9-8038-b9c6b5aa98c2 service nova] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Received unexpected event network-vif-plugged-910fb3d4-3965-41a2-8f97-9de79ee78c78 for instance with vm_state resized and task_state None.
Apr 11 15:39:27 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:39:27 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:39:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:39:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:39:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 15:39:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 15:39:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 15:39:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:39:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:39:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:39:38 user nova-compute[71229]: DEBUG nova.compute.manager [req-8171a9bf-2018-4d85-9a2b-97d3db740a54 req-d054e17a-6042-4ae3-a373-6a721130bd7b service nova] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Received event network-changed-19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:39:38 user nova-compute[71229]: DEBUG nova.compute.manager [req-8171a9bf-2018-4d85-9a2b-97d3db740a54 req-d054e17a-6042-4ae3-a373-6a721130bd7b service nova] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Refreshing instance network info cache due to event network-changed-19b6c9ca-9d18-4f57-9687-ce7ffde5ca53. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:39:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-8171a9bf-2018-4d85-9a2b-97d3db740a54 req-d054e17a-6042-4ae3-a373-6a721130bd7b service nova] Acquiring lock "refresh_cache-1e3d0956-d528-4097-a200-d9b2b6ce7aa8" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:39:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-8171a9bf-2018-4d85-9a2b-97d3db740a54 req-d054e17a-6042-4ae3-a373-6a721130bd7b service nova] Acquired lock "refresh_cache-1e3d0956-d528-4097-a200-d9b2b6ce7aa8" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:39:38 user nova-compute[71229]: DEBUG nova.network.neutron [req-8171a9bf-2018-4d85-9a2b-97d3db740a54 req-d054e17a-6042-4ae3-a373-6a721130bd7b service nova] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Refreshing network info cache for port 19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:39:38 user nova-compute[71229]: DEBUG nova.network.neutron [req-8171a9bf-2018-4d85-9a2b-97d3db740a54 req-d054e17a-6042-4ae3-a373-6a721130bd7b service nova] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Updated VIF entry in instance network info cache for port 19b6c9ca-9d18-4f57-9687-ce7ffde5ca53. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:39:38 user nova-compute[71229]: DEBUG nova.network.neutron [req-8171a9bf-2018-4d85-9a2b-97d3db740a54 req-d054e17a-6042-4ae3-a373-6a721130bd7b service nova] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Updating instance_info_cache with network_info: [{"id": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53", "address": "fa:16:3e:3e:55:16", "network": {"id": "b1189892-ba9d-4316-9962-c737b27f14bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1737061315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c23461a3d7ca49f6a77d3fde6f1009d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19b6c9ca-9d", "ovs_interfaceid": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:39:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-8171a9bf-2018-4d85-9a2b-97d3db740a54 req-d054e17a-6042-4ae3-a373-6a721130bd7b service nova] Releasing lock "refresh_cache-1e3d0956-d528-4097-a200-d9b2b6ce7aa8" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:39:39 user nova-compute[71229]: DEBUG nova.compute.manager [req-173b8fb2-67f9-4ff9-95ba-f8ac837571a7 req-2314a00e-486a-4779-821a-1c34cb2d1055 service nova] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Received event network-changed-19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:39:39 user nova-compute[71229]: DEBUG nova.compute.manager [req-173b8fb2-67f9-4ff9-95ba-f8ac837571a7 req-2314a00e-486a-4779-821a-1c34cb2d1055 service nova] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Refreshing instance network info cache due to event network-changed-19b6c9ca-9d18-4f57-9687-ce7ffde5ca53. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:39:39 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-173b8fb2-67f9-4ff9-95ba-f8ac837571a7 req-2314a00e-486a-4779-821a-1c34cb2d1055 service nova] Acquiring lock "refresh_cache-1e3d0956-d528-4097-a200-d9b2b6ce7aa8" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:39:39 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-173b8fb2-67f9-4ff9-95ba-f8ac837571a7 req-2314a00e-486a-4779-821a-1c34cb2d1055 service nova] Acquired lock "refresh_cache-1e3d0956-d528-4097-a200-d9b2b6ce7aa8" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:39:39 user nova-compute[71229]: DEBUG nova.network.neutron [req-173b8fb2-67f9-4ff9-95ba-f8ac837571a7 req-2314a00e-486a-4779-821a-1c34cb2d1055 service nova] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Refreshing network info cache for port 19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:39:39 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ecf5908f-4cf0-4b4b-ad02-25faa14b7799 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "1e3d0956-d528-4097-a200-d9b2b6ce7aa8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:39:39 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ecf5908f-4cf0-4b4b-ad02-25faa14b7799 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "1e3d0956-d528-4097-a200-d9b2b6ce7aa8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:39:39 user nova-compute[71229]: INFO nova.compute.manager [None req-ecf5908f-4cf0-4b4b-ad02-25faa14b7799 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Detaching volume 6119ec74-db79-4b19-9bf7-44cc8a4d853a
Apr 11 15:39:39 user nova-compute[71229]: INFO nova.virt.block_device [None req-ecf5908f-4cf0-4b4b-ad02-25faa14b7799 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Attempting to driver detach volume 6119ec74-db79-4b19-9bf7-44cc8a4d853a from mountpoint /dev/vdb
Apr 11 15:39:39 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-ecf5908f-4cf0-4b4b-ad02-25faa14b7799 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Attempting to detach device vdb from instance 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 from the persistent domain config. {{(pid=71229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 15:39:39 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-ecf5908f-4cf0-4b4b-ad02-25faa14b7799 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 15:39:39 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:39:39 user nova-compute[71229]:   <source dev="/dev/sde"/>
Apr 11 15:39:39 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 15:39:39 user nova-compute[71229]:   <serial>6119ec74-db79-4b19-9bf7-44cc8a4d853a</serial>
Apr 11 15:39:39 user nova-compute[71229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 15:39:39 user nova-compute[71229]: </disk>
Apr 11 15:39:39 user nova-compute[71229]:  {{(pid=71229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 15:39:39 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-ecf5908f-4cf0-4b4b-ad02-25faa14b7799 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Successfully detached device vdb from instance 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 from the persistent domain config.
Apr 11 15:39:39 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-ecf5908f-4cf0-4b4b-ad02-25faa14b7799 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 from the live domain config. {{(pid=71229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 15:39:39 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-ecf5908f-4cf0-4b4b-ad02-25faa14b7799 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 15:39:39 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:39:39 user nova-compute[71229]:   <source dev="/dev/sde"/>
Apr 11 15:39:39 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 15:39:39 user nova-compute[71229]:   <serial>6119ec74-db79-4b19-9bf7-44cc8a4d853a</serial>
Apr 11 15:39:39 user nova-compute[71229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 15:39:39 user nova-compute[71229]: </disk>
Apr 11 15:39:39 user nova-compute[71229]:  {{(pid=71229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 15:39:39 user nova-compute[71229]: DEBUG nova.network.neutron [req-173b8fb2-67f9-4ff9-95ba-f8ac837571a7 req-2314a00e-486a-4779-821a-1c34cb2d1055 service nova] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Updated VIF entry in instance network info cache for port 19b6c9ca-9d18-4f57-9687-ce7ffde5ca53. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:39:39 user nova-compute[71229]: DEBUG nova.network.neutron [req-173b8fb2-67f9-4ff9-95ba-f8ac837571a7 req-2314a00e-486a-4779-821a-1c34cb2d1055 service nova] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Updating instance_info_cache with network_info: [{"id": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53", "address": "fa:16:3e:3e:55:16", "network": {"id": "b1189892-ba9d-4316-9962-c737b27f14bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1737061315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c23461a3d7ca49f6a77d3fde6f1009d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19b6c9ca-9d", "ovs_interfaceid": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:39:39 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-173b8fb2-67f9-4ff9-95ba-f8ac837571a7 req-2314a00e-486a-4779-821a-1c34cb2d1055 service nova] Releasing lock "refresh_cache-1e3d0956-d528-4097-a200-d9b2b6ce7aa8" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:39:39 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Received event <DeviceRemovedEvent: 1681227579.845419, 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71229) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 15:39:39 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-ecf5908f-4cf0-4b4b-ad02-25faa14b7799 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 {{(pid=71229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 15:39:39 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-ecf5908f-4cf0-4b4b-ad02-25faa14b7799 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Successfully detached device vdb from instance 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 from the live domain config.
Apr 11 15:39:39 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecf5908f-4cf0-4b4b-ad02-25faa14b7799 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 15:39:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf5908f-4cf0-4b4b-ad02-25faa14b7799 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cvnTNDLM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:39:39 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-ecf5908f-4cf0-4b4b-ad02-25faa14b7799 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:39:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-ecf5908f-4cf0-4b4b-ad02-25faa14b7799 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:39:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-ecf5908f-4cf0-4b4b-ad02-25faa14b7799 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:39:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:39 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d229bdc-646f-4e93-9696-d7d1d2946364]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:39:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf5908f-4cf0-4b4b-ad02-25faa14b7799 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 15:39:39 user nova-compute[71229]: No targets found.
Apr 11 15:39:39 user nova-compute[71229]: iSNS:
Apr 11 15:39:39 user nova-compute[71229]: No targets found.
Apr 11 15:39:39 user nova-compute[71229]: STATIC:
Apr 11 15:39:39 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb
Apr 11 15:39:39 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:39:39 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:39:39 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a
Apr 11 15:39:39 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:39:39 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:39:39 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68
Apr 11 15:39:39 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:39:39 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:39:39 user nova-compute[71229]: FIRMWARE:
Apr 11 15:39:39 user nova-compute[71229]: No targets found.
Apr 11 15:39:39 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:39:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf5908f-4cf0-4b4b-ad02-25faa14b7799 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 15:39:39 user nova-compute[71229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 15:39:39 user nova-compute[71229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71229) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 15:39:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf5908f-4cf0-4b4b-ad02-25faa14b7799 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a', 0)] {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 15:39:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:39 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9e6854-7410-47bb-9f29-d850227cb8bd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:39:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:39 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d1d8af-2f2d-4d82-8105-8b77d1fb4976]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:39:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf5908f-4cf0-4b4b-ad02-25faa14b7799 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:39:39 user nova-compute[71229]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a (non-flash)
Apr 11 15:39:39 user nova-compute[71229]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 (non-flash)
Apr 11 15:39:39 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:39:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf5908f-4cf0-4b4b-ad02-25faa14b7799 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:39:39 user nova-compute[71229]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a (non-flash)
Apr 11 15:39:39 user nova-compute[71229]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 (non-flash)
Apr 11 15:39:39 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:39:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf5908f-4cf0-4b4b-ad02-25faa14b7799 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb64306560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a'): ({'sde'}, set())}) {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 15:39:39 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-ecf5908f-4cf0-4b4b-ad02-25faa14b7799 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Removing single pathed devices sde {{(pid=71229) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 15:39:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:39 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6692d618-fa15-4a85-9dc6-0207a4e3f513]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:39:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cada2d73-3904-489b-b2c0-6523e25577d9]: (4, ('ok\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-ecf5908f-4cf0-4b4b-ad02-25faa14b7799 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Flushing IO for device /dev/sde {{(pid=71229) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e95fd87-9f66-4f07-af30-9a05b446f73f]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-ecf5908f-4cf0-4b4b-ad02-25faa14b7799 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71229) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "b0d90fd2-6a95-43c4-8756-e82071d99154" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "b0d90fd2-6a95-43c4-8756-e82071d99154" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "b0d90fd2-6a95-43c4-8756-e82071d99154-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "b0d90fd2-6a95-43c4-8756-e82071d99154-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "b0d90fd2-6a95-43c4-8756-e82071d99154-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[83421890-abbe-4e1e-9587-3657e591f499]: (4, ('1', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-ecf5908f-4cf0-4b4b-ad02-25faa14b7799 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-ecf5908f-4cf0-4b4b-ad02-25faa14b7799 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] SCSI volumes sde have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf5908f-4cf0-4b4b-ad02-25faa14b7799 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a')] {{(pid=71229) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 15:39:40 user nova-compute[71229]: INFO nova.compute.manager [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Terminating instance
Apr 11 15:39:40 user nova-compute[71229]: DEBUG nova.compute.manager [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Start destroying the instance on the hypervisor. {{(pid=71229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09f21ac-f419-4d5f-b407-278df5922784]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf5908f-4cf0-4b4b-ad02-25faa14b7799 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a -p 172.16.0.220:3260 --logout {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a -p 172.16.0.220:3260 --logout" returned: 0 in 0.094s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1face6f-9825-4392-b202-ef049a856a63]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf5908f-4cf0-4b4b-ad02-25faa14b7799 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a, portal: 172.16.0.220,3260]
Apr 11 15:39:40 user nova-compute[71229]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a, portal: 172.16.0.220,3260] successful.
Apr 11 15:39:40 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a -p 172.16.0.220:3260 --op delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6119ec74-db79-4b19-9bf7-44cc8a4d853a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b682cc03-804b-4d68-aa91-c9721a61dd7d]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf5908f-4cf0-4b4b-ad02-25faa14b7799 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-ecf5908f-4cf0-4b4b-ad02-25faa14b7799 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf5908f-4cf0-4b4b-ad02-25faa14b7799 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] <== disconnect_volume: return (373ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecf5908f-4cf0-4b4b-ad02-25faa14b7799 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG nova.compute.manager [req-7acd6701-2ba4-42b0-b864-91f04cb5d778 req-fc98ec01-e013-4a27-9eed-a75a6d730985 service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Received event network-vif-unplugged-4718fa68-0eb9-4592-8c43-981438e3d0b8 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-7acd6701-2ba4-42b0-b864-91f04cb5d778 req-fc98ec01-e013-4a27-9eed-a75a6d730985 service nova] Acquiring lock "b0d90fd2-6a95-43c4-8756-e82071d99154-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-7acd6701-2ba4-42b0-b864-91f04cb5d778 req-fc98ec01-e013-4a27-9eed-a75a6d730985 service nova] Lock "b0d90fd2-6a95-43c4-8756-e82071d99154-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-7acd6701-2ba4-42b0-b864-91f04cb5d778 req-fc98ec01-e013-4a27-9eed-a75a6d730985 service nova] Lock "b0d90fd2-6a95-43c4-8756-e82071d99154-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG nova.compute.manager [req-7acd6701-2ba4-42b0-b864-91f04cb5d778 req-fc98ec01-e013-4a27-9eed-a75a6d730985 service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] No waiting events found dispatching network-vif-unplugged-4718fa68-0eb9-4592-8c43-981438e3d0b8 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG nova.compute.manager [req-7acd6701-2ba4-42b0-b864-91f04cb5d778 req-fc98ec01-e013-4a27-9eed-a75a6d730985 service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Received event network-vif-unplugged-4718fa68-0eb9-4592-8c43-981438e3d0b8 for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:39:40 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Instance destroyed successfully.
Apr 11 15:39:40 user nova-compute[71229]: DEBUG nova.objects.instance [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lazy-loading 'resources' on Instance uuid b0d90fd2-6a95-43c4-8756-e82071d99154 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:23:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-785051320',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-785051320',id=10,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:25:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ddc05e9bf5ab426982ccb3092ad596e4',ramdisk_id='',reservation_id='r-cxnpum04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1907753459',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:27:42Z,user_data=None,user_id='1d60ce27bfad4d7c9b976e834df35ad4',uuid=b0d90fd2-6a95-43c4-8756-e82071d99154,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4718fa68-0eb9-4592-8c43-981438e3d0b8", "address": "fa:16:3e:e4:28:3b", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4718fa68-0e", "ovs_interfaceid": "4718fa68-0eb9-4592-8c43-981438e3d0b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Converting VIF {"id": "4718fa68-0eb9-4592-8c43-981438e3d0b8", "address": "fa:16:3e:e4:28:3b", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4718fa68-0e", "ovs_interfaceid": "4718fa68-0eb9-4592-8c43-981438e3d0b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:28:3b,bridge_name='br-int',has_traffic_filtering=True,id=4718fa68-0eb9-4592-8c43-981438e3d0b8,network=Network(1cf4cec3-ff08-4320-89e4-aa7e8cf75eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4718fa68-0e') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG os_vif [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:28:3b,bridge_name='br-int',has_traffic_filtering=True,id=4718fa68-0eb9-4592-8c43-981438e3d0b8,network=Network(1cf4cec3-ff08-4320-89e4-aa7e8cf75eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4718fa68-0e') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4718fa68-0e, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:39:40 user nova-compute[71229]: INFO os_vif [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:28:3b,bridge_name='br-int',has_traffic_filtering=True,id=4718fa68-0eb9-4592-8c43-981438e3d0b8,network=Network(1cf4cec3-ff08-4320-89e4-aa7e8cf75eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4718fa68-0e')
Apr 11 15:39:40 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QxVsBWUp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:39:40 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:39:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0472bda-d16d-4d31-957b-978ca79c793b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 15:39:40 user nova-compute[71229]: No targets found.
Apr 11 15:39:40 user nova-compute[71229]: iSNS:
Apr 11 15:39:40 user nova-compute[71229]: No targets found.
Apr 11 15:39:40 user nova-compute[71229]: STATIC:
Apr 11 15:39:40 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb
Apr 11 15:39:40 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:39:40 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:39:40 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68
Apr 11 15:39:40 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:39:40 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:39:40 user nova-compute[71229]: FIRMWARE:
Apr 11 15:39:40 user nova-compute[71229]: No targets found.
Apr 11 15:39:40 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 15:39:40 user nova-compute[71229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 15:39:40 user nova-compute[71229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71229) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb', 0)] {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae7dc3a-c4e9-401a-a1f6-73adcf08aa52]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf568b2-32f3-4c7e-b806-350784d70129]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:39:40 user nova-compute[71229]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 (non-flash)
Apr 11 15:39:40 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb (non-flash)
Apr 11 15:39:40 user nova-compute[71229]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 (non-flash)
Apr 11 15:39:40 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb5c2b0d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb'): ({'sdb'}, set())}) {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Removing single pathed devices sdb {{(pid=71229) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c47718c-5709-4879-b234-b96992e365ba]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.030s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a3a61b-5b40-4697-8f0d-e974dfbda5ff]: (4, ('ok\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Flushing IO for device /dev/sdb {{(pid=71229) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 15:39:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:41 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5db1f4-3c7c-4269-92e3-6e7d6c311c86]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:39:41 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71229) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 15:39:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:41 user nova-compute[71229]: DEBUG nova.objects.instance [None req-ecf5908f-4cf0-4b4b-ad02-25faa14b7799 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lazy-loading 'flavor' on Instance uuid 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:39:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:41 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd11b766-9309-42b7-b420-81563f94d454]: (4, ('1', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:39:41 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 15:39:41 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] SCSI volumes sdb have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 15:39:41 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb')] {{(pid=71229) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 15:39:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:41 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6349c0-33ef-4c7e-9475-77289d06e679]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:39:41 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:39:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb -p 172.16.0.220:3260 --logout {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ecf5908f-4cf0-4b4b-ad02-25faa14b7799 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "1e3d0956-d528-4097-a200-d9b2b6ce7aa8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.764s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:39:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:41 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5356eea-330f-4f9c-bd3e-3f988e8ee973]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:39:41 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb, portal: 172.16.0.220,3260]
Apr 11 15:39:41 user nova-compute[71229]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb, portal: 172.16.0.220,3260] successful.
Apr 11 15:39:41 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:39:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb -p 172.16.0.220:3260 --op delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:39:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65c1d870-4696-4892-9abe-b305824a04eb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:39:41 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2beb56e9-e4e8-478e-8c21-711f849c5b94]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:39:41 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:39:41 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:39:41 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] <== disconnect_volume: return (316ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:39:41 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 15:39:41 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Deleting instance files /opt/stack/data/nova/instances/b0d90fd2-6a95-43c4-8756-e82071d99154_del
Apr 11 15:39:41 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Deletion of /opt/stack/data/nova/instances/b0d90fd2-6a95-43c4-8756-e82071d99154_del complete
Apr 11 15:39:41 user nova-compute[71229]: INFO nova.compute.manager [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Took 1.14 seconds to destroy the instance on the hypervisor.
Apr 11 15:39:41 user nova-compute[71229]: DEBUG oslo.service.loopingcall [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71229) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 15:39:41 user nova-compute[71229]: DEBUG nova.compute.manager [-] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Deallocating network for instance {{(pid=71229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 15:39:41 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] deallocate_for_instance() {{(pid=71229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 15:39:41 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:39:41 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Took 0.43 seconds to deallocate network for instance.
Apr 11 15:39:42 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:39:42 user nova-compute[71229]: DEBUG nova.compute.manager [req-8b81022c-7ba7-4ec8-bccf-853d75925eaf req-67e1d5b1-bb5f-49b7-b744-dbeb25f82944 service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Received event network-vif-plugged-4718fa68-0eb9-4592-8c43-981438e3d0b8 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:39:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-8b81022c-7ba7-4ec8-bccf-853d75925eaf req-67e1d5b1-bb5f-49b7-b744-dbeb25f82944 service nova] Acquiring lock "b0d90fd2-6a95-43c4-8756-e82071d99154-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:39:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-8b81022c-7ba7-4ec8-bccf-853d75925eaf req-67e1d5b1-bb5f-49b7-b744-dbeb25f82944 service nova] Lock "b0d90fd2-6a95-43c4-8756-e82071d99154-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:39:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-8b81022c-7ba7-4ec8-bccf-853d75925eaf req-67e1d5b1-bb5f-49b7-b744-dbeb25f82944 service nova] Lock "b0d90fd2-6a95-43c4-8756-e82071d99154-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:39:42 user nova-compute[71229]: DEBUG nova.compute.manager [req-8b81022c-7ba7-4ec8-bccf-853d75925eaf req-67e1d5b1-bb5f-49b7-b744-dbeb25f82944 service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] No waiting events found dispatching network-vif-plugged-4718fa68-0eb9-4592-8c43-981438e3d0b8 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:39:42 user nova-compute[71229]: WARNING nova.compute.manager [req-8b81022c-7ba7-4ec8-bccf-853d75925eaf req-67e1d5b1-bb5f-49b7-b744-dbeb25f82944 service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Received unexpected event network-vif-plugged-4718fa68-0eb9-4592-8c43-981438e3d0b8 for instance with vm_state active and task_state deleting.
Apr 11 15:39:42 user nova-compute[71229]: DEBUG nova.compute.manager [req-8b81022c-7ba7-4ec8-bccf-853d75925eaf req-67e1d5b1-bb5f-49b7-b744-dbeb25f82944 service nova] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Received event network-vif-deleted-4718fa68-0eb9-4592-8c43-981438e3d0b8 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:39:42 user nova-compute[71229]: INFO nova.compute.manager [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Took 0.79 seconds to detach 1 volumes for instance.
Apr 11 15:39:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:39:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:39:42 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:39:42 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:39:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.287s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:39:42 user nova-compute[71229]: INFO nova.scheduler.client.report [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Deleted allocations for instance b0d90fd2-6a95-43c4-8756-e82071d99154
Apr 11 15:39:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f328cad7-827f-4f9b-8d3a-88f2a4d60268 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "b0d90fd2-6a95-43c4-8756-e82071d99154" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.857s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:39:45 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:39:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:39:50 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:39:52 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:39:55 user nova-compute[71229]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681227580.8131797, b0d90fd2-6a95-43c4-8756-e82071d99154 => Stopped> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:39:55 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] VM Stopped (Lifecycle Event)
Apr 11 15:39:55 user nova-compute[71229]: DEBUG nova.compute.manager [None req-7c947b7a-7b96-423b-955c-4d8f17513264 None None] [instance: b0d90fd2-6a95-43c4-8756-e82071d99154] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:39:55 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:40:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:40:01 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:40:01 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 15:40:05 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:40:05 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 15:40:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "refresh_cache-dcbfcbfd-7e96-4271-94ee-60ef937e3b7e" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:40:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquired lock "refresh_cache-dcbfcbfd-7e96-4271-94ee-60ef937e3b7e" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:40:05 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Forcefully refreshing network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 15:40:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:40:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:40:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 15:40:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 15:40:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 15:40:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:40:06 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Updating instance_info_cache with network_info: [{"id": "32c006ee-14e2-47d8-b999-bafc729aa67a", "address": "fa:16:3e:1a:bd:54", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c006ee-14", "ovs_interfaceid": "32c006ee-14e2-47d8-b999-bafc729aa67a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:40:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Releasing lock "refresh_cache-dcbfcbfd-7e96-4271-94ee-60ef937e3b7e" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:40:06 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Updated the network info_cache for instance {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 15:40:06 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:40:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:40:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:40:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:40:06 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 15:40:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:40:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:40:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:40:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:40:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:40:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:40:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:40:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:40:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:40:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:40:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:40:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:40:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:40:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:40:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:40:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:40:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:40:07 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:40:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:40:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:40:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:40:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:40:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:40:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:40:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:40:08 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e3d0956-d528-4097-a200-d9b2b6ce7aa8/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:40:08 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:40:08 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:40:08 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8311MB free_disk=25.94719696044922GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 15:40:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:40:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:40:08 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Applying migration context for instance ffce2921-d4a5-4bcb-8032-62a6dc321fb4 as it has an incoming, in-progress migration 71b2eb17-0495-4112-b141-1e859cc7b24b. Migration status is finished {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 11 15:40:08 user nova-compute[71229]: INFO nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Updating resource usage from migration 71b2eb17-0495-4112-b141-1e859cc7b24b
Apr 11 15:40:08 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance de1a45fd-27be-4438-80a4-2f3a100643c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:40:08 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance dcbfcbfd-7e96-4271-94ee-60ef937e3b7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:40:08 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:40:08 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 6f6ae64a-c760-4ba3-8a50-d380835d9913 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:40:08 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 058df5ba-07ab-4bdd-9a47-907e7b0e0e59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:40:08 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Migration 71b2eb17-0495-4112-b141-1e859cc7b24b is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 11 15:40:08 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance ffce2921-d4a5-4bcb-8032-62a6dc321fb4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:40:08 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 15:40:08 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=1472MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 15:40:08 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:40:08 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:40:08 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 15:40:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.404s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:40:09 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:40:09 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:40:09 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:40:09 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:40:10 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:40:10 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:40:10 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:40:15 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:40:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:40:20 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:40:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:40:30 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-2fdc7c2d-1f6d-4763-af76-99e921fd1cf0 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "de1a45fd-27be-4438-80a4-2f3a100643c9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:40:30 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-2fdc7c2d-1f6d-4763-af76-99e921fd1cf0 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "de1a45fd-27be-4438-80a4-2f3a100643c9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:40:30 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-2fdc7c2d-1f6d-4763-af76-99e921fd1cf0 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "de1a45fd-27be-4438-80a4-2f3a100643c9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:40:30 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-2fdc7c2d-1f6d-4763-af76-99e921fd1cf0 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "de1a45fd-27be-4438-80a4-2f3a100643c9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:40:30 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-2fdc7c2d-1f6d-4763-af76-99e921fd1cf0 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "de1a45fd-27be-4438-80a4-2f3a100643c9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:40:30 user nova-compute[71229]: INFO nova.compute.manager [None req-2fdc7c2d-1f6d-4763-af76-99e921fd1cf0 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Terminating instance
Apr 11 15:40:30 user nova-compute[71229]: DEBUG nova.compute.manager [None req-2fdc7c2d-1f6d-4763-af76-99e921fd1cf0 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Start destroying the instance on the hypervisor. {{(pid=71229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 15:40:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:40:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:40:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:40:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:40:30 user nova-compute[71229]: DEBUG nova.compute.manager [req-6e49cc92-fae6-4e2a-8a8b-e233786e229d req-9be6239c-5ed8-433c-8957-356b86b551c0 service nova] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Received event network-vif-unplugged-197ae974-459a-49ab-9d70-89bfaa073f50 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:40:30 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-6e49cc92-fae6-4e2a-8a8b-e233786e229d req-9be6239c-5ed8-433c-8957-356b86b551c0 service nova] Acquiring lock "de1a45fd-27be-4438-80a4-2f3a100643c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:40:30 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-6e49cc92-fae6-4e2a-8a8b-e233786e229d req-9be6239c-5ed8-433c-8957-356b86b551c0 service nova] Lock "de1a45fd-27be-4438-80a4-2f3a100643c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:40:30 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-6e49cc92-fae6-4e2a-8a8b-e233786e229d req-9be6239c-5ed8-433c-8957-356b86b551c0 service nova] Lock "de1a45fd-27be-4438-80a4-2f3a100643c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:40:30 user nova-compute[71229]: DEBUG nova.compute.manager [req-6e49cc92-fae6-4e2a-8a8b-e233786e229d req-9be6239c-5ed8-433c-8957-356b86b551c0 service nova] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] No waiting events found dispatching network-vif-unplugged-197ae974-459a-49ab-9d70-89bfaa073f50 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:40:30 user nova-compute[71229]: DEBUG nova.compute.manager [req-6e49cc92-fae6-4e2a-8a8b-e233786e229d req-9be6239c-5ed8-433c-8957-356b86b551c0 service nova] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Received event network-vif-unplugged-197ae974-459a-49ab-9d70-89bfaa073f50 for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 15:40:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b8f47a2d-6acb-41ed-89a6-b4d23a2b5c7e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "1e3d0956-d528-4097-a200-d9b2b6ce7aa8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:40:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b8f47a2d-6acb-41ed-89a6-b4d23a2b5c7e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "1e3d0956-d528-4097-a200-d9b2b6ce7aa8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:40:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b8f47a2d-6acb-41ed-89a6-b4d23a2b5c7e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "1e3d0956-d528-4097-a200-d9b2b6ce7aa8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:40:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b8f47a2d-6acb-41ed-89a6-b4d23a2b5c7e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "1e3d0956-d528-4097-a200-d9b2b6ce7aa8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:40:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b8f47a2d-6acb-41ed-89a6-b4d23a2b5c7e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "1e3d0956-d528-4097-a200-d9b2b6ce7aa8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:40:31 user nova-compute[71229]: INFO nova.compute.manager [None req-b8f47a2d-6acb-41ed-89a6-b4d23a2b5c7e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Terminating instance
Apr 11 15:40:31 user nova-compute[71229]: DEBUG nova.compute.manager [None req-b8f47a2d-6acb-41ed-89a6-b4d23a2b5c7e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Start destroying the instance on the hypervisor. {{(pid=71229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 15:40:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:40:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:40:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:40:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:40:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:40:31 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Instance destroyed successfully.
Apr 11 15:40:31 user nova-compute[71229]: DEBUG nova.objects.instance [None req-2fdc7c2d-1f6d-4763-af76-99e921fd1cf0 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lazy-loading 'resources' on Instance uuid de1a45fd-27be-4438-80a4-2f3a100643c9 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:40:31 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-2fdc7c2d-1f6d-4763-af76-99e921fd1cf0 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:20:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1804245774',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1804245774',id=1,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:21:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ddc05e9bf5ab426982ccb3092ad596e4',ramdisk_id='',reservation_id='r-0s0qo2m2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1907753459',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:22:52Z,user_data=None,user_id='1d60ce27bfad4d7c9b976e834df35ad4',uuid=de1a45fd-27be-4438-80a4-2f3a100643c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "197ae974-459a-49ab-9d70-89bfaa073f50", "address": "fa:16:3e:03:bb:91", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ae974-45", "ovs_interfaceid": "197ae974-459a-49ab-9d70-89bfaa073f50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:40:31 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-2fdc7c2d-1f6d-4763-af76-99e921fd1cf0 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Converting VIF {"id": "197ae974-459a-49ab-9d70-89bfaa073f50", "address": "fa:16:3e:03:bb:91", "network": {"id": "1cf4cec3-ff08-4320-89e4-aa7e8cf75eef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-467318876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddc05e9bf5ab426982ccb3092ad596e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ae974-45", "ovs_interfaceid": "197ae974-459a-49ab-9d70-89bfaa073f50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:40:31 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-2fdc7c2d-1f6d-4763-af76-99e921fd1cf0 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:bb:91,bridge_name='br-int',has_traffic_filtering=True,id=197ae974-459a-49ab-9d70-89bfaa073f50,network=Network(1cf4cec3-ff08-4320-89e4-aa7e8cf75eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap197ae974-45') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:40:31 user nova-compute[71229]: DEBUG os_vif [None req-2fdc7c2d-1f6d-4763-af76-99e921fd1cf0 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:bb:91,bridge_name='br-int',has_traffic_filtering=True,id=197ae974-459a-49ab-9d70-89bfaa073f50,network=Network(1cf4cec3-ff08-4320-89e4-aa7e8cf75eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap197ae974-45') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:40:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:40:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap197ae974-45, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:40:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:40:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:40:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:40:31 user nova-compute[71229]: INFO os_vif [None req-2fdc7c2d-1f6d-4763-af76-99e921fd1cf0 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:bb:91,bridge_name='br-int',has_traffic_filtering=True,id=197ae974-459a-49ab-9d70-89bfaa073f50,network=Network(1cf4cec3-ff08-4320-89e4-aa7e8cf75eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap197ae974-45')
Apr 11 15:40:31 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-2fdc7c2d-1f6d-4763-af76-99e921fd1cf0 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Deleting instance files /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9_del
Apr 11 15:40:31 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-2fdc7c2d-1f6d-4763-af76-99e921fd1cf0 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Deletion of /opt/stack/data/nova/instances/de1a45fd-27be-4438-80a4-2f3a100643c9_del complete
Apr 11 15:40:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:40:31 user nova-compute[71229]: INFO nova.compute.manager [None req-2fdc7c2d-1f6d-4763-af76-99e921fd1cf0 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Took 0.68 seconds to destroy the instance on the hypervisor.
Apr 11 15:40:31 user nova-compute[71229]: DEBUG oslo.service.loopingcall [None req-2fdc7c2d-1f6d-4763-af76-99e921fd1cf0 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71229) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 15:40:31 user nova-compute[71229]: DEBUG nova.compute.manager [-] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Deallocating network for instance {{(pid=71229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 15:40:31 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] deallocate_for_instance() {{(pid=71229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 15:40:31 user nova-compute[71229]: DEBUG nova.compute.manager [req-2cd98944-9eaa-4ca0-84b0-b9c57c09c34f req-d148e4e0-bcf1-455f-abc5-689b9ba735e8 service nova] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Received event network-vif-unplugged-19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:40:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2cd98944-9eaa-4ca0-84b0-b9c57c09c34f req-d148e4e0-bcf1-455f-abc5-689b9ba735e8 service nova] Acquiring lock "1e3d0956-d528-4097-a200-d9b2b6ce7aa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:40:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2cd98944-9eaa-4ca0-84b0-b9c57c09c34f req-d148e4e0-bcf1-455f-abc5-689b9ba735e8 service nova] Lock "1e3d0956-d528-4097-a200-d9b2b6ce7aa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:40:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2cd98944-9eaa-4ca0-84b0-b9c57c09c34f req-d148e4e0-bcf1-455f-abc5-689b9ba735e8 service nova] Lock "1e3d0956-d528-4097-a200-d9b2b6ce7aa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:40:31 user nova-compute[71229]: DEBUG nova.compute.manager [req-2cd98944-9eaa-4ca0-84b0-b9c57c09c34f req-d148e4e0-bcf1-455f-abc5-689b9ba735e8 service nova] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] No waiting events found dispatching network-vif-unplugged-19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:40:31 user nova-compute[71229]: DEBUG nova.compute.manager [req-2cd98944-9eaa-4ca0-84b0-b9c57c09c34f req-d148e4e0-bcf1-455f-abc5-689b9ba735e8 service nova] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Received event network-vif-unplugged-19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 15:40:32 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Instance destroyed successfully.
Apr 11 15:40:32 user nova-compute[71229]: DEBUG nova.objects.instance [None req-b8f47a2d-6acb-41ed-89a6-b4d23a2b5c7e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lazy-loading 'resources' on Instance uuid 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:40:32 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:40:32 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-b8f47a2d-6acb-41ed-89a6-b4d23a2b5c7e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:35:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1775975364',display_name='tempest-TestMinimumBasicScenario-server-1775975364',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1775975364',id=27,image_ref='eef769ca-4518-48cc-8f9b-15f43146d184',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCX38V29uKqq32pbrXcHfjwmsz6kzESDeVl6gqbOhAcULXo21SBTbxQJXUQHaV8PJeMjZRs4D5UehvHzvnc4jeUpiLPu2JFq1xh2/XZqKhiBdFrsxTD5c6W9I6S8vZoQ6A==',key_name='tempest-TestMinimumBasicScenario-1861021757',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:35:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c23461a3d7ca49f6a77d3fde6f1009d3',ramdisk_id='',reservation_id='r-20z6o102',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eef769ca-4518-48cc-8f9b-15f43146d184',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-673773229',owner_user_name='tempest-TestMinimumBasicScenario-673773229-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:37:56Z,user_data=None,user_id='044f17aee3324b3a97bebe935548b3b4',uuid=1e3d0956-d528-4097-a200-d9b2b6ce7aa8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53", "address": "fa:16:3e:3e:55:16", "network": {"id": "b1189892-ba9d-4316-9962-c737b27f14bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1737061315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c23461a3d7ca49f6a77d3fde6f1009d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19b6c9ca-9d", "ovs_interfaceid": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:40:32 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-b8f47a2d-6acb-41ed-89a6-b4d23a2b5c7e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Converting VIF {"id": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53", "address": "fa:16:3e:3e:55:16", "network": {"id": "b1189892-ba9d-4316-9962-c737b27f14bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1737061315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c23461a3d7ca49f6a77d3fde6f1009d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19b6c9ca-9d", "ovs_interfaceid": "19b6c9ca-9d18-4f57-9687-ce7ffde5ca53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:40:32 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-b8f47a2d-6acb-41ed-89a6-b4d23a2b5c7e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:55:16,bridge_name='br-int',has_traffic_filtering=True,id=19b6c9ca-9d18-4f57-9687-ce7ffde5ca53,network=Network(b1189892-ba9d-4316-9962-c737b27f14bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19b6c9ca-9d') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:40:32 user nova-compute[71229]: DEBUG os_vif [None req-b8f47a2d-6acb-41ed-89a6-b4d23a2b5c7e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:55:16,bridge_name='br-int',has_traffic_filtering=True,id=19b6c9ca-9d18-4f57-9687-ce7ffde5ca53,network=Network(b1189892-ba9d-4316-9962-c737b27f14bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19b6c9ca-9d') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:40:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:40:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap19b6c9ca-9d, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:40:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:40:32 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Took 0.64 seconds to deallocate network for instance.
Apr 11 15:40:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:40:32 user nova-compute[71229]: INFO os_vif [None req-b8f47a2d-6acb-41ed-89a6-b4d23a2b5c7e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:55:16,bridge_name='br-int',has_traffic_filtering=True,id=19b6c9ca-9d18-4f57-9687-ce7ffde5ca53,network=Network(b1189892-ba9d-4316-9962-c737b27f14bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19b6c9ca-9d')
Apr 11 15:40:32 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-b8f47a2d-6acb-41ed-89a6-b4d23a2b5c7e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Deleting instance files /opt/stack/data/nova/instances/1e3d0956-d528-4097-a200-d9b2b6ce7aa8_del
Apr 11 15:40:32 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-b8f47a2d-6acb-41ed-89a6-b4d23a2b5c7e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Deletion of /opt/stack/data/nova/instances/1e3d0956-d528-4097-a200-d9b2b6ce7aa8_del complete
Apr 11 15:40:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-2fdc7c2d-1f6d-4763-af76-99e921fd1cf0 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:40:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-2fdc7c2d-1f6d-4763-af76-99e921fd1cf0 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:40:32 user nova-compute[71229]: INFO nova.compute.manager [None req-b8f47a2d-6acb-41ed-89a6-b4d23a2b5c7e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Took 0.91 seconds to destroy the instance on the hypervisor.
Apr 11 15:40:32 user nova-compute[71229]: DEBUG oslo.service.loopingcall [None req-b8f47a2d-6acb-41ed-89a6-b4d23a2b5c7e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71229) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 15:40:32 user nova-compute[71229]: DEBUG nova.compute.manager [-] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Deallocating network for instance {{(pid=71229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 15:40:32 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] deallocate_for_instance() {{(pid=71229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 15:40:32 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-2fdc7c2d-1f6d-4763-af76-99e921fd1cf0 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:40:32 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-2fdc7c2d-1f6d-4763-af76-99e921fd1cf0 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:40:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-2fdc7c2d-1f6d-4763-af76-99e921fd1cf0 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.268s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:40:32 user nova-compute[71229]: INFO nova.scheduler.client.report [None req-2fdc7c2d-1f6d-4763-af76-99e921fd1cf0 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Deleted allocations for instance de1a45fd-27be-4438-80a4-2f3a100643c9
Apr 11 15:40:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-2fdc7c2d-1f6d-4763-af76-99e921fd1cf0 tempest-ServerBootFromVolumeStableRescueTest-1907753459 tempest-ServerBootFromVolumeStableRescueTest-1907753459-project-member] Lock "de1a45fd-27be-4438-80a4-2f3a100643c9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.764s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:40:32 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:40:32 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Took 0.43 seconds to deallocate network for instance.
Apr 11 15:40:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b8f47a2d-6acb-41ed-89a6-b4d23a2b5c7e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:40:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b8f47a2d-6acb-41ed-89a6-b4d23a2b5c7e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:40:32 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-b8f47a2d-6acb-41ed-89a6-b4d23a2b5c7e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:40:32 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-b8f47a2d-6acb-41ed-89a6-b4d23a2b5c7e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:40:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b8f47a2d-6acb-41ed-89a6-b4d23a2b5c7e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.209s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:40:32 user nova-compute[71229]: INFO nova.scheduler.client.report [None req-b8f47a2d-6acb-41ed-89a6-b4d23a2b5c7e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Deleted allocations for instance 1e3d0956-d528-4097-a200-d9b2b6ce7aa8
Apr 11 15:40:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b8f47a2d-6acb-41ed-89a6-b4d23a2b5c7e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "1e3d0956-d528-4097-a200-d9b2b6ce7aa8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.715s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:40:33 user nova-compute[71229]: DEBUG nova.compute.manager [req-7e14d949-987e-4adc-b111-9085a67bd1f7 req-8a02ce6f-3b76-47ae-a739-dcb41b0dfe74 service nova] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Received event network-vif-plugged-197ae974-459a-49ab-9d70-89bfaa073f50 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:40:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-7e14d949-987e-4adc-b111-9085a67bd1f7 req-8a02ce6f-3b76-47ae-a739-dcb41b0dfe74 service nova] Acquiring lock "de1a45fd-27be-4438-80a4-2f3a100643c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:40:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-7e14d949-987e-4adc-b111-9085a67bd1f7 req-8a02ce6f-3b76-47ae-a739-dcb41b0dfe74 service nova] Lock "de1a45fd-27be-4438-80a4-2f3a100643c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:40:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-7e14d949-987e-4adc-b111-9085a67bd1f7 req-8a02ce6f-3b76-47ae-a739-dcb41b0dfe74 service nova] Lock "de1a45fd-27be-4438-80a4-2f3a100643c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:40:33 user nova-compute[71229]: DEBUG nova.compute.manager [req-7e14d949-987e-4adc-b111-9085a67bd1f7 req-8a02ce6f-3b76-47ae-a739-dcb41b0dfe74 service nova] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] No waiting events found dispatching network-vif-plugged-197ae974-459a-49ab-9d70-89bfaa073f50 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:40:33 user nova-compute[71229]: WARNING nova.compute.manager [req-7e14d949-987e-4adc-b111-9085a67bd1f7 req-8a02ce6f-3b76-47ae-a739-dcb41b0dfe74 service nova] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Received unexpected event network-vif-plugged-197ae974-459a-49ab-9d70-89bfaa073f50 for instance with vm_state deleted and task_state None.
Apr 11 15:40:33 user nova-compute[71229]: DEBUG nova.compute.manager [req-032e60ba-7cd3-45dd-8b53-51c685dfb025 req-fcd161ea-3dab-4969-a20b-cdd9a1d3718f service nova] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Received event network-vif-plugged-19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:40:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-032e60ba-7cd3-45dd-8b53-51c685dfb025 req-fcd161ea-3dab-4969-a20b-cdd9a1d3718f service nova] Acquiring lock "1e3d0956-d528-4097-a200-d9b2b6ce7aa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:40:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-032e60ba-7cd3-45dd-8b53-51c685dfb025 req-fcd161ea-3dab-4969-a20b-cdd9a1d3718f service nova] Lock "1e3d0956-d528-4097-a200-d9b2b6ce7aa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:40:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-032e60ba-7cd3-45dd-8b53-51c685dfb025 req-fcd161ea-3dab-4969-a20b-cdd9a1d3718f service nova] Lock "1e3d0956-d528-4097-a200-d9b2b6ce7aa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:40:33 user nova-compute[71229]: DEBUG nova.compute.manager [req-032e60ba-7cd3-45dd-8b53-51c685dfb025 req-fcd161ea-3dab-4969-a20b-cdd9a1d3718f service nova] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] No waiting events found dispatching network-vif-plugged-19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:40:33 user nova-compute[71229]: WARNING nova.compute.manager [req-032e60ba-7cd3-45dd-8b53-51c685dfb025 req-fcd161ea-3dab-4969-a20b-cdd9a1d3718f service nova] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Received unexpected event network-vif-plugged-19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 for instance with vm_state deleted and task_state None.
Apr 11 15:40:33 user nova-compute[71229]: DEBUG nova.compute.manager [req-032e60ba-7cd3-45dd-8b53-51c685dfb025 req-fcd161ea-3dab-4969-a20b-cdd9a1d3718f service nova] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Received event network-vif-deleted-197ae974-459a-49ab-9d70-89bfaa073f50 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:40:33 user nova-compute[71229]: DEBUG nova.compute.manager [req-032e60ba-7cd3-45dd-8b53-51c685dfb025 req-fcd161ea-3dab-4969-a20b-cdd9a1d3718f service nova] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Received event network-vif-deleted-19b6c9ca-9d18-4f57-9687-ce7ffde5ca53 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:40:35 user nova-compute[71229]: INFO nova.compute.manager [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Rescuing
Apr 11 15:40:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "refresh_cache-6f6ae64a-c760-4ba3-8a50-d380835d9913" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:40:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquired lock "refresh_cache-6f6ae64a-c760-4ba3-8a50-d380835d9913" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:40:35 user nova-compute[71229]: DEBUG nova.network.neutron [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:40:35 user nova-compute[71229]: DEBUG nova.network.neutron [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Updating instance_info_cache with network_info: [{"id": "2b891eeb-973f-492a-9059-55961bb956bf", "address": "fa:16:3e:97:b1:ae", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b891eeb-97", "ovs_interfaceid": "2b891eeb-973f-492a-9059-55961bb956bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:40:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Releasing lock "refresh_cache-6f6ae64a-c760-4ba3-8a50-d380835d9913" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:40:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:40:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:40:36 user nova-compute[71229]: DEBUG nova.compute.manager [req-8cb50e40-1ecf-4f4a-8feb-fdecf33dfe28 req-4e93f559-46fb-4b22-9761-14e70a6c043f service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Received event network-vif-unplugged-2b891eeb-973f-492a-9059-55961bb956bf {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:40:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-8cb50e40-1ecf-4f4a-8feb-fdecf33dfe28 req-4e93f559-46fb-4b22-9761-14e70a6c043f service nova] Acquiring lock "6f6ae64a-c760-4ba3-8a50-d380835d9913-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:40:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-8cb50e40-1ecf-4f4a-8feb-fdecf33dfe28 req-4e93f559-46fb-4b22-9761-14e70a6c043f service nova] Lock "6f6ae64a-c760-4ba3-8a50-d380835d9913-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:40:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-8cb50e40-1ecf-4f4a-8feb-fdecf33dfe28 req-4e93f559-46fb-4b22-9761-14e70a6c043f service nova] Lock "6f6ae64a-c760-4ba3-8a50-d380835d9913-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:40:36 user nova-compute[71229]: DEBUG nova.compute.manager [req-8cb50e40-1ecf-4f4a-8feb-fdecf33dfe28 req-4e93f559-46fb-4b22-9761-14e70a6c043f service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] No waiting events found dispatching network-vif-unplugged-2b891eeb-973f-492a-9059-55961bb956bf {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:40:36 user nova-compute[71229]: WARNING nova.compute.manager [req-8cb50e40-1ecf-4f4a-8feb-fdecf33dfe28 req-4e93f559-46fb-4b22-9761-14e70a6c043f service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Received unexpected event network-vif-unplugged-2b891eeb-973f-492a-9059-55961bb956bf for instance with vm_state active and task_state rescuing.
Apr 11 15:40:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:40:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:40:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:40:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:40:36 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Instance destroyed successfully.
Apr 11 15:40:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:40:36 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Attempting rescue
Apr 11 15:40:36 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71229) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 11 15:40:36 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Instance directory exists: not creating {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 15:40:36 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Creating image(s)
Apr 11 15:40:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "/opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:40:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "/opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:40:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "/opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:40:36 user nova-compute[71229]: DEBUG nova.objects.instance [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6f6ae64a-c760-4ba3-8a50-d380835d9913 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:40:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:40:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:40:36 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:40:36 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.148s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:40:36 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk.rescue {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:40:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:40:36 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk.rescue" returned: 0 in 0.058s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:40:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:40:36 user nova-compute[71229]: DEBUG nova.objects.instance [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lazy-loading 'migration_context' on Instance uuid 6f6ae64a-c760-4ba3-8a50-d380835d9913 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:40:36 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Created local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 15:40:36 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Start _get_guest_xml network_info=[{"id": "2b891eeb-973f-492a-9059-55961bb956bf", "address": "fa:16:3e:97:b1:ae", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "vif_mac": "fa:16:3e:97:b1:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b891eeb-97", "ovs_interfaceid": "2b891eeb-973f-492a-9059-55961bb956bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '52fe638c-5ada-47d5-b376-233bfa808a37', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:40:36 user nova-compute[71229]: DEBUG nova.objects.instance [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lazy-loading 'resources' on Instance uuid 6f6ae64a-c760-4ba3-8a50-d380835d9913 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:40:36 user nova-compute[71229]: DEBUG nova.objects.instance [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lazy-loading 'numa_topology' on Instance uuid 6f6ae64a-c760-4ba3-8a50-d380835d9913 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:40:36 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:40:36 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:40:36 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:40:36 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:40:36 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:40:36 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:40:36 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:40:36 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:40:36 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:40:36 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:40:36 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:40:36 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:40:36 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:40:36 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:40:36 user nova-compute[71229]: DEBUG nova.objects.instance [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6f6ae64a-c760-4ba3-8a50-d380835d9913 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:40:36 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:35:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1967250041',display_name='tempest-ServerRescueNegativeTestJSON-server-1967250041',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1967250041',id=28,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:36:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d700a53aa25849e0afd562b05881d09a',ramdisk_id='',reservation_id='r-467thbtg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1491000769',owner_user_name='tempest-ServerRescueNegativeTestJSON-1491000769-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:36:00Z,user_data=None,user_id='5c8492f96e5d4f54aaae3679c82b6759',uuid=6f6ae64a-c760-4ba3-8a50-d380835d9913,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b891eeb-973f-492a-9059-55961bb956bf", "address": "fa:16:3e:97:b1:ae", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "vif_mac": "fa:16:3e:97:b1:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b891eeb-97", "ovs_interfaceid": "2b891eeb-973f-492a-9059-55961bb956bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:40:36 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Converting VIF {"id": "2b891eeb-973f-492a-9059-55961bb956bf", "address": "fa:16:3e:97:b1:ae", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "vif_mac": "fa:16:3e:97:b1:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b891eeb-97", "ovs_interfaceid": "2b891eeb-973f-492a-9059-55961bb956bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:40:36 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:b1:ae,bridge_name='br-int',has_traffic_filtering=True,id=2b891eeb-973f-492a-9059-55961bb956bf,network=Network(7ba20249-9c62-46d7-810c-8144c1a1f17e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b891eeb-97') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:40:36 user nova-compute[71229]: DEBUG nova.objects.instance [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f6ae64a-c760-4ba3-8a50-d380835d9913 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:40:36 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:40:36 user nova-compute[71229]:   <uuid>6f6ae64a-c760-4ba3-8a50-d380835d9913</uuid>
Apr 11 15:40:36 user nova-compute[71229]:   <name>instance-0000001c</name>
Apr 11 15:40:36 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:40:36 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:40:36 user nova-compute[71229]:   <metadata>
Apr 11 15:40:36 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:40:36 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:40:36 user nova-compute[71229]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1967250041</nova:name>
Apr 11 15:40:36 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:40:36</nova:creationTime>
Apr 11 15:40:36 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:40:36 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:40:36 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:40:36 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:40:36 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:40:36 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:40:36 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:40:36 user nova-compute[71229]:       <nova:owner>
Apr 11 15:40:36 user nova-compute[71229]:         <nova:user uuid="5c8492f96e5d4f54aaae3679c82b6759">tempest-ServerRescueNegativeTestJSON-1491000769-project-member</nova:user>
Apr 11 15:40:36 user nova-compute[71229]:         <nova:project uuid="d700a53aa25849e0afd562b05881d09a">tempest-ServerRescueNegativeTestJSON-1491000769</nova:project>
Apr 11 15:40:36 user nova-compute[71229]:       </nova:owner>
Apr 11 15:40:36 user nova-compute[71229]:       <nova:root type="image" uuid="52fe638c-5ada-47d5-b376-233bfa808a37"/>
Apr 11 15:40:36 user nova-compute[71229]:       <nova:ports>
Apr 11 15:40:36 user nova-compute[71229]:         <nova:port uuid="2b891eeb-973f-492a-9059-55961bb956bf">
Apr 11 15:40:36 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 11 15:40:36 user nova-compute[71229]:         </nova:port>
Apr 11 15:40:36 user nova-compute[71229]:       </nova:ports>
Apr 11 15:40:36 user nova-compute[71229]:     </nova:instance>
Apr 11 15:40:36 user nova-compute[71229]:   </metadata>
Apr 11 15:40:36 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:40:36 user nova-compute[71229]:     <system>
Apr 11 15:40:36 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:40:36 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:40:36 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:40:36 user nova-compute[71229]:       <entry name="serial">6f6ae64a-c760-4ba3-8a50-d380835d9913</entry>
Apr 11 15:40:36 user nova-compute[71229]:       <entry name="uuid">6f6ae64a-c760-4ba3-8a50-d380835d9913</entry>
Apr 11 15:40:36 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:40:36 user nova-compute[71229]:     </system>
Apr 11 15:40:36 user nova-compute[71229]:   </sysinfo>
Apr 11 15:40:36 user nova-compute[71229]:   <os>
Apr 11 15:40:36 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:40:36 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:40:36 user nova-compute[71229]:   </os>
Apr 11 15:40:36 user nova-compute[71229]:   <features>
Apr 11 15:40:36 user nova-compute[71229]:     <acpi/>
Apr 11 15:40:36 user nova-compute[71229]:     <apic/>
Apr 11 15:40:36 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:40:36 user nova-compute[71229]:   </features>
Apr 11 15:40:36 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:40:36 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:40:36 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:40:36 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:40:36 user nova-compute[71229]:   </clock>
Apr 11 15:40:36 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:40:36 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:40:36 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:40:36 user nova-compute[71229]:   </cpu>
Apr 11 15:40:36 user nova-compute[71229]:   <devices>
Apr 11 15:40:36 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 15:40:36 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 15:40:36 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk.rescue"/>
Apr 11 15:40:36 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:40:36 user nova-compute[71229]:     </disk>
Apr 11 15:40:36 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 15:40:36 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 15:40:36 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk"/>
Apr 11 15:40:36 user nova-compute[71229]:       <target dev="vdb" bus="virtio"/>
Apr 11 15:40:36 user nova-compute[71229]:     </disk>
Apr 11 15:40:36 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:40:36 user nova-compute[71229]:       <mac address="fa:16:3e:97:b1:ae"/>
Apr 11 15:40:36 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:40:36 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:40:36 user nova-compute[71229]:       <target dev="tap2b891eeb-97"/>
Apr 11 15:40:36 user nova-compute[71229]:     </interface>
Apr 11 15:40:36 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:40:36 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/console.log" append="off"/>
Apr 11 15:40:36 user nova-compute[71229]:     </serial>
Apr 11 15:40:36 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:40:36 user nova-compute[71229]:     <video>
Apr 11 15:40:36 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:40:36 user nova-compute[71229]:     </video>
Apr 11 15:40:36 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:40:36 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:40:36 user nova-compute[71229]:     </rng>
Apr 11 15:40:36 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:40:36 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:40:36 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:40:36 user nova-compute[71229]:     </memballoon>
Apr 11 15:40:36 user nova-compute[71229]:   </devices>
Apr 11 15:40:36 user nova-compute[71229]: </domain>
Apr 11 15:40:36 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:40:37 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Instance destroyed successfully.
Apr 11 15:40:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:40:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:40:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:40:37 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:40:37 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:40:37 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] No VIF found with MAC fa:16:3e:97:b1:ae, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:40:38 user nova-compute[71229]: DEBUG nova.compute.manager [req-2d2b2b0a-5a4c-4d00-9f82-f2ce9312d705 req-d791a04a-c426-45f6-97a7-3e1233fd816d service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Received event network-vif-plugged-2b891eeb-973f-492a-9059-55961bb956bf {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:40:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2d2b2b0a-5a4c-4d00-9f82-f2ce9312d705 req-d791a04a-c426-45f6-97a7-3e1233fd816d service nova] Acquiring lock "6f6ae64a-c760-4ba3-8a50-d380835d9913-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:40:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2d2b2b0a-5a4c-4d00-9f82-f2ce9312d705 req-d791a04a-c426-45f6-97a7-3e1233fd816d service nova] Lock "6f6ae64a-c760-4ba3-8a50-d380835d9913-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:40:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2d2b2b0a-5a4c-4d00-9f82-f2ce9312d705 req-d791a04a-c426-45f6-97a7-3e1233fd816d service nova] Lock "6f6ae64a-c760-4ba3-8a50-d380835d9913-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:40:38 user nova-compute[71229]: DEBUG nova.compute.manager [req-2d2b2b0a-5a4c-4d00-9f82-f2ce9312d705 req-d791a04a-c426-45f6-97a7-3e1233fd816d service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] No waiting events found dispatching network-vif-plugged-2b891eeb-973f-492a-9059-55961bb956bf {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:40:38 user nova-compute[71229]: WARNING nova.compute.manager [req-2d2b2b0a-5a4c-4d00-9f82-f2ce9312d705 req-d791a04a-c426-45f6-97a7-3e1233fd816d service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Received unexpected event network-vif-plugged-2b891eeb-973f-492a-9059-55961bb956bf for instance with vm_state active and task_state rescuing.
Apr 11 15:40:38 user nova-compute[71229]: DEBUG nova.compute.manager [req-2d2b2b0a-5a4c-4d00-9f82-f2ce9312d705 req-d791a04a-c426-45f6-97a7-3e1233fd816d service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Received event network-vif-plugged-2b891eeb-973f-492a-9059-55961bb956bf {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:40:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2d2b2b0a-5a4c-4d00-9f82-f2ce9312d705 req-d791a04a-c426-45f6-97a7-3e1233fd816d service nova] Acquiring lock "6f6ae64a-c760-4ba3-8a50-d380835d9913-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:40:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2d2b2b0a-5a4c-4d00-9f82-f2ce9312d705 req-d791a04a-c426-45f6-97a7-3e1233fd816d service nova] Lock "6f6ae64a-c760-4ba3-8a50-d380835d9913-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:40:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2d2b2b0a-5a4c-4d00-9f82-f2ce9312d705 req-d791a04a-c426-45f6-97a7-3e1233fd816d service nova] Lock "6f6ae64a-c760-4ba3-8a50-d380835d9913-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:40:38 user nova-compute[71229]: DEBUG nova.compute.manager [req-2d2b2b0a-5a4c-4d00-9f82-f2ce9312d705 req-d791a04a-c426-45f6-97a7-3e1233fd816d service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] No waiting events found dispatching network-vif-plugged-2b891eeb-973f-492a-9059-55961bb956bf {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:40:38 user nova-compute[71229]: WARNING nova.compute.manager [req-2d2b2b0a-5a4c-4d00-9f82-f2ce9312d705 req-d791a04a-c426-45f6-97a7-3e1233fd816d service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Received unexpected event network-vif-plugged-2b891eeb-973f-492a-9059-55961bb956bf for instance with vm_state active and task_state rescuing.
Apr 11 15:40:38 user nova-compute[71229]: DEBUG nova.compute.manager [req-2d2b2b0a-5a4c-4d00-9f82-f2ce9312d705 req-d791a04a-c426-45f6-97a7-3e1233fd816d service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Received event network-vif-plugged-2b891eeb-973f-492a-9059-55961bb956bf {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:40:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2d2b2b0a-5a4c-4d00-9f82-f2ce9312d705 req-d791a04a-c426-45f6-97a7-3e1233fd816d service nova] Acquiring lock "6f6ae64a-c760-4ba3-8a50-d380835d9913-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:40:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2d2b2b0a-5a4c-4d00-9f82-f2ce9312d705 req-d791a04a-c426-45f6-97a7-3e1233fd816d service nova] Lock "6f6ae64a-c760-4ba3-8a50-d380835d9913-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:40:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2d2b2b0a-5a4c-4d00-9f82-f2ce9312d705 req-d791a04a-c426-45f6-97a7-3e1233fd816d service nova] Lock "6f6ae64a-c760-4ba3-8a50-d380835d9913-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:40:38 user nova-compute[71229]: DEBUG nova.compute.manager [req-2d2b2b0a-5a4c-4d00-9f82-f2ce9312d705 req-d791a04a-c426-45f6-97a7-3e1233fd816d service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] No waiting events found dispatching network-vif-plugged-2b891eeb-973f-492a-9059-55961bb956bf {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:40:38 user nova-compute[71229]: WARNING nova.compute.manager [req-2d2b2b0a-5a4c-4d00-9f82-f2ce9312d705 req-d791a04a-c426-45f6-97a7-3e1233fd816d service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Received unexpected event network-vif-plugged-2b891eeb-973f-492a-9059-55961bb956bf for instance with vm_state active and task_state rescuing.
Apr 11 15:40:38 user nova-compute[71229]: DEBUG nova.compute.manager [req-2d2b2b0a-5a4c-4d00-9f82-f2ce9312d705 req-d791a04a-c426-45f6-97a7-3e1233fd816d service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Received event network-vif-unplugged-2b891eeb-973f-492a-9059-55961bb956bf {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:40:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2d2b2b0a-5a4c-4d00-9f82-f2ce9312d705 req-d791a04a-c426-45f6-97a7-3e1233fd816d service nova] Acquiring lock "6f6ae64a-c760-4ba3-8a50-d380835d9913-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:40:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2d2b2b0a-5a4c-4d00-9f82-f2ce9312d705 req-d791a04a-c426-45f6-97a7-3e1233fd816d service nova] Lock "6f6ae64a-c760-4ba3-8a50-d380835d9913-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:40:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2d2b2b0a-5a4c-4d00-9f82-f2ce9312d705 req-d791a04a-c426-45f6-97a7-3e1233fd816d service nova] Lock "6f6ae64a-c760-4ba3-8a50-d380835d9913-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:40:38 user nova-compute[71229]: DEBUG nova.compute.manager [req-2d2b2b0a-5a4c-4d00-9f82-f2ce9312d705 req-d791a04a-c426-45f6-97a7-3e1233fd816d service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] No waiting events found dispatching network-vif-unplugged-2b891eeb-973f-492a-9059-55961bb956bf {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:40:38 user nova-compute[71229]: WARNING nova.compute.manager [req-2d2b2b0a-5a4c-4d00-9f82-f2ce9312d705 req-d791a04a-c426-45f6-97a7-3e1233fd816d service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Received unexpected event network-vif-unplugged-2b891eeb-973f-492a-9059-55961bb956bf for instance with vm_state active and task_state rescuing.
Apr 11 15:40:38 user nova-compute[71229]: DEBUG nova.compute.manager [req-2d2b2b0a-5a4c-4d00-9f82-f2ce9312d705 req-d791a04a-c426-45f6-97a7-3e1233fd816d service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Received event network-vif-plugged-2b891eeb-973f-492a-9059-55961bb956bf {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:40:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2d2b2b0a-5a4c-4d00-9f82-f2ce9312d705 req-d791a04a-c426-45f6-97a7-3e1233fd816d service nova] Acquiring lock "6f6ae64a-c760-4ba3-8a50-d380835d9913-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:40:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2d2b2b0a-5a4c-4d00-9f82-f2ce9312d705 req-d791a04a-c426-45f6-97a7-3e1233fd816d service nova] Lock "6f6ae64a-c760-4ba3-8a50-d380835d9913-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:40:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2d2b2b0a-5a4c-4d00-9f82-f2ce9312d705 req-d791a04a-c426-45f6-97a7-3e1233fd816d service nova] Lock "6f6ae64a-c760-4ba3-8a50-d380835d9913-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:40:38 user nova-compute[71229]: DEBUG nova.compute.manager [req-2d2b2b0a-5a4c-4d00-9f82-f2ce9312d705 req-d791a04a-c426-45f6-97a7-3e1233fd816d service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] No waiting events found dispatching network-vif-plugged-2b891eeb-973f-492a-9059-55961bb956bf {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:40:38 user nova-compute[71229]: WARNING nova.compute.manager [req-2d2b2b0a-5a4c-4d00-9f82-f2ce9312d705 req-d791a04a-c426-45f6-97a7-3e1233fd816d service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Received unexpected event network-vif-plugged-2b891eeb-973f-492a-9059-55961bb956bf for instance with vm_state active and task_state rescuing.
Apr 11 15:40:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:40:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:40:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:40:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:40:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:40:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:40:40 user nova-compute[71229]: DEBUG nova.compute.manager [req-4dd05e25-a488-443f-9c55-e505abbf0eea req-3aa1b89e-8193-4376-b8fd-b16223f5d1ab service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Received event network-vif-plugged-2b891eeb-973f-492a-9059-55961bb956bf {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:40:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4dd05e25-a488-443f-9c55-e505abbf0eea req-3aa1b89e-8193-4376-b8fd-b16223f5d1ab service nova] Acquiring lock "6f6ae64a-c760-4ba3-8a50-d380835d9913-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:40:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4dd05e25-a488-443f-9c55-e505abbf0eea req-3aa1b89e-8193-4376-b8fd-b16223f5d1ab service nova] Lock "6f6ae64a-c760-4ba3-8a50-d380835d9913-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:40:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4dd05e25-a488-443f-9c55-e505abbf0eea req-3aa1b89e-8193-4376-b8fd-b16223f5d1ab service nova] Lock "6f6ae64a-c760-4ba3-8a50-d380835d9913-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:40:40 user nova-compute[71229]: DEBUG nova.compute.manager [req-4dd05e25-a488-443f-9c55-e505abbf0eea req-3aa1b89e-8193-4376-b8fd-b16223f5d1ab service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] No waiting events found dispatching network-vif-plugged-2b891eeb-973f-492a-9059-55961bb956bf {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:40:40 user nova-compute[71229]: WARNING nova.compute.manager [req-4dd05e25-a488-443f-9c55-e505abbf0eea req-3aa1b89e-8193-4376-b8fd-b16223f5d1ab service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Received unexpected event network-vif-plugged-2b891eeb-973f-492a-9059-55961bb956bf for instance with vm_state active and task_state rescuing.
Apr 11 15:40:40 user nova-compute[71229]: DEBUG nova.compute.manager [req-4dd05e25-a488-443f-9c55-e505abbf0eea req-3aa1b89e-8193-4376-b8fd-b16223f5d1ab service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Received event network-vif-plugged-2b891eeb-973f-492a-9059-55961bb956bf {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:40:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4dd05e25-a488-443f-9c55-e505abbf0eea req-3aa1b89e-8193-4376-b8fd-b16223f5d1ab service nova] Acquiring lock "6f6ae64a-c760-4ba3-8a50-d380835d9913-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:40:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4dd05e25-a488-443f-9c55-e505abbf0eea req-3aa1b89e-8193-4376-b8fd-b16223f5d1ab service nova] Lock "6f6ae64a-c760-4ba3-8a50-d380835d9913-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:40:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4dd05e25-a488-443f-9c55-e505abbf0eea req-3aa1b89e-8193-4376-b8fd-b16223f5d1ab service nova] Lock "6f6ae64a-c760-4ba3-8a50-d380835d9913-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:40:40 user nova-compute[71229]: DEBUG nova.compute.manager [req-4dd05e25-a488-443f-9c55-e505abbf0eea req-3aa1b89e-8193-4376-b8fd-b16223f5d1ab service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] No waiting events found dispatching network-vif-plugged-2b891eeb-973f-492a-9059-55961bb956bf {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:40:40 user nova-compute[71229]: WARNING nova.compute.manager [req-4dd05e25-a488-443f-9c55-e505abbf0eea req-3aa1b89e-8193-4376-b8fd-b16223f5d1ab service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Received unexpected event network-vif-plugged-2b891eeb-973f-492a-9059-55961bb956bf for instance with vm_state active and task_state rescuing.
Apr 11 15:40:40 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Removed pending event for 6f6ae64a-c760-4ba3-8a50-d380835d9913 due to event {{(pid=71229) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 15:40:40 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227640.5489888, 6f6ae64a-c760-4ba3-8a50-d380835d9913 => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:40:40 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] VM Resumed (Lifecycle Event)
Apr 11 15:40:40 user nova-compute[71229]: DEBUG nova.compute.manager [None req-88b9700a-5c37-410c-b8aa-3623efaa969f tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:40:40 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:40:40 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:40:40 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 11 15:40:40 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227640.5530217, 6f6ae64a-c760-4ba3-8a50-d380835d9913 => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:40:40 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] VM Started (Lifecycle Event)
Apr 11 15:40:40 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:40:40 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:40:42 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:40:42 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:40:46 user nova-compute[71229]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681227631.2881653, de1a45fd-27be-4438-80a4-2f3a100643c9 => Stopped> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:40:46 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] VM Stopped (Lifecycle Event)
Apr 11 15:40:46 user nova-compute[71229]: DEBUG nova.compute.manager [None req-4773c9f8-0303-4a6c-a665-b4134f97e95d None None] [instance: de1a45fd-27be-4438-80a4-2f3a100643c9] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:40:47 user nova-compute[71229]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681227632.020528, 1e3d0956-d528-4097-a200-d9b2b6ce7aa8 => Stopped> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:40:47 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] VM Stopped (Lifecycle Event)
Apr 11 15:40:47 user nova-compute[71229]: DEBUG nova.compute.manager [None req-3aa9eaa2-6bd0-45c6-9fd4-0d6918e5ccb0 None None] [instance: 1e3d0956-d528-4097-a200-d9b2b6ce7aa8] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:40:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:40:52 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:40:52 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:40:52 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 15:40:52 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 15:40:52 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 15:40:52 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:40:57 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:40:57 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:40:57 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 15:40:57 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 15:40:57 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 15:40:57 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:40:57 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:41:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-e752e989-7612-4ca6-a088-443658688663 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ffce2921-d4a5-4bcb-8032-62a6dc321fb4" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:41:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-e752e989-7612-4ca6-a088-443658688663 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ffce2921-d4a5-4bcb-8032-62a6dc321fb4" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:41:00 user nova-compute[71229]: DEBUG nova.compute.manager [None req-e752e989-7612-4ca6-a088-443658688663 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Going to confirm migration 2 {{(pid=71229) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4663}}
Apr 11 15:41:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-e752e989-7612-4ca6-a088-443658688663 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "refresh_cache-ffce2921-d4a5-4bcb-8032-62a6dc321fb4" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:41:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-e752e989-7612-4ca6-a088-443658688663 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquired lock "refresh_cache-ffce2921-d4a5-4bcb-8032-62a6dc321fb4" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:41:01 user nova-compute[71229]: DEBUG nova.network.neutron [None req-e752e989-7612-4ca6-a088-443658688663 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:41:01 user nova-compute[71229]: DEBUG nova.objects.instance [None req-e752e989-7612-4ca6-a088-443658688663 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lazy-loading 'info_cache' on Instance uuid ffce2921-d4a5-4bcb-8032-62a6dc321fb4 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:41:01 user nova-compute[71229]: DEBUG nova.network.neutron [None req-e752e989-7612-4ca6-a088-443658688663 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Updating instance_info_cache with network_info: [{"id": "910fb3d4-3965-41a2-8f97-9de79ee78c78", "address": "fa:16:3e:50:1e:37", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap910fb3d4-39", "ovs_interfaceid": "910fb3d4-3965-41a2-8f97-9de79ee78c78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:41:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-e752e989-7612-4ca6-a088-443658688663 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Releasing lock "refresh_cache-ffce2921-d4a5-4bcb-8032-62a6dc321fb4" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:41:01 user nova-compute[71229]: DEBUG nova.objects.instance [None req-e752e989-7612-4ca6-a088-443658688663 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lazy-loading 'migration_context' on Instance uuid ffce2921-d4a5-4bcb-8032-62a6dc321fb4 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:41:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-e752e989-7612-4ca6-a088-443658688663 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:41:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-e752e989-7612-4ca6-a088-443658688663 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:41:01 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-e752e989-7612-4ca6-a088-443658688663 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:41:01 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-e752e989-7612-4ca6-a088-443658688663 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:41:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-e752e989-7612-4ca6-a088-443658688663 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.241s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:41:02 user nova-compute[71229]: INFO nova.scheduler.client.report [None req-e752e989-7612-4ca6-a088-443658688663 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Deleted allocation for migration 71b2eb17-0495-4112-b141-1e859cc7b24b
Apr 11 15:41:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:41:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:41:02 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-e752e989-7612-4ca6-a088-443658688663 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ffce2921-d4a5-4bcb-8032-62a6dc321fb4" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.185s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:41:03 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:41:03 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 15:41:06 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:41:06 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:41:06 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:41:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:41:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:41:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:41:06 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 15:41:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:41:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:41:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:41:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:41:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:41:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:41:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:41:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:41:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:41:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:41:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:41:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:41:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:41:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:41:07 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:41:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk.rescue --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:41:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk.rescue --force-share --output=json" returned: 0 in 0.154s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:41:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk.rescue --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:41:08 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:41:08 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:41:08 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:41:08 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:41:08 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:41:08 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:41:08 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:41:08 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8466MB free_disk=26.037944793701172GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 15:41:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:41:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:41:08 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance dcbfcbfd-7e96-4271-94ee-60ef937e3b7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:41:08 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 6f6ae64a-c760-4ba3-8a50-d380835d9913 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:41:08 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 058df5ba-07ab-4bdd-9a47-907e7b0e0e59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:41:08 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance ffce2921-d4a5-4bcb-8032-62a6dc321fb4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:41:08 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 15:41:08 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=1088MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 15:41:08 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:41:08 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:41:09 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 15:41:09 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.281s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:41:10 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:41:10 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 15:41:10 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "refresh_cache-6f6ae64a-c760-4ba3-8a50-d380835d9913" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:41:10 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquired lock "refresh_cache-6f6ae64a-c760-4ba3-8a50-d380835d9913" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:41:10 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Forcefully refreshing network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 15:41:10 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Updating instance_info_cache with network_info: [{"id": "2b891eeb-973f-492a-9059-55961bb956bf", "address": "fa:16:3e:97:b1:ae", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b891eeb-97", "ovs_interfaceid": "2b891eeb-973f-492a-9059-55961bb956bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:41:10 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Releasing lock "refresh_cache-6f6ae64a-c760-4ba3-8a50-d380835d9913" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:41:10 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Updated the network info_cache for instance {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 15:41:10 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:41:10 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:41:10 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:41:10 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:41:12 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:41:16 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:41:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:41:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:41:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 15:41:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 15:41:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 15:41:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:41:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:41:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:41:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 15:41:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 15:41:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 15:41:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:41:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:41:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:41:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:41:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:41:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:41:25 user nova-compute[71229]: DEBUG nova.compute.manager [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Starting instance... {{(pid=71229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 15:41:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:41:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:41:25 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 15:41:25 user nova-compute[71229]: INFO nova.compute.claims [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Claim successful on node user
Apr 11 15:41:25 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:41:25 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:41:26 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.294s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:41:26 user nova-compute[71229]: DEBUG nova.compute.manager [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Start building networks asynchronously for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 15:41:26 user nova-compute[71229]: DEBUG nova.compute.manager [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Allocating IP information in the background. {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 15:41:26 user nova-compute[71229]: DEBUG nova.network.neutron [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] allocate_for_instance() {{(pid=71229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 15:41:26 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 15:41:26 user nova-compute[71229]: DEBUG nova.compute.manager [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Start building block device mappings for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 15:41:26 user nova-compute[71229]: DEBUG nova.compute.manager [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Start spawning the instance on the hypervisor. {{(pid=71229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 15:41:26 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Creating instance directory {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 15:41:26 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Creating image(s)
Apr 11 15:41:26 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "/opt/stack/data/nova/instances/8e816ce5-4da8-4366-9fa1-c33a45ba87fd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:41:26 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "/opt/stack/data/nova/instances/8e816ce5-4da8-4366-9fa1-c33a45ba87fd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:41:26 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "/opt/stack/data/nova/instances/8e816ce5-4da8-4366-9fa1-c33a45ba87fd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:41:26 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "0c1309c913e910f94bada2b43edf82abdb5aa65b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:41:26 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "0c1309c913e910f94bada2b43edf82abdb5aa65b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:41:26 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0c1309c913e910f94bada2b43edf82abdb5aa65b.part --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:41:26 user nova-compute[71229]: DEBUG nova.policy [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '044f17aee3324b3a97bebe935548b3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23461a3d7ca49f6a77d3fde6f1009d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71229) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 15:41:26 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0c1309c913e910f94bada2b43edf82abdb5aa65b.part --force-share --output=json" returned: 0 in 0.138s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:41:26 user nova-compute[71229]: DEBUG nova.virt.images [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] 549c0060-ec14-4185-b1e7-cc908fe9383a was qcow2, converting to raw {{(pid=71229) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 15:41:26 user nova-compute[71229]: DEBUG nova.privsep.utils [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71229) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 15:41:26 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0c1309c913e910f94bada2b43edf82abdb5aa65b.part /opt/stack/data/nova/instances/_base/0c1309c913e910f94bada2b43edf82abdb5aa65b.converted {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:41:27 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:41:27 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0c1309c913e910f94bada2b43edf82abdb5aa65b.part /opt/stack/data/nova/instances/_base/0c1309c913e910f94bada2b43edf82abdb5aa65b.converted" returned: 0 in 0.170s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:41:27 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0c1309c913e910f94bada2b43edf82abdb5aa65b.converted --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:41:27 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0c1309c913e910f94bada2b43edf82abdb5aa65b.converted --force-share --output=json" returned: 0 in 0.151s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:41:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "0c1309c913e910f94bada2b43edf82abdb5aa65b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.022s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:41:27 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0c1309c913e910f94bada2b43edf82abdb5aa65b --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:41:27 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0c1309c913e910f94bada2b43edf82abdb5aa65b --force-share --output=json" returned: 0 in 0.141s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:41:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "0c1309c913e910f94bada2b43edf82abdb5aa65b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:41:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "0c1309c913e910f94bada2b43edf82abdb5aa65b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:41:27 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0c1309c913e910f94bada2b43edf82abdb5aa65b --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:41:27 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0c1309c913e910f94bada2b43edf82abdb5aa65b --force-share --output=json" returned: 0 in 0.145s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:41:27 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0c1309c913e910f94bada2b43edf82abdb5aa65b,backing_fmt=raw /opt/stack/data/nova/instances/8e816ce5-4da8-4366-9fa1-c33a45ba87fd/disk 1073741824 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:41:27 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0c1309c913e910f94bada2b43edf82abdb5aa65b,backing_fmt=raw /opt/stack/data/nova/instances/8e816ce5-4da8-4366-9fa1-c33a45ba87fd/disk 1073741824" returned: 0 in 0.050s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:41:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "0c1309c913e910f94bada2b43edf82abdb5aa65b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:41:27 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0c1309c913e910f94bada2b43edf82abdb5aa65b --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:41:27 user nova-compute[71229]: DEBUG nova.network.neutron [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Successfully created port: 7f4d2694-64e4-4dd0-af87-84d67de89287 {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 15:41:27 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0c1309c913e910f94bada2b43edf82abdb5aa65b --force-share --output=json" returned: 0 in 0.141s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:41:27 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8e816ce5-4da8-4366-9fa1-c33a45ba87fd/disk. size=1073741824 {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 15:41:27 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e816ce5-4da8-4366-9fa1-c33a45ba87fd/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:41:28 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e816ce5-4da8-4366-9fa1-c33a45ba87fd/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:41:28 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Cannot resize image /opt/stack/data/nova/instances/8e816ce5-4da8-4366-9fa1-c33a45ba87fd/disk to a smaller size. {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 15:41:28 user nova-compute[71229]: DEBUG nova.objects.instance [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lazy-loading 'migration_context' on Instance uuid 8e816ce5-4da8-4366-9fa1-c33a45ba87fd {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:41:28 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Created local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 15:41:28 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Ensure instance console log exists: /opt/stack/data/nova/instances/8e816ce5-4da8-4366-9fa1-c33a45ba87fd/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 15:41:28 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:41:28 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:41:28 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:41:28 user nova-compute[71229]: DEBUG nova.network.neutron [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Successfully updated port: 7f4d2694-64e4-4dd0-af87-84d67de89287 {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:41:28 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "refresh_cache-8e816ce5-4da8-4366-9fa1-c33a45ba87fd" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:41:28 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquired lock "refresh_cache-8e816ce5-4da8-4366-9fa1-c33a45ba87fd" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:41:28 user nova-compute[71229]: DEBUG nova.network.neutron [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:41:28 user nova-compute[71229]: DEBUG nova.compute.manager [req-58da0d1d-8c2a-4a40-99fa-d516425b269b req-cd137ee0-203d-49a8-ad5c-146a106cd9bb service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Received event network-changed-7f4d2694-64e4-4dd0-af87-84d67de89287 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:41:28 user nova-compute[71229]: DEBUG nova.compute.manager [req-58da0d1d-8c2a-4a40-99fa-d516425b269b req-cd137ee0-203d-49a8-ad5c-146a106cd9bb service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Refreshing instance network info cache due to event network-changed-7f4d2694-64e4-4dd0-af87-84d67de89287. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:41:28 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-58da0d1d-8c2a-4a40-99fa-d516425b269b req-cd137ee0-203d-49a8-ad5c-146a106cd9bb service nova] Acquiring lock "refresh_cache-8e816ce5-4da8-4366-9fa1-c33a45ba87fd" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:41:28 user nova-compute[71229]: DEBUG nova.network.neutron [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:41:29 user nova-compute[71229]: DEBUG nova.network.neutron [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Updating instance_info_cache with network_info: [{"id": "7f4d2694-64e4-4dd0-af87-84d67de89287", "address": "fa:16:3e:29:f1:87", "network": {"id": "b1189892-ba9d-4316-9962-c737b27f14bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1737061315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c23461a3d7ca49f6a77d3fde6f1009d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f4d2694-64", "ovs_interfaceid": "7f4d2694-64e4-4dd0-af87-84d67de89287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:41:29 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Releasing lock "refresh_cache-8e816ce5-4da8-4366-9fa1-c33a45ba87fd" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:41:29 user nova-compute[71229]: DEBUG nova.compute.manager [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Instance network_info: |[{"id": "7f4d2694-64e4-4dd0-af87-84d67de89287", "address": "fa:16:3e:29:f1:87", "network": {"id": "b1189892-ba9d-4316-9962-c737b27f14bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1737061315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c23461a3d7ca49f6a77d3fde6f1009d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f4d2694-64", "ovs_interfaceid": "7f4d2694-64e4-4dd0-af87-84d67de89287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 15:41:29 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-58da0d1d-8c2a-4a40-99fa-d516425b269b req-cd137ee0-203d-49a8-ad5c-146a106cd9bb service nova] Acquired lock "refresh_cache-8e816ce5-4da8-4366-9fa1-c33a45ba87fd" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:41:29 user nova-compute[71229]: DEBUG nova.network.neutron [req-58da0d1d-8c2a-4a40-99fa-d516425b269b req-cd137ee0-203d-49a8-ad5c-146a106cd9bb service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Refreshing network info cache for port 7f4d2694-64e4-4dd0-af87-84d67de89287 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:41:29 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Start _get_guest_xml network_info=[{"id": "7f4d2694-64e4-4dd0-af87-84d67de89287", "address": "fa:16:3e:29:f1:87", "network": {"id": "b1189892-ba9d-4316-9962-c737b27f14bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1737061315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c23461a3d7ca49f6a77d3fde6f1009d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f4d2694-64", "ovs_interfaceid": "7f4d2694-64e4-4dd0-af87-84d67de89287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:41:23Z,direct_url=<?>,disk_format='qcow2',id=549c0060-ec14-4185-b1e7-cc908fe9383a,min_disk=0,min_ram=0,name='tempest-scenario-img--1594948934',owner='c23461a3d7ca49f6a77d3fde6f1009d3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:41:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '549c0060-ec14-4185-b1e7-cc908fe9383a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:41:29 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:41:29 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:41:29 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:41:29 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:41:23Z,direct_url=<?>,disk_format='qcow2',id=549c0060-ec14-4185-b1e7-cc908fe9383a,min_disk=0,min_ram=0,name='tempest-scenario-img--1594948934',owner='c23461a3d7ca49f6a77d3fde6f1009d3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:41:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:41:29 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:41:29 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:41:29 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:41:29 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:41:29 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:41:29 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:41:29 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:41:29 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:41:29 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:41:29 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:41:29 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:41:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-658332042',display_name='tempest-TestMinimumBasicScenario-server-658332042',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-658332042',id=31,image_ref='549c0060-ec14-4185-b1e7-cc908fe9383a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEi4e2JA/PL1tAOhcKlKt8FTH71kaR0W8XoERLXcyazkBigSjzY+dpYEFC9a+OYtBKc4ccV+zmtRPE4sE6bLSGB//HIVXoOcZ03OattPC2GZ2XpT9tuqlDYpxg3EGGGEOg==',key_name='tempest-TestMinimumBasicScenario-476755655',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c23461a3d7ca49f6a77d3fde6f1009d3',ramdisk_id='',reservation_id='r-vjgzwdqb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549c0060-ec14-4185-b1e7-cc908fe9383a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-673773229',owner_user_name='tempest-TestMinimumBasicScenario-673773229-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:41:26Z,user_data=None,user_id='044f17aee3324b3a97bebe935548b3b4',uuid=8e816ce5-4da8-4366-9fa1-c33a45ba87fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f4d2694-64e4-4dd0-af87-84d67de89287", "address": "fa:16:3e:29:f1:87", "network": {"id": "b1189892-ba9d-4316-9962-c737b27f14bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1737061315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c23461a3d7ca49f6a77d3fde6f1009d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f4d2694-64", "ovs_interfaceid": "7f4d2694-64e4-4dd0-af87-84d67de89287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:41:29 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Converting VIF {"id": "7f4d2694-64e4-4dd0-af87-84d67de89287", "address": "fa:16:3e:29:f1:87", "network": {"id": "b1189892-ba9d-4316-9962-c737b27f14bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1737061315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c23461a3d7ca49f6a77d3fde6f1009d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f4d2694-64", "ovs_interfaceid": "7f4d2694-64e4-4dd0-af87-84d67de89287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:41:29 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:f1:87,bridge_name='br-int',has_traffic_filtering=True,id=7f4d2694-64e4-4dd0-af87-84d67de89287,network=Network(b1189892-ba9d-4316-9962-c737b27f14bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f4d2694-64') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:41:29 user nova-compute[71229]: DEBUG nova.objects.instance [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e816ce5-4da8-4366-9fa1-c33a45ba87fd {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:41:29 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:41:29 user nova-compute[71229]:   <uuid>8e816ce5-4da8-4366-9fa1-c33a45ba87fd</uuid>
Apr 11 15:41:29 user nova-compute[71229]:   <name>instance-0000001f</name>
Apr 11 15:41:29 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:41:29 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:41:29 user nova-compute[71229]:   <metadata>
Apr 11 15:41:29 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:41:29 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:41:29 user nova-compute[71229]:       <nova:name>tempest-TestMinimumBasicScenario-server-658332042</nova:name>
Apr 11 15:41:29 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:41:29</nova:creationTime>
Apr 11 15:41:29 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:41:29 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:41:29 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:41:29 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:41:29 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:41:29 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:41:29 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:41:29 user nova-compute[71229]:       <nova:owner>
Apr 11 15:41:29 user nova-compute[71229]:         <nova:user uuid="044f17aee3324b3a97bebe935548b3b4">tempest-TestMinimumBasicScenario-673773229-project-member</nova:user>
Apr 11 15:41:29 user nova-compute[71229]:         <nova:project uuid="c23461a3d7ca49f6a77d3fde6f1009d3">tempest-TestMinimumBasicScenario-673773229</nova:project>
Apr 11 15:41:29 user nova-compute[71229]:       </nova:owner>
Apr 11 15:41:29 user nova-compute[71229]:       <nova:root type="image" uuid="549c0060-ec14-4185-b1e7-cc908fe9383a"/>
Apr 11 15:41:29 user nova-compute[71229]:       <nova:ports>
Apr 11 15:41:29 user nova-compute[71229]:         <nova:port uuid="7f4d2694-64e4-4dd0-af87-84d67de89287">
Apr 11 15:41:29 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 11 15:41:29 user nova-compute[71229]:         </nova:port>
Apr 11 15:41:29 user nova-compute[71229]:       </nova:ports>
Apr 11 15:41:29 user nova-compute[71229]:     </nova:instance>
Apr 11 15:41:29 user nova-compute[71229]:   </metadata>
Apr 11 15:41:29 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:41:29 user nova-compute[71229]:     <system>
Apr 11 15:41:29 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:41:29 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:41:29 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:41:29 user nova-compute[71229]:       <entry name="serial">8e816ce5-4da8-4366-9fa1-c33a45ba87fd</entry>
Apr 11 15:41:29 user nova-compute[71229]:       <entry name="uuid">8e816ce5-4da8-4366-9fa1-c33a45ba87fd</entry>
Apr 11 15:41:29 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:41:29 user nova-compute[71229]:     </system>
Apr 11 15:41:29 user nova-compute[71229]:   </sysinfo>
Apr 11 15:41:29 user nova-compute[71229]:   <os>
Apr 11 15:41:29 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:41:29 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 15:41:29 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:41:29 user nova-compute[71229]:   </os>
Apr 11 15:41:29 user nova-compute[71229]:   <features>
Apr 11 15:41:29 user nova-compute[71229]:     <acpi/>
Apr 11 15:41:29 user nova-compute[71229]:     <apic/>
Apr 11 15:41:29 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:41:29 user nova-compute[71229]:   </features>
Apr 11 15:41:29 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:41:29 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:41:29 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:41:29 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:41:29 user nova-compute[71229]:   </clock>
Apr 11 15:41:29 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:41:29 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:41:29 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:41:29 user nova-compute[71229]:   </cpu>
Apr 11 15:41:29 user nova-compute[71229]:   <devices>
Apr 11 15:41:29 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 15:41:29 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 15:41:29 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/8e816ce5-4da8-4366-9fa1-c33a45ba87fd/disk"/>
Apr 11 15:41:29 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:41:29 user nova-compute[71229]:     </disk>
Apr 11 15:41:29 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:41:29 user nova-compute[71229]:       <mac address="fa:16:3e:29:f1:87"/>
Apr 11 15:41:29 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:41:29 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:41:29 user nova-compute[71229]:       <target dev="tap7f4d2694-64"/>
Apr 11 15:41:29 user nova-compute[71229]:     </interface>
Apr 11 15:41:29 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:41:29 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/8e816ce5-4da8-4366-9fa1-c33a45ba87fd/console.log" append="off"/>
Apr 11 15:41:29 user nova-compute[71229]:     </serial>
Apr 11 15:41:29 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:41:29 user nova-compute[71229]:     <video>
Apr 11 15:41:29 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:41:29 user nova-compute[71229]:     </video>
Apr 11 15:41:29 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:41:29 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:41:29 user nova-compute[71229]:     </rng>
Apr 11 15:41:29 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:41:29 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:41:29 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:41:29 user nova-compute[71229]:     </memballoon>
Apr 11 15:41:29 user nova-compute[71229]:   </devices>
Apr 11 15:41:29 user nova-compute[71229]: </domain>
Apr 11 15:41:29 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:41:29 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:41:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-658332042',display_name='tempest-TestMinimumBasicScenario-server-658332042',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-658332042',id=31,image_ref='549c0060-ec14-4185-b1e7-cc908fe9383a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEi4e2JA/PL1tAOhcKlKt8FTH71kaR0W8XoERLXcyazkBigSjzY+dpYEFC9a+OYtBKc4ccV+zmtRPE4sE6bLSGB//HIVXoOcZ03OattPC2GZ2XpT9tuqlDYpxg3EGGGEOg==',key_name='tempest-TestMinimumBasicScenario-476755655',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c23461a3d7ca49f6a77d3fde6f1009d3',ramdisk_id='',reservation_id='r-vjgzwdqb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549c0060-ec14-4185-b1e7-cc908fe9383a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-673773229',owner_user_name='tempest-TestMinimumBasicScenario-673773229-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:41:26Z,user_data=None,user_id='044f17aee3324b3a97bebe935548b3b4',uuid=8e816ce5-4da8-4366-9fa1-c33a45ba87fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f4d2694-64e4-4dd0-af87-84d67de89287", "address": "fa:16:3e:29:f1:87", "network": {"id": "b1189892-ba9d-4316-9962-c737b27f14bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1737061315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c23461a3d7ca49f6a77d3fde6f1009d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f4d2694-64", "ovs_interfaceid": "7f4d2694-64e4-4dd0-af87-84d67de89287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:41:29 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Converting VIF {"id": "7f4d2694-64e4-4dd0-af87-84d67de89287", "address": "fa:16:3e:29:f1:87", "network": {"id": "b1189892-ba9d-4316-9962-c737b27f14bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1737061315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c23461a3d7ca49f6a77d3fde6f1009d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f4d2694-64", "ovs_interfaceid": "7f4d2694-64e4-4dd0-af87-84d67de89287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:41:29 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:f1:87,bridge_name='br-int',has_traffic_filtering=True,id=7f4d2694-64e4-4dd0-af87-84d67de89287,network=Network(b1189892-ba9d-4316-9962-c737b27f14bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f4d2694-64') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:41:29 user nova-compute[71229]: DEBUG os_vif [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:f1:87,bridge_name='br-int',has_traffic_filtering=True,id=7f4d2694-64e4-4dd0-af87-84d67de89287,network=Network(b1189892-ba9d-4316-9962-c737b27f14bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f4d2694-64') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:41:29 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:41:29 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:41:29 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:41:29 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:41:29 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f4d2694-64, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:41:29 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7f4d2694-64, col_values=(('external_ids', {'iface-id': '7f4d2694-64e4-4dd0-af87-84d67de89287', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:f1:87', 'vm-uuid': '8e816ce5-4da8-4366-9fa1-c33a45ba87fd'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:41:29 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:41:29 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:41:29 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:41:29 user nova-compute[71229]: INFO os_vif [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:f1:87,bridge_name='br-int',has_traffic_filtering=True,id=7f4d2694-64e4-4dd0-af87-84d67de89287,network=Network(b1189892-ba9d-4316-9962-c737b27f14bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f4d2694-64')
Apr 11 15:41:29 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:41:29 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] No VIF found with MAC fa:16:3e:29:f1:87, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:41:29 user nova-compute[71229]: DEBUG nova.network.neutron [req-58da0d1d-8c2a-4a40-99fa-d516425b269b req-cd137ee0-203d-49a8-ad5c-146a106cd9bb service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Updated VIF entry in instance network info cache for port 7f4d2694-64e4-4dd0-af87-84d67de89287. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:41:29 user nova-compute[71229]: DEBUG nova.network.neutron [req-58da0d1d-8c2a-4a40-99fa-d516425b269b req-cd137ee0-203d-49a8-ad5c-146a106cd9bb service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Updating instance_info_cache with network_info: [{"id": "7f4d2694-64e4-4dd0-af87-84d67de89287", "address": "fa:16:3e:29:f1:87", "network": {"id": "b1189892-ba9d-4316-9962-c737b27f14bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1737061315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c23461a3d7ca49f6a77d3fde6f1009d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f4d2694-64", "ovs_interfaceid": "7f4d2694-64e4-4dd0-af87-84d67de89287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:41:29 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-58da0d1d-8c2a-4a40-99fa-d516425b269b req-cd137ee0-203d-49a8-ad5c-146a106cd9bb service nova] Releasing lock "refresh_cache-8e816ce5-4da8-4366-9fa1-c33a45ba87fd" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:41:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:41:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:41:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:41:31 user nova-compute[71229]: DEBUG nova.compute.manager [req-32b8df62-2341-4aff-a94e-96f4d98576e5 req-dd9d5a96-2d3f-478e-9cd8-c77241f92487 service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Received event network-vif-plugged-7f4d2694-64e4-4dd0-af87-84d67de89287 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:41:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-32b8df62-2341-4aff-a94e-96f4d98576e5 req-dd9d5a96-2d3f-478e-9cd8-c77241f92487 service nova] Acquiring lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:41:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-32b8df62-2341-4aff-a94e-96f4d98576e5 req-dd9d5a96-2d3f-478e-9cd8-c77241f92487 service nova] Lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:41:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-32b8df62-2341-4aff-a94e-96f4d98576e5 req-dd9d5a96-2d3f-478e-9cd8-c77241f92487 service nova] Lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:41:31 user nova-compute[71229]: DEBUG nova.compute.manager [req-32b8df62-2341-4aff-a94e-96f4d98576e5 req-dd9d5a96-2d3f-478e-9cd8-c77241f92487 service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] No waiting events found dispatching network-vif-plugged-7f4d2694-64e4-4dd0-af87-84d67de89287 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:41:31 user nova-compute[71229]: WARNING nova.compute.manager [req-32b8df62-2341-4aff-a94e-96f4d98576e5 req-dd9d5a96-2d3f-478e-9cd8-c77241f92487 service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Received unexpected event network-vif-plugged-7f4d2694-64e4-4dd0-af87-84d67de89287 for instance with vm_state building and task_state spawning.
Apr 11 15:41:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:41:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:41:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:41:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:41:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:41:33 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227693.0073597, 8e816ce5-4da8-4366-9fa1-c33a45ba87fd => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:41:33 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] VM Resumed (Lifecycle Event)
Apr 11 15:41:33 user nova-compute[71229]: DEBUG nova.compute.manager [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 15:41:33 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Guest created on hypervisor {{(pid=71229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 15:41:33 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Instance spawned successfully.
Apr 11 15:41:33 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 15:41:33 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:41:33 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:41:33 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Found default for hw_cdrom_bus of ide {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:41:33 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Found default for hw_disk_bus of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:41:33 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Found default for hw_input_bus of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:41:33 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Found default for hw_pointer_model of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:41:33 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Found default for hw_video_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:41:33 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Found default for hw_vif_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:41:33 user nova-compute[71229]: DEBUG nova.compute.manager [req-dbf26538-d944-41c5-91da-edfdf4ae82d4 req-afafcb50-cf3f-4ae6-b3d5-564dbc9a07dc service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Received event network-vif-plugged-7f4d2694-64e4-4dd0-af87-84d67de89287 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:41:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-dbf26538-d944-41c5-91da-edfdf4ae82d4 req-afafcb50-cf3f-4ae6-b3d5-564dbc9a07dc service nova] Acquiring lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:41:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-dbf26538-d944-41c5-91da-edfdf4ae82d4 req-afafcb50-cf3f-4ae6-b3d5-564dbc9a07dc service nova] Lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:41:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-dbf26538-d944-41c5-91da-edfdf4ae82d4 req-afafcb50-cf3f-4ae6-b3d5-564dbc9a07dc service nova] Lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:41:33 user nova-compute[71229]: DEBUG nova.compute.manager [req-dbf26538-d944-41c5-91da-edfdf4ae82d4 req-afafcb50-cf3f-4ae6-b3d5-564dbc9a07dc service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] No waiting events found dispatching network-vif-plugged-7f4d2694-64e4-4dd0-af87-84d67de89287 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:41:33 user nova-compute[71229]: WARNING nova.compute.manager [req-dbf26538-d944-41c5-91da-edfdf4ae82d4 req-afafcb50-cf3f-4ae6-b3d5-564dbc9a07dc service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Received unexpected event network-vif-plugged-7f4d2694-64e4-4dd0-af87-84d67de89287 for instance with vm_state building and task_state spawning.
Apr 11 15:41:33 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:41:33 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227693.0088892, 8e816ce5-4da8-4366-9fa1-c33a45ba87fd => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:41:33 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] VM Started (Lifecycle Event)
Apr 11 15:41:33 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:41:33 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:41:33 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:41:33 user nova-compute[71229]: INFO nova.compute.manager [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Took 6.86 seconds to spawn the instance on the hypervisor.
Apr 11 15:41:33 user nova-compute[71229]: DEBUG nova.compute.manager [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:41:33 user nova-compute[71229]: INFO nova.compute.manager [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Took 7.49 seconds to build instance.
Apr 11 15:41:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ac10de53-1171-4863-b8be-77bdcb968288 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.630s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:41:34 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:41:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:41:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:41:44 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:41:44 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:41:44 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 15:41:44 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 15:41:44 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 15:41:44 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:41:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:41:47 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:41:47 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Cleaning up deleted instances {{(pid=71229) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 15:41:47 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] There are 0 instances to clean {{(pid=71229) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 15:41:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:41:52 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:41:54 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:41:57 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:41:59 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:42:01 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:42:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:42:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:42:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:42:04 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:42:04 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 15:42:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:42:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:42:07 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:42:07 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:42:07 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:42:07 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:42:07 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:42:07 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:42:07 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 15:42:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e816ce5-4da8-4366-9fa1-c33a45ba87fd/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:42:08 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e816ce5-4da8-4366-9fa1-c33a45ba87fd/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:42:08 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e816ce5-4da8-4366-9fa1-c33a45ba87fd/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:42:08 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e816ce5-4da8-4366-9fa1-c33a45ba87fd/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:42:08 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:42:08 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:42:08 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:42:08 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json" returned: 0 in 0.157s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:42:08 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:42:08 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:42:08 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:42:08 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:42:08 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:42:08 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:42:08 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:42:08 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:42:09 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:42:09 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:42:09 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk.rescue --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:42:09 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:42:09 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk.rescue --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:42:09 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:42:09 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:42:09 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:42:09 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:42:09 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:42:09 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:42:10 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:42:10 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:42:10 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8404MB free_disk=25.989513397216797GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 15:42:10 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:42:10 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:42:10 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance dcbfcbfd-7e96-4271-94ee-60ef937e3b7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:42:10 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 6f6ae64a-c760-4ba3-8a50-d380835d9913 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:42:10 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 058df5ba-07ab-4bdd-9a47-907e7b0e0e59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:42:10 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance ffce2921-d4a5-4bcb-8032-62a6dc321fb4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:42:10 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 8e816ce5-4da8-4366-9fa1-c33a45ba87fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:42:10 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 15:42:10 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=1216MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 15:42:10 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:42:10 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:42:10 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 15:42:10 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.322s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:42:10 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:42:10 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71229) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 15:42:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:42:11 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:42:11 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 15:42:11 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "refresh_cache-058df5ba-07ab-4bdd-9a47-907e7b0e0e59" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:42:11 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquired lock "refresh_cache-058df5ba-07ab-4bdd-9a47-907e7b0e0e59" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:42:11 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Forcefully refreshing network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 15:42:12 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Updating instance_info_cache with network_info: [{"id": "cdfec3e6-f5dc-42e6-98a8-651f46bd37f4", "address": "fa:16:3e:47:d3:74", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdfec3e6-f5", "ovs_interfaceid": "cdfec3e6-f5dc-42e6-98a8-651f46bd37f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:42:12 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Releasing lock "refresh_cache-058df5ba-07ab-4bdd-9a47-907e7b0e0e59" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:42:12 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Updated the network info_cache for instance {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 15:42:12 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:42:12 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:42:12 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:42:12 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:42:12 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:42:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:42:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "4f51cc22-e687-40e2-899a-72f2f169b154" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:42:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "4f51cc22-e687-40e2-899a-72f2f169b154" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:42:15 user nova-compute[71229]: DEBUG nova.compute.manager [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Starting instance... {{(pid=71229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 15:42:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:42:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:42:15 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 15:42:15 user nova-compute[71229]: INFO nova.compute.claims [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Claim successful on node user
Apr 11 15:42:15 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:42:15 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:42:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.282s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:42:15 user nova-compute[71229]: DEBUG nova.compute.manager [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Start building networks asynchronously for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 15:42:15 user nova-compute[71229]: DEBUG nova.compute.manager [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Allocating IP information in the background. {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 15:42:15 user nova-compute[71229]: DEBUG nova.network.neutron [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] allocate_for_instance() {{(pid=71229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 15:42:15 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 15:42:15 user nova-compute[71229]: DEBUG nova.compute.manager [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Start building block device mappings for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 15:42:15 user nova-compute[71229]: INFO nova.virt.block_device [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Booting with volume snapshot 7dd85c86-9339-4862-8de7-a199b74565a6 at /dev/vda
Apr 11 15:42:15 user nova-compute[71229]: DEBUG nova.policy [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c2110b74f38642afa560e1c9790d3f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312851c65ba1434691eca0cd2a8cd6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71229) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 15:42:16 user nova-compute[71229]: DEBUG nova.network.neutron [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Successfully created port: 66c0193e-7320-4344-8ef3-419b21bbbba7 {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 15:42:17 user nova-compute[71229]: DEBUG nova.network.neutron [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Successfully updated port: 66c0193e-7320-4344-8ef3-419b21bbbba7 {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:42:17 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "refresh_cache-4f51cc22-e687-40e2-899a-72f2f169b154" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:42:17 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquired lock "refresh_cache-4f51cc22-e687-40e2-899a-72f2f169b154" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:42:17 user nova-compute[71229]: DEBUG nova.network.neutron [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:42:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:42:17 user nova-compute[71229]: DEBUG nova.compute.manager [req-540f910b-dca5-4a61-87ee-9425a898959d req-a283ca3c-8209-41d6-80e5-293757b8243e service nova] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Received event network-changed-66c0193e-7320-4344-8ef3-419b21bbbba7 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:42:17 user nova-compute[71229]: DEBUG nova.compute.manager [req-540f910b-dca5-4a61-87ee-9425a898959d req-a283ca3c-8209-41d6-80e5-293757b8243e service nova] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Refreshing instance network info cache due to event network-changed-66c0193e-7320-4344-8ef3-419b21bbbba7. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:42:17 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-540f910b-dca5-4a61-87ee-9425a898959d req-a283ca3c-8209-41d6-80e5-293757b8243e service nova] Acquiring lock "refresh_cache-4f51cc22-e687-40e2-899a-72f2f169b154" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:42:17 user nova-compute[71229]: DEBUG nova.network.neutron [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:42:17 user nova-compute[71229]: DEBUG nova.network.neutron [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Updating instance_info_cache with network_info: [{"id": "66c0193e-7320-4344-8ef3-419b21bbbba7", "address": "fa:16:3e:83:ef:5b", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c0193e-73", "ovs_interfaceid": "66c0193e-7320-4344-8ef3-419b21bbbba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:42:17 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Releasing lock "refresh_cache-4f51cc22-e687-40e2-899a-72f2f169b154" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:42:17 user nova-compute[71229]: DEBUG nova.compute.manager [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Instance network_info: |[{"id": "66c0193e-7320-4344-8ef3-419b21bbbba7", "address": "fa:16:3e:83:ef:5b", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c0193e-73", "ovs_interfaceid": "66c0193e-7320-4344-8ef3-419b21bbbba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 15:42:17 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-540f910b-dca5-4a61-87ee-9425a898959d req-a283ca3c-8209-41d6-80e5-293757b8243e service nova] Acquired lock "refresh_cache-4f51cc22-e687-40e2-899a-72f2f169b154" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:42:17 user nova-compute[71229]: DEBUG nova.network.neutron [req-540f910b-dca5-4a61-87ee-9425a898959d req-a283ca3c-8209-41d6-80e5-293757b8243e service nova] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Refreshing network info cache for port 66c0193e-7320-4344-8ef3-419b21bbbba7 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:42:17 user nova-compute[71229]: DEBUG nova.network.neutron [req-540f910b-dca5-4a61-87ee-9425a898959d req-a283ca3c-8209-41d6-80e5-293757b8243e service nova] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Updated VIF entry in instance network info cache for port 66c0193e-7320-4344-8ef3-419b21bbbba7. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:42:17 user nova-compute[71229]: DEBUG nova.network.neutron [req-540f910b-dca5-4a61-87ee-9425a898959d req-a283ca3c-8209-41d6-80e5-293757b8243e service nova] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Updating instance_info_cache with network_info: [{"id": "66c0193e-7320-4344-8ef3-419b21bbbba7", "address": "fa:16:3e:83:ef:5b", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c0193e-73", "ovs_interfaceid": "66c0193e-7320-4344-8ef3-419b21bbbba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:42:17 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-540f910b-dca5-4a61-87ee-9425a898959d req-a283ca3c-8209-41d6-80e5-293757b8243e service nova] Releasing lock "refresh_cache-4f51cc22-e687-40e2-899a-72f2f169b154" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:42:19 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:42:21 user nova-compute[71229]: DEBUG os_brick.utils [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:42:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:42:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:42:21 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ace771-dbf8-4462-a303-db6afc456ef8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d55e24a97c90\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:42:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:42:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:42:21 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc241e51-33d9-46a4-941f-969c122c86ac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:42:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:42:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:42:21 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e92da8-fc31-4f6a-8cc1-f5fa95a77d30]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:42:21 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab00bd4-b8e9-4723-a8a8-232d4fd07863]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:42:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Running cmd (subprocess): nvme version {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:42:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 'nvme version' failed. Not Retrying. {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:42:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] nvme not present on system {{(pid=71229) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 15:42:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:42:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:42:21 user nova-compute[71229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 15:42:21 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad4a86a-5319-440e-bd9c-e40d76cce13e]: (4, '') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:42:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71229) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 15:42:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 15:42:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] LIGHTOS: no hostnqn found. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 15:42:21 user nova-compute[71229]: DEBUG os_brick.utils [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d55e24a97c90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:42:21 user nova-compute[71229]: DEBUG nova.virt.block_device [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Updating existing volume attachment record: 1a7fd6df-3763-4cb3-827d-bcd7d5bfed17 {{(pid=71229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 15:42:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:42:24 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG nova.compute.manager [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Start spawning the instance on the hypervisor. {{(pid=71229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Creating instance directory {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 15:42:25 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Creating image(s)
Apr 11 15:42:25 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Did not create local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Ensure instance console log exists: /opt/stack/data/nova/instances/4f51cc22-e687-40e2-899a-72f2f169b154/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Start _get_guest_xml network_info=[{"id": "66c0193e-7320-4344-8ef3-419b21bbbba7", "address": "fa:16:3e:83:ef:5b", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c0193e-73", "ovs_interfaceid": "66c0193e-7320-4344-8ef3-419b21bbbba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZPGqhwAD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4f51cc22-e687-40e2-899a-72f2f169b154', 'attached_at': '', 'detached_at': '', 'volume_id': '75f6a2d2-2c23-4678-a4bd-7e61625149ea', 'serial': '75f6a2d2-2c23-4678-a4bd-7e61625149ea'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '1a7fd6df-3763-4cb3-827d-bcd7d5bfed17', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:42:25 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:42:25 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:42:25 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZPGqhwAD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:42:25 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:42:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:42:25 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:42:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:42:25 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 15:42:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d1282c-32ae-4c7e-a535-ada739b1a22d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 15:42:25 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea -p 172.16.0.220:3260 --interface default --op new {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[671d2497-9f6b-4327-a027-b40da159bfb0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea] added\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea] added
Apr 11 15:42:25 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c4ca42-b01e-49c9-a2dc-d14493026663]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[807dcbae-9245-4b09-833e-28b42683275a]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZPGqhwAD {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZPGqhwAD" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c92f1e-73ae-40c4-9bde-d1aaf25a5850]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZPGqhwAD'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d09cdb9-13ab-45d4-b0f1-7f1db9e56b59]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[008012b4-3aaa-48ae-9c2a-2877e2865f5a]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 (non-flash)
Apr 11 15:42:25 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 (non-flash)
Apr 11 15:42:25 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea -p 172.16.0.220:3260 --login {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9ed667-2c52-4b27-96fa-4a9812f35ca3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea, portal: 172.16.0.220,3260]
Apr 11 15:42:25 user nova-compute[71229]: Login to [iface: default, target: iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea, portal: 172.16.0.220,3260] successful.
Apr 11 15:42:25 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd00fa33-665d-4cfa-845c-a802399e8354]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7da124-c288-46ae-b75c-b2ac3d46ea2f]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 (non-flash)
Apr 11 15:42:25 user nova-compute[71229]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea (non-flash)
Apr 11 15:42:25 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 (non-flash)
Apr 11 15:42:25 user nova-compute[71229]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea (non-flash)
Apr 11 15:42:25 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 15:42:25 user nova-compute[71229]: INFO nova.compute.manager [None req-db941114-5382-4229-b58a-1cbd22f68ad4 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Unrescuing
Apr 11 15:42:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-db941114-5382-4229-b58a-1cbd22f68ad4 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "refresh_cache-6f6ae64a-c760-4ba3-8a50-d380835d9913" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-db941114-5382-4229-b58a-1cbd22f68ad4 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquired lock "refresh_cache-6f6ae64a-c760-4ba3-8a50-d380835d9913" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG nova.network.neutron [None req-db941114-5382-4229-b58a-1cbd22f68ad4 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[359bd15e-efcb-418b-81c4-7a259df4ed38]: (4, ('- - 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:42:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZPGqhwAD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 15:42:26 user nova-compute[71229]: DEBUG nova.network.neutron [None req-db941114-5382-4229-b58a-1cbd22f68ad4 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Updating instance_info_cache with network_info: [{"id": "2b891eeb-973f-492a-9059-55961bb956bf", "address": "fa:16:3e:97:b1:ae", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b891eeb-97", "ovs_interfaceid": "2b891eeb-973f-492a-9059-55961bb956bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:42:26 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-db941114-5382-4229-b58a-1cbd22f68ad4 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Releasing lock "refresh_cache-6f6ae64a-c760-4ba3-8a50-d380835d9913" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:42:26 user nova-compute[71229]: DEBUG nova.objects.instance [None req-db941114-5382-4229-b58a-1cbd22f68ad4 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lazy-loading 'flavor' on Instance uuid 6f6ae64a-c760-4ba3-8a50-d380835d9913 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:42:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:42:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:42:26 user nova-compute[71229]: DEBUG nova.compute.manager [req-c21dd10b-61e8-49ef-bbba-45af30cad9f9 req-66a239cc-abd0-455d-ade0-86cecc1f8e3a service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Received event network-vif-unplugged-2b891eeb-973f-492a-9059-55961bb956bf {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:42:26 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c21dd10b-61e8-49ef-bbba-45af30cad9f9 req-66a239cc-abd0-455d-ade0-86cecc1f8e3a service nova] Acquiring lock "6f6ae64a-c760-4ba3-8a50-d380835d9913-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:42:26 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c21dd10b-61e8-49ef-bbba-45af30cad9f9 req-66a239cc-abd0-455d-ade0-86cecc1f8e3a service nova] Lock "6f6ae64a-c760-4ba3-8a50-d380835d9913-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:42:26 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c21dd10b-61e8-49ef-bbba-45af30cad9f9 req-66a239cc-abd0-455d-ade0-86cecc1f8e3a service nova] Lock "6f6ae64a-c760-4ba3-8a50-d380835d9913-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:42:26 user nova-compute[71229]: DEBUG nova.compute.manager [req-c21dd10b-61e8-49ef-bbba-45af30cad9f9 req-66a239cc-abd0-455d-ade0-86cecc1f8e3a service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] No waiting events found dispatching network-vif-unplugged-2b891eeb-973f-492a-9059-55961bb956bf {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:42:26 user nova-compute[71229]: WARNING nova.compute.manager [req-c21dd10b-61e8-49ef-bbba-45af30cad9f9 req-66a239cc-abd0-455d-ade0-86cecc1f8e3a service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Received unexpected event network-vif-unplugged-2b891eeb-973f-492a-9059-55961bb956bf for instance with vm_state rescued and task_state unrescuing.
Apr 11 15:42:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:42:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:42:26 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:42:26 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '26365303962373864', 'path': '/dev/sdb'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:42:26 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365303962373864', 'path': '/dev/sdb'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 15:42:27 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Instance destroyed successfully.
Apr 11 15:42:27 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:42:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-430537775',display_name='tempest-TestVolumeBootPattern-server-430537775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-430537775',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='312851c65ba1434691eca0cd2a8cd6d2',ramdisk_id='',reservation_id='r-wbk5o8e3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1933582504',owner_user_name='tempest-TestVolumeBootPattern-1933582504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:42:16Z,user_data=None,user_id='c2110b74f38642afa560e1c9790d3f81',uuid=4f51cc22-e687-40e2-899a-72f2f169b154,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66c0193e-7320-4344-8ef3-419b21bbbba7", "address": "fa:16:3e:83:ef:5b", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c0193e-73", "ovs_interfaceid": "66c0193e-7320-4344-8ef3-419b21bbbba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:42:27 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Converting VIF {"id": "66c0193e-7320-4344-8ef3-419b21bbbba7", "address": "fa:16:3e:83:ef:5b", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c0193e-73", "ovs_interfaceid": "66c0193e-7320-4344-8ef3-419b21bbbba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:42:27 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:ef:5b,bridge_name='br-int',has_traffic_filtering=True,id=66c0193e-7320-4344-8ef3-419b21bbbba7,network=Network(8d262ba8-b9c3-44ed-8431-6c295eb9ea24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66c0193e-73') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:42:27 user nova-compute[71229]: DEBUG nova.objects.instance [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f51cc22-e687-40e2-899a-72f2f169b154 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:42:27 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:42:27 user nova-compute[71229]:   <uuid>4f51cc22-e687-40e2-899a-72f2f169b154</uuid>
Apr 11 15:42:27 user nova-compute[71229]:   <name>instance-00000020</name>
Apr 11 15:42:27 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:42:27 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:42:27 user nova-compute[71229]:   <metadata>
Apr 11 15:42:27 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:42:27 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:42:27 user nova-compute[71229]:       <nova:name>tempest-TestVolumeBootPattern-server-430537775</nova:name>
Apr 11 15:42:27 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:42:25</nova:creationTime>
Apr 11 15:42:27 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:42:27 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:42:27 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:42:27 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:42:27 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:42:27 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:42:27 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:42:27 user nova-compute[71229]:       <nova:owner>
Apr 11 15:42:27 user nova-compute[71229]:         <nova:user uuid="c2110b74f38642afa560e1c9790d3f81">tempest-TestVolumeBootPattern-1933582504-project-member</nova:user>
Apr 11 15:42:27 user nova-compute[71229]:         <nova:project uuid="312851c65ba1434691eca0cd2a8cd6d2">tempest-TestVolumeBootPattern-1933582504</nova:project>
Apr 11 15:42:27 user nova-compute[71229]:       </nova:owner>
Apr 11 15:42:27 user nova-compute[71229]:       <nova:ports>
Apr 11 15:42:27 user nova-compute[71229]:         <nova:port uuid="66c0193e-7320-4344-8ef3-419b21bbbba7">
Apr 11 15:42:27 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 11 15:42:27 user nova-compute[71229]:         </nova:port>
Apr 11 15:42:27 user nova-compute[71229]:       </nova:ports>
Apr 11 15:42:27 user nova-compute[71229]:     </nova:instance>
Apr 11 15:42:27 user nova-compute[71229]:   </metadata>
Apr 11 15:42:27 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:42:27 user nova-compute[71229]:     <system>
Apr 11 15:42:27 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:42:27 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:42:27 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:42:27 user nova-compute[71229]:       <entry name="serial">4f51cc22-e687-40e2-899a-72f2f169b154</entry>
Apr 11 15:42:27 user nova-compute[71229]:       <entry name="uuid">4f51cc22-e687-40e2-899a-72f2f169b154</entry>
Apr 11 15:42:27 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:42:27 user nova-compute[71229]:     </system>
Apr 11 15:42:27 user nova-compute[71229]:   </sysinfo>
Apr 11 15:42:27 user nova-compute[71229]:   <os>
Apr 11 15:42:27 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:42:27 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 15:42:27 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:42:27 user nova-compute[71229]:   </os>
Apr 11 15:42:27 user nova-compute[71229]:   <features>
Apr 11 15:42:27 user nova-compute[71229]:     <acpi/>
Apr 11 15:42:27 user nova-compute[71229]:     <apic/>
Apr 11 15:42:27 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:42:27 user nova-compute[71229]:   </features>
Apr 11 15:42:27 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:42:27 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:42:27 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:42:27 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:42:27 user nova-compute[71229]:   </clock>
Apr 11 15:42:27 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:42:27 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:42:27 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:42:27 user nova-compute[71229]:   </cpu>
Apr 11 15:42:27 user nova-compute[71229]:   <devices>
Apr 11 15:42:27 user nova-compute[71229]:     <disk type="block" device="disk">
Apr 11 15:42:27 user nova-compute[71229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:42:27 user nova-compute[71229]:       <source dev="/dev/sdb"/>
Apr 11 15:42:27 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:42:27 user nova-compute[71229]:       <serial>75f6a2d2-2c23-4678-a4bd-7e61625149ea</serial>
Apr 11 15:42:27 user nova-compute[71229]:     </disk>
Apr 11 15:42:27 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:42:27 user nova-compute[71229]:       <mac address="fa:16:3e:83:ef:5b"/>
Apr 11 15:42:27 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:42:27 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:42:27 user nova-compute[71229]:       <target dev="tap66c0193e-73"/>
Apr 11 15:42:27 user nova-compute[71229]:     </interface>
Apr 11 15:42:27 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:42:27 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/4f51cc22-e687-40e2-899a-72f2f169b154/console.log" append="off"/>
Apr 11 15:42:27 user nova-compute[71229]:     </serial>
Apr 11 15:42:27 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:42:27 user nova-compute[71229]:     <video>
Apr 11 15:42:27 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:42:27 user nova-compute[71229]:     </video>
Apr 11 15:42:27 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:42:27 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:42:27 user nova-compute[71229]:     </rng>
Apr 11 15:42:27 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:42:27 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:42:27 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:42:27 user nova-compute[71229]:     </memballoon>
Apr 11 15:42:27 user nova-compute[71229]:   </devices>
Apr 11 15:42:27 user nova-compute[71229]: </domain>
Apr 11 15:42:27 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:42:27 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:42:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-430537775',display_name='tempest-TestVolumeBootPattern-server-430537775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-430537775',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='312851c65ba1434691eca0cd2a8cd6d2',ramdisk_id='',reservation_id='r-wbk5o8e3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1933582504',owner_user_name='tempest-TestVolumeBootPattern-1933582504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:42:16Z,user_data=None,user_id='c2110b74f38642afa560e1c9790d3f81',uuid=4f51cc22-e687-40e2-899a-72f2f169b154,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66c0193e-7320-4344-8ef3-419b21bbbba7", "address": "fa:16:3e:83:ef:5b", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c0193e-73", "ovs_interfaceid": "66c0193e-7320-4344-8ef3-419b21bbbba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:42:27 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Converting VIF {"id": "66c0193e-7320-4344-8ef3-419b21bbbba7", "address": "fa:16:3e:83:ef:5b", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c0193e-73", "ovs_interfaceid": "66c0193e-7320-4344-8ef3-419b21bbbba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:42:27 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:ef:5b,bridge_name='br-int',has_traffic_filtering=True,id=66c0193e-7320-4344-8ef3-419b21bbbba7,network=Network(8d262ba8-b9c3-44ed-8431-6c295eb9ea24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66c0193e-73') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:42:27 user nova-compute[71229]: DEBUG os_vif [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:ef:5b,bridge_name='br-int',has_traffic_filtering=True,id=66c0193e-7320-4344-8ef3-419b21bbbba7,network=Network(8d262ba8-b9c3-44ed-8431-6c295eb9ea24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66c0193e-73') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:42:27 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:42:27 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:42:27 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:42:27 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:42:27 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap66c0193e-73, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:42:27 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap66c0193e-73, col_values=(('external_ids', {'iface-id': '66c0193e-7320-4344-8ef3-419b21bbbba7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:ef:5b', 'vm-uuid': '4f51cc22-e687-40e2-899a-72f2f169b154'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:42:27 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:42:27 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:42:27 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:42:27 user nova-compute[71229]: INFO os_vif [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:ef:5b,bridge_name='br-int',has_traffic_filtering=True,id=66c0193e-7320-4344-8ef3-419b21bbbba7,network=Network(8d262ba8-b9c3-44ed-8431-6c295eb9ea24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66c0193e-73')
Apr 11 15:42:27 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:42:27 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] No VIF found with MAC fa:16:3e:83:ef:5b, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:42:27 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:42:28 user nova-compute[71229]: DEBUG nova.compute.manager [req-24a9ee76-b17f-4065-bc47-60f5df4d94f1 req-cc72a252-9f9b-480c-8289-aec42b38fb07 service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Received event network-vif-plugged-2b891eeb-973f-492a-9059-55961bb956bf {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:42:28 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-24a9ee76-b17f-4065-bc47-60f5df4d94f1 req-cc72a252-9f9b-480c-8289-aec42b38fb07 service nova] Acquiring lock "6f6ae64a-c760-4ba3-8a50-d380835d9913-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:42:28 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-24a9ee76-b17f-4065-bc47-60f5df4d94f1 req-cc72a252-9f9b-480c-8289-aec42b38fb07 service nova] Lock "6f6ae64a-c760-4ba3-8a50-d380835d9913-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:42:28 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-24a9ee76-b17f-4065-bc47-60f5df4d94f1 req-cc72a252-9f9b-480c-8289-aec42b38fb07 service nova] Lock "6f6ae64a-c760-4ba3-8a50-d380835d9913-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:42:28 user nova-compute[71229]: DEBUG nova.compute.manager [req-24a9ee76-b17f-4065-bc47-60f5df4d94f1 req-cc72a252-9f9b-480c-8289-aec42b38fb07 service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] No waiting events found dispatching network-vif-plugged-2b891eeb-973f-492a-9059-55961bb956bf {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:42:28 user nova-compute[71229]: WARNING nova.compute.manager [req-24a9ee76-b17f-4065-bc47-60f5df4d94f1 req-cc72a252-9f9b-480c-8289-aec42b38fb07 service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Received unexpected event network-vif-plugged-2b891eeb-973f-492a-9059-55961bb956bf for instance with vm_state rescued and task_state unrescuing.
Apr 11 15:42:29 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:42:29 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:42:29 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:42:29 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:42:29 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:42:29 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:42:29 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:42:29 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:42:29 user nova-compute[71229]: DEBUG nova.compute.manager [req-dc8c9115-b04d-4751-93b8-2daceda4a035 req-d6b75220-1f53-4b24-b7b2-edb00f141323 service nova] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Received event network-vif-plugged-66c0193e-7320-4344-8ef3-419b21bbbba7 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:42:29 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-dc8c9115-b04d-4751-93b8-2daceda4a035 req-d6b75220-1f53-4b24-b7b2-edb00f141323 service nova] Acquiring lock "4f51cc22-e687-40e2-899a-72f2f169b154-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:42:29 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-dc8c9115-b04d-4751-93b8-2daceda4a035 req-d6b75220-1f53-4b24-b7b2-edb00f141323 service nova] Lock "4f51cc22-e687-40e2-899a-72f2f169b154-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:42:29 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-dc8c9115-b04d-4751-93b8-2daceda4a035 req-d6b75220-1f53-4b24-b7b2-edb00f141323 service nova] Lock "4f51cc22-e687-40e2-899a-72f2f169b154-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:42:29 user nova-compute[71229]: DEBUG nova.compute.manager [req-dc8c9115-b04d-4751-93b8-2daceda4a035 req-d6b75220-1f53-4b24-b7b2-edb00f141323 service nova] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] No waiting events found dispatching network-vif-plugged-66c0193e-7320-4344-8ef3-419b21bbbba7 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:42:29 user nova-compute[71229]: WARNING nova.compute.manager [req-dc8c9115-b04d-4751-93b8-2daceda4a035 req-d6b75220-1f53-4b24-b7b2-edb00f141323 service nova] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Received unexpected event network-vif-plugged-66c0193e-7320-4344-8ef3-419b21bbbba7 for instance with vm_state building and task_state spawning.
Apr 11 15:42:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:42:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:42:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:42:30 user nova-compute[71229]: DEBUG nova.compute.manager [req-48c2ab8b-362d-4351-b9d6-94ab00599741 req-88eb2b83-f7ac-43f3-9b27-77593dec7616 service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Received event network-vif-plugged-2b891eeb-973f-492a-9059-55961bb956bf {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:42:30 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-48c2ab8b-362d-4351-b9d6-94ab00599741 req-88eb2b83-f7ac-43f3-9b27-77593dec7616 service nova] Acquiring lock "6f6ae64a-c760-4ba3-8a50-d380835d9913-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:42:30 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-48c2ab8b-362d-4351-b9d6-94ab00599741 req-88eb2b83-f7ac-43f3-9b27-77593dec7616 service nova] Lock "6f6ae64a-c760-4ba3-8a50-d380835d9913-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:42:30 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-48c2ab8b-362d-4351-b9d6-94ab00599741 req-88eb2b83-f7ac-43f3-9b27-77593dec7616 service nova] Lock "6f6ae64a-c760-4ba3-8a50-d380835d9913-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:42:30 user nova-compute[71229]: DEBUG nova.compute.manager [req-48c2ab8b-362d-4351-b9d6-94ab00599741 req-88eb2b83-f7ac-43f3-9b27-77593dec7616 service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] No waiting events found dispatching network-vif-plugged-2b891eeb-973f-492a-9059-55961bb956bf {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:42:30 user nova-compute[71229]: WARNING nova.compute.manager [req-48c2ab8b-362d-4351-b9d6-94ab00599741 req-88eb2b83-f7ac-43f3-9b27-77593dec7616 service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Received unexpected event network-vif-plugged-2b891eeb-973f-492a-9059-55961bb956bf for instance with vm_state rescued and task_state unrescuing.
Apr 11 15:42:30 user nova-compute[71229]: DEBUG nova.compute.manager [req-48c2ab8b-362d-4351-b9d6-94ab00599741 req-88eb2b83-f7ac-43f3-9b27-77593dec7616 service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Received event network-vif-plugged-2b891eeb-973f-492a-9059-55961bb956bf {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:42:30 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-48c2ab8b-362d-4351-b9d6-94ab00599741 req-88eb2b83-f7ac-43f3-9b27-77593dec7616 service nova] Acquiring lock "6f6ae64a-c760-4ba3-8a50-d380835d9913-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:42:30 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-48c2ab8b-362d-4351-b9d6-94ab00599741 req-88eb2b83-f7ac-43f3-9b27-77593dec7616 service nova] Lock "6f6ae64a-c760-4ba3-8a50-d380835d9913-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:42:30 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-48c2ab8b-362d-4351-b9d6-94ab00599741 req-88eb2b83-f7ac-43f3-9b27-77593dec7616 service nova] Lock "6f6ae64a-c760-4ba3-8a50-d380835d9913-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:42:30 user nova-compute[71229]: DEBUG nova.compute.manager [req-48c2ab8b-362d-4351-b9d6-94ab00599741 req-88eb2b83-f7ac-43f3-9b27-77593dec7616 service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] No waiting events found dispatching network-vif-plugged-2b891eeb-973f-492a-9059-55961bb956bf {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:42:30 user nova-compute[71229]: WARNING nova.compute.manager [req-48c2ab8b-362d-4351-b9d6-94ab00599741 req-88eb2b83-f7ac-43f3-9b27-77593dec7616 service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Received unexpected event network-vif-plugged-2b891eeb-973f-492a-9059-55961bb956bf for instance with vm_state rescued and task_state unrescuing.
Apr 11 15:42:31 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227751.9367945, 4f51cc22-e687-40e2-899a-72f2f169b154 => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:42:31 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] VM Resumed (Lifecycle Event)
Apr 11 15:42:31 user nova-compute[71229]: DEBUG nova.compute.manager [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 15:42:31 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Guest created on hypervisor {{(pid=71229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 15:42:31 user nova-compute[71229]: DEBUG nova.compute.manager [None req-db941114-5382-4229-b58a-1cbd22f68ad4 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:42:31 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Instance spawned successfully.
Apr 11 15:42:31 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 15:42:31 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:42:31 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:42:31 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Found default for hw_cdrom_bus of ide {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:42:31 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Found default for hw_disk_bus of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:42:31 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Found default for hw_input_bus of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:42:31 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Found default for hw_pointer_model of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:42:31 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Found default for hw_video_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:42:31 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Found default for hw_vif_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:42:31 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:42:31 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227751.9399889, 4f51cc22-e687-40e2-899a-72f2f169b154 => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:42:31 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] VM Started (Lifecycle Event)
Apr 11 15:42:32 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:42:32 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:42:32 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:42:32 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Removed pending event for 6f6ae64a-c760-4ba3-8a50-d380835d9913 due to event {{(pid=71229) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 15:42:32 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227751.9411194, 6f6ae64a-c760-4ba3-8a50-d380835d9913 => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:42:32 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] VM Resumed (Lifecycle Event)
Apr 11 15:42:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:42:32 user nova-compute[71229]: INFO nova.compute.manager [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Took 6.45 seconds to spawn the instance on the hypervisor.
Apr 11 15:42:32 user nova-compute[71229]: DEBUG nova.compute.manager [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:42:32 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:42:32 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:42:32 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227751.9420824, 6f6ae64a-c760-4ba3-8a50-d380835d9913 => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:42:32 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] VM Started (Lifecycle Event)
Apr 11 15:42:32 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:42:32 user nova-compute[71229]: DEBUG nova.compute.manager [req-62b5e447-5006-4b1e-b64b-296a5bd4d365 req-08d5268d-22d6-4c7e-be8c-aecd100f3687 service nova] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Received event network-vif-plugged-66c0193e-7320-4344-8ef3-419b21bbbba7 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:42:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-62b5e447-5006-4b1e-b64b-296a5bd4d365 req-08d5268d-22d6-4c7e-be8c-aecd100f3687 service nova] Acquiring lock "4f51cc22-e687-40e2-899a-72f2f169b154-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:42:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-62b5e447-5006-4b1e-b64b-296a5bd4d365 req-08d5268d-22d6-4c7e-be8c-aecd100f3687 service nova] Lock "4f51cc22-e687-40e2-899a-72f2f169b154-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:42:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-62b5e447-5006-4b1e-b64b-296a5bd4d365 req-08d5268d-22d6-4c7e-be8c-aecd100f3687 service nova] Lock "4f51cc22-e687-40e2-899a-72f2f169b154-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:42:32 user nova-compute[71229]: DEBUG nova.compute.manager [req-62b5e447-5006-4b1e-b64b-296a5bd4d365 req-08d5268d-22d6-4c7e-be8c-aecd100f3687 service nova] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] No waiting events found dispatching network-vif-plugged-66c0193e-7320-4344-8ef3-419b21bbbba7 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:42:32 user nova-compute[71229]: WARNING nova.compute.manager [req-62b5e447-5006-4b1e-b64b-296a5bd4d365 req-08d5268d-22d6-4c7e-be8c-aecd100f3687 service nova] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Received unexpected event network-vif-plugged-66c0193e-7320-4344-8ef3-419b21bbbba7 for instance with vm_state building and task_state spawning.
Apr 11 15:42:32 user nova-compute[71229]: INFO nova.compute.manager [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Took 16.90 seconds to build instance.
Apr 11 15:42:32 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:42:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:42:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-3ede1379-3385-4e9b-bc27-c253f247ef59 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "4f51cc22-e687-40e2-899a-72f2f169b154" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.990s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:42:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:42:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:42:42 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:42:42 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:42:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:42:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:42:51 user nova-compute[71229]: INFO nova.compute.manager [None req-7ab5ac2f-bdd9-4bef-8c58-a3e744b5cd5f tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Get console output
Apr 11 15:42:51 user nova-compute[71229]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Apr 11 15:42:52 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:42:52 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:42:57 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:42:57 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:43:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:43:04 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:43:04 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 15:43:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:43:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:43:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 15:43:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 15:43:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 15:43:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:43:08 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:43:08 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:43:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:43:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:43:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:43:08 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 15:43:08 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e816ce5-4da8-4366-9fa1-c33a45ba87fd/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:43:08 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e816ce5-4da8-4366-9fa1-c33a45ba87fd/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:43:08 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e816ce5-4da8-4366-9fa1-c33a45ba87fd/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:43:09 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e816ce5-4da8-4366-9fa1-c33a45ba87fd/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:43:09 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:43:09 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:43:09 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:43:09 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:43:09 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:43:09 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:43:09 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:43:09 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:43:09 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:43:09 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:43:09 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:43:09 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:43:10 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:43:10 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:43:10 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:43:10 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:43:10 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:43:10 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:43:10 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:43:10 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:43:10 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8243MB free_disk=26.005146026611328GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 15:43:10 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:43:10 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:43:11 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance dcbfcbfd-7e96-4271-94ee-60ef937e3b7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:43:11 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 6f6ae64a-c760-4ba3-8a50-d380835d9913 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:43:11 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 058df5ba-07ab-4bdd-9a47-907e7b0e0e59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:43:11 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance ffce2921-d4a5-4bcb-8032-62a6dc321fb4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:43:11 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 8e816ce5-4da8-4366-9fa1-c33a45ba87fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:43:11 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 4f51cc22-e687-40e2-899a-72f2f169b154 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:43:11 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 15:43:11 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=1344MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 15:43:11 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Refreshing inventories for resource provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 15:43:11 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Updating ProviderTree inventory for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 15:43:11 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Updating inventory in ProviderTree for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 15:43:11 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Refreshing aggregate associations for resource provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de, aggregates: None {{(pid=71229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 15:43:11 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Refreshing trait associations for resource provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de, traits: COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=71229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 15:43:11 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:43:11 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:43:11 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 15:43:11 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.640s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:43:12 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:43:12 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:43:12 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:43:12 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:43:12 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 15:43:12 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "refresh_cache-ffce2921-d4a5-4bcb-8032-62a6dc321fb4" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:43:12 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquired lock "refresh_cache-ffce2921-d4a5-4bcb-8032-62a6dc321fb4" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:43:12 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Forcefully refreshing network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 15:43:13 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Updating instance_info_cache with network_info: [{"id": "910fb3d4-3965-41a2-8f97-9de79ee78c78", "address": "fa:16:3e:50:1e:37", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap910fb3d4-39", "ovs_interfaceid": "910fb3d4-3965-41a2-8f97-9de79ee78c78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:43:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Releasing lock "refresh_cache-ffce2921-d4a5-4bcb-8032-62a6dc321fb4" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:43:13 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Updated the network info_cache for instance {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 15:43:13 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:43:13 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:43:13 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:43:13 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:43:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:43:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:43:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:43:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:43:18 user nova-compute[71229]: DEBUG nova.objects.instance [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lazy-loading 'flavor' on Instance uuid 8e816ce5-4da8-4366-9fa1-c33a45ba87fd {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:43:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:43:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:43:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:43:18 user nova-compute[71229]: INFO nova.compute.manager [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Attaching volume 65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79 to /dev/vdb
Apr 11 15:43:18 user nova-compute[71229]: DEBUG os_brick.utils [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:43:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:43:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:43:18 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd5db52-4dbf-461c-b616-3f86525ac173]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d55e24a97c90\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:43:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:43:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:43:18 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad9745b-5f05-4ac3-bec2-6b8b025764f2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:43:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:43:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:43:18 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7719baca-df82-4f07-84bb-aa50a25ead59]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:43:18 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcaaa684-1edc-454d-9a36-f65bf36fa8e4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:43:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Running cmd (subprocess): nvme version {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:43:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] 'nvme version' failed. Not Retrying. {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:43:18 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] nvme not present on system {{(pid=71229) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 15:43:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:43:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:43:18 user nova-compute[71229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 15:43:18 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[697c9b72-7cf5-4da7-ba42-6edcdba4ab36]: (4, '') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:43:18 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71229) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 15:43:18 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 15:43:18 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] LIGHTOS: no hostnqn found. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 15:43:18 user nova-compute[71229]: DEBUG os_brick.utils [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d55e24a97c90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:43:18 user nova-compute[71229]: DEBUG nova.virt.block_device [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Updating existing volume attachment record: 393807f6-08a9-477f-909f-8a780ee943ad {{(pid=71229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 15:43:21 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:43:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:43:22 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 15:43:22 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gLYHaXcb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:43:22 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:43:22 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:43:22 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:43:22 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:43:22 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:43:22 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:43:22 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 15:43:22 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79 -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:43:22 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:43:22 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa71e66c-e7b1-46cd-bf00-3453bf95b88c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:43:22 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 15:43:22 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:43:22 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79 -p 172.16.0.220:3260 --interface default --op new {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:43:22 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:43:22 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[610f55d3-dd07-47cf-8e15-28e4b3d91dd9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79] added\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:43:22 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79] added
Apr 11 15:43:22 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:43:22 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:43:22 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:43:22 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0cd76d4-64c0-4786-8489-ddcb29adcfa6]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:43:22 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:43:22 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:43:22 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:43:22 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab65c9c5-c76e-40f9-8a9c-d31d50b2f152]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:43:22 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:43:22 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gLYHaXcb {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:43:22 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gLYHaXcb" returned: 0 in 0.025s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:43:22 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[658da2d7-919a-43f9-b0ed-da47a9f032ed]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:43:22 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gLYHaXcb'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:43:22 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:43:22 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:43:22 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[258bd24a-afa0-48c0-a1f8-e518d8bfcff4]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:43:22 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:43:22 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:43:22 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:43:22 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[627807d0-82d3-4a8a-bc68-9366fd9a6aea]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:43:22 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 (non-flash)
Apr 11 15:43:22 user nova-compute[71229]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea (non-flash)
Apr 11 15:43:22 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:43:22 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 (non-flash)
Apr 11 15:43:22 user nova-compute[71229]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea (non-flash)
Apr 11 15:43:22 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:43:22 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79 -p 172.16.0.220:3260 --login {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:43:22 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79 -p 172.16.0.220:3260 --login" returned: 0 in 0.100s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:43:22 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00f309f-01cd-4bfc-a053-9c8818d7f352]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:43:22 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79, portal: 172.16.0.220,3260]
Apr 11 15:43:22 user nova-compute[71229]: Login to [iface: default, target: iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79, portal: 172.16.0.220,3260] successful.
Apr 11 15:43:22 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:43:22 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:43:22 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:43:22 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[876c8b79-a614-4bb1-bad2-432d4d6b3681]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:43:22 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:43:22 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:43:22 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:43:22 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fbaf92-490c-4d71-986e-4714da8c7de7]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:43:22 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 (non-flash)
Apr 11 15:43:22 user nova-compute[71229]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea (non-flash)
Apr 11 15:43:22 user nova-compute[71229]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79 (non-flash)
Apr 11 15:43:22 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:43:22 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 (non-flash)
Apr 11 15:43:22 user nova-compute[71229]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea (non-flash)
Apr 11 15:43:22 user nova-compute[71229]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79 (non-flash)
Apr 11 15:43:22 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:43:22 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:43:22 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 15:43:22 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] HCTL ('35', '-', '-', 0) found on session 38 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 15:43:22 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 15:43:22 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:43:23 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:43:23 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[21fc7971-c10d-4691-a6a3-da9879ad7346]: (4, ('- - 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:43:23 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: None {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:43:24 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:43:24 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gLYHaXcb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 15:43:24 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:43:24 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '23431663837373437', 'path': '/dev/sdd'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:43:24 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431663837373437', 'path': '/dev/sdd'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 15:43:24 user nova-compute[71229]: DEBUG nova.objects.instance [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lazy-loading 'flavor' on Instance uuid 8e816ce5-4da8-4366-9fa1-c33a45ba87fd {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:43:24 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 15:43:24 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:43:24 user nova-compute[71229]:   <source dev="/dev/sdd"/>
Apr 11 15:43:24 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 15:43:24 user nova-compute[71229]:   <serial>65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79</serial>
Apr 11 15:43:24 user nova-compute[71229]: </disk>
Apr 11 15:43:24 user nova-compute[71229]:  {{(pid=71229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 15:43:24 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:43:24 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:43:24 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] No VIF found with MAC fa:16:3e:29:f1:87, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:43:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-78a74f78-fb3a-499c-b0c3-a62dc48ad4ea tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.161s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:43:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:43:26 user nova-compute[71229]: DEBUG nova.compute.manager [req-25d3c1a8-3e12-4949-b119-60d4030364cc req-c4b43ce3-a94f-4398-bca8-873c2b79dafc service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Received event network-changed-7f4d2694-64e4-4dd0-af87-84d67de89287 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:43:26 user nova-compute[71229]: DEBUG nova.compute.manager [req-25d3c1a8-3e12-4949-b119-60d4030364cc req-c4b43ce3-a94f-4398-bca8-873c2b79dafc service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Refreshing instance network info cache due to event network-changed-7f4d2694-64e4-4dd0-af87-84d67de89287. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:43:26 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-25d3c1a8-3e12-4949-b119-60d4030364cc req-c4b43ce3-a94f-4398-bca8-873c2b79dafc service nova] Acquiring lock "refresh_cache-8e816ce5-4da8-4366-9fa1-c33a45ba87fd" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:43:26 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-25d3c1a8-3e12-4949-b119-60d4030364cc req-c4b43ce3-a94f-4398-bca8-873c2b79dafc service nova] Acquired lock "refresh_cache-8e816ce5-4da8-4366-9fa1-c33a45ba87fd" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:43:26 user nova-compute[71229]: DEBUG nova.network.neutron [req-25d3c1a8-3e12-4949-b119-60d4030364cc req-c4b43ce3-a94f-4398-bca8-873c2b79dafc service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Refreshing network info cache for port 7f4d2694-64e4-4dd0-af87-84d67de89287 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:43:27 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:43:27 user nova-compute[71229]: DEBUG nova.network.neutron [req-25d3c1a8-3e12-4949-b119-60d4030364cc req-c4b43ce3-a94f-4398-bca8-873c2b79dafc service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Updated VIF entry in instance network info cache for port 7f4d2694-64e4-4dd0-af87-84d67de89287. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:43:27 user nova-compute[71229]: DEBUG nova.network.neutron [req-25d3c1a8-3e12-4949-b119-60d4030364cc req-c4b43ce3-a94f-4398-bca8-873c2b79dafc service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Updating instance_info_cache with network_info: [{"id": "7f4d2694-64e4-4dd0-af87-84d67de89287", "address": "fa:16:3e:29:f1:87", "network": {"id": "b1189892-ba9d-4316-9962-c737b27f14bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1737061315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c23461a3d7ca49f6a77d3fde6f1009d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f4d2694-64", "ovs_interfaceid": "7f4d2694-64e4-4dd0-af87-84d67de89287", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:43:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-25d3c1a8-3e12-4949-b119-60d4030364cc req-c4b43ce3-a94f-4398-bca8-873c2b79dafc service nova] Releasing lock "refresh_cache-8e816ce5-4da8-4366-9fa1-c33a45ba87fd" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:43:28 user nova-compute[71229]: DEBUG nova.compute.manager [req-afeb5c83-2e30-4a3d-bf4d-fd51cc1c3575 req-3c8633c1-f739-4aa1-a1ce-6fbac756c7a8 service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Received event network-changed-7f4d2694-64e4-4dd0-af87-84d67de89287 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:43:28 user nova-compute[71229]: DEBUG nova.compute.manager [req-afeb5c83-2e30-4a3d-bf4d-fd51cc1c3575 req-3c8633c1-f739-4aa1-a1ce-6fbac756c7a8 service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Refreshing instance network info cache due to event network-changed-7f4d2694-64e4-4dd0-af87-84d67de89287. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:43:28 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-afeb5c83-2e30-4a3d-bf4d-fd51cc1c3575 req-3c8633c1-f739-4aa1-a1ce-6fbac756c7a8 service nova] Acquiring lock "refresh_cache-8e816ce5-4da8-4366-9fa1-c33a45ba87fd" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:43:28 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-afeb5c83-2e30-4a3d-bf4d-fd51cc1c3575 req-3c8633c1-f739-4aa1-a1ce-6fbac756c7a8 service nova] Acquired lock "refresh_cache-8e816ce5-4da8-4366-9fa1-c33a45ba87fd" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:43:28 user nova-compute[71229]: DEBUG nova.network.neutron [req-afeb5c83-2e30-4a3d-bf4d-fd51cc1c3575 req-3c8633c1-f739-4aa1-a1ce-6fbac756c7a8 service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Refreshing network info cache for port 7f4d2694-64e4-4dd0-af87-84d67de89287 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:43:28 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-df250bbc-01c5-4c88-bc17-52c9df50a082 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:43:28 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-df250bbc-01c5-4c88-bc17-52c9df50a082 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:43:28 user nova-compute[71229]: INFO nova.compute.manager [None req-df250bbc-01c5-4c88-bc17-52c9df50a082 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Rebooting instance
Apr 11 15:43:28 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-df250bbc-01c5-4c88-bc17-52c9df50a082 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "refresh_cache-8e816ce5-4da8-4366-9fa1-c33a45ba87fd" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:43:29 user nova-compute[71229]: DEBUG nova.network.neutron [req-afeb5c83-2e30-4a3d-bf4d-fd51cc1c3575 req-3c8633c1-f739-4aa1-a1ce-6fbac756c7a8 service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Updated VIF entry in instance network info cache for port 7f4d2694-64e4-4dd0-af87-84d67de89287. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:43:29 user nova-compute[71229]: DEBUG nova.network.neutron [req-afeb5c83-2e30-4a3d-bf4d-fd51cc1c3575 req-3c8633c1-f739-4aa1-a1ce-6fbac756c7a8 service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Updating instance_info_cache with network_info: [{"id": "7f4d2694-64e4-4dd0-af87-84d67de89287", "address": "fa:16:3e:29:f1:87", "network": {"id": "b1189892-ba9d-4316-9962-c737b27f14bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1737061315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c23461a3d7ca49f6a77d3fde6f1009d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f4d2694-64", "ovs_interfaceid": "7f4d2694-64e4-4dd0-af87-84d67de89287", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:43:29 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-afeb5c83-2e30-4a3d-bf4d-fd51cc1c3575 req-3c8633c1-f739-4aa1-a1ce-6fbac756c7a8 service nova] Releasing lock "refresh_cache-8e816ce5-4da8-4366-9fa1-c33a45ba87fd" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:43:29 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-df250bbc-01c5-4c88-bc17-52c9df50a082 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquired lock "refresh_cache-8e816ce5-4da8-4366-9fa1-c33a45ba87fd" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:43:29 user nova-compute[71229]: DEBUG nova.network.neutron [None req-df250bbc-01c5-4c88-bc17-52c9df50a082 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:43:29 user nova-compute[71229]: DEBUG nova.network.neutron [None req-df250bbc-01c5-4c88-bc17-52c9df50a082 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Updating instance_info_cache with network_info: [{"id": "7f4d2694-64e4-4dd0-af87-84d67de89287", "address": "fa:16:3e:29:f1:87", "network": {"id": "b1189892-ba9d-4316-9962-c737b27f14bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1737061315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c23461a3d7ca49f6a77d3fde6f1009d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f4d2694-64", "ovs_interfaceid": "7f4d2694-64e4-4dd0-af87-84d67de89287", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:43:29 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-df250bbc-01c5-4c88-bc17-52c9df50a082 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Releasing lock "refresh_cache-8e816ce5-4da8-4366-9fa1-c33a45ba87fd" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:43:29 user nova-compute[71229]: DEBUG nova.compute.manager [None req-df250bbc-01c5-4c88-bc17-52c9df50a082 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:43:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:43:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:43:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:43:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:43:32 user nova-compute[71229]: DEBUG nova.compute.manager [req-ceb135b3-1000-4af2-bf99-ca1bf8267f9d req-29a89c68-0681-4e06-97a2-2a5ceec51538 service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Received event network-vif-unplugged-7f4d2694-64e4-4dd0-af87-84d67de89287 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:43:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-ceb135b3-1000-4af2-bf99-ca1bf8267f9d req-29a89c68-0681-4e06-97a2-2a5ceec51538 service nova] Acquiring lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:43:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-ceb135b3-1000-4af2-bf99-ca1bf8267f9d req-29a89c68-0681-4e06-97a2-2a5ceec51538 service nova] Lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:43:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-ceb135b3-1000-4af2-bf99-ca1bf8267f9d req-29a89c68-0681-4e06-97a2-2a5ceec51538 service nova] Lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:43:32 user nova-compute[71229]: DEBUG nova.compute.manager [req-ceb135b3-1000-4af2-bf99-ca1bf8267f9d req-29a89c68-0681-4e06-97a2-2a5ceec51538 service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] No waiting events found dispatching network-vif-unplugged-7f4d2694-64e4-4dd0-af87-84d67de89287 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:43:32 user nova-compute[71229]: WARNING nova.compute.manager [req-ceb135b3-1000-4af2-bf99-ca1bf8267f9d req-29a89c68-0681-4e06-97a2-2a5ceec51538 service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Received unexpected event network-vif-unplugged-7f4d2694-64e4-4dd0-af87-84d67de89287 for instance with vm_state active and task_state reboot_started.
Apr 11 15:43:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:43:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:43:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:43:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:43:32 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-df250bbc-01c5-4c88-bc17-52c9df50a082 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Instance shutdown successfully.
Apr 11 15:43:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:43:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:43:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:43:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:43:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:43:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:43:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:43:34 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:43:34 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:43:34 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:43:34 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:43:34 user nova-compute[71229]: DEBUG nova.compute.manager [req-443ab80d-7d31-4b68-b87d-0fe0a4ba9dc8 req-c3d6640e-762c-4aca-a83f-69a08e7ce53e service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Received event network-vif-plugged-7f4d2694-64e4-4dd0-af87-84d67de89287 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:43:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-443ab80d-7d31-4b68-b87d-0fe0a4ba9dc8 req-c3d6640e-762c-4aca-a83f-69a08e7ce53e service nova] Acquiring lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:43:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-443ab80d-7d31-4b68-b87d-0fe0a4ba9dc8 req-c3d6640e-762c-4aca-a83f-69a08e7ce53e service nova] Lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:43:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-443ab80d-7d31-4b68-b87d-0fe0a4ba9dc8 req-c3d6640e-762c-4aca-a83f-69a08e7ce53e service nova] Lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:43:34 user nova-compute[71229]: DEBUG nova.compute.manager [req-443ab80d-7d31-4b68-b87d-0fe0a4ba9dc8 req-c3d6640e-762c-4aca-a83f-69a08e7ce53e service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] No waiting events found dispatching network-vif-plugged-7f4d2694-64e4-4dd0-af87-84d67de89287 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:43:34 user nova-compute[71229]: WARNING nova.compute.manager [req-443ab80d-7d31-4b68-b87d-0fe0a4ba9dc8 req-c3d6640e-762c-4aca-a83f-69a08e7ce53e service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Received unexpected event network-vif-plugged-7f4d2694-64e4-4dd0-af87-84d67de89287 for instance with vm_state active and task_state reboot_started.
Apr 11 15:43:34 user nova-compute[71229]: DEBUG nova.compute.manager [req-443ab80d-7d31-4b68-b87d-0fe0a4ba9dc8 req-c3d6640e-762c-4aca-a83f-69a08e7ce53e service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Received event network-vif-plugged-7f4d2694-64e4-4dd0-af87-84d67de89287 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:43:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-443ab80d-7d31-4b68-b87d-0fe0a4ba9dc8 req-c3d6640e-762c-4aca-a83f-69a08e7ce53e service nova] Acquiring lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:43:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-443ab80d-7d31-4b68-b87d-0fe0a4ba9dc8 req-c3d6640e-762c-4aca-a83f-69a08e7ce53e service nova] Lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:43:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-443ab80d-7d31-4b68-b87d-0fe0a4ba9dc8 req-c3d6640e-762c-4aca-a83f-69a08e7ce53e service nova] Lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:43:34 user nova-compute[71229]: DEBUG nova.compute.manager [req-443ab80d-7d31-4b68-b87d-0fe0a4ba9dc8 req-c3d6640e-762c-4aca-a83f-69a08e7ce53e service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] No waiting events found dispatching network-vif-plugged-7f4d2694-64e4-4dd0-af87-84d67de89287 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:43:34 user nova-compute[71229]: WARNING nova.compute.manager [req-443ab80d-7d31-4b68-b87d-0fe0a4ba9dc8 req-c3d6640e-762c-4aca-a83f-69a08e7ce53e service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Received unexpected event network-vif-plugged-7f4d2694-64e4-4dd0-af87-84d67de89287 for instance with vm_state active and task_state reboot_started.
Apr 11 15:43:34 user nova-compute[71229]: DEBUG nova.compute.manager [req-443ab80d-7d31-4b68-b87d-0fe0a4ba9dc8 req-c3d6640e-762c-4aca-a83f-69a08e7ce53e service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Received event network-vif-plugged-7f4d2694-64e4-4dd0-af87-84d67de89287 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:43:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-443ab80d-7d31-4b68-b87d-0fe0a4ba9dc8 req-c3d6640e-762c-4aca-a83f-69a08e7ce53e service nova] Acquiring lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:43:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-443ab80d-7d31-4b68-b87d-0fe0a4ba9dc8 req-c3d6640e-762c-4aca-a83f-69a08e7ce53e service nova] Lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:43:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-443ab80d-7d31-4b68-b87d-0fe0a4ba9dc8 req-c3d6640e-762c-4aca-a83f-69a08e7ce53e service nova] Lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:43:34 user nova-compute[71229]: DEBUG nova.compute.manager [req-443ab80d-7d31-4b68-b87d-0fe0a4ba9dc8 req-c3d6640e-762c-4aca-a83f-69a08e7ce53e service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] No waiting events found dispatching network-vif-plugged-7f4d2694-64e4-4dd0-af87-84d67de89287 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:43:34 user nova-compute[71229]: WARNING nova.compute.manager [req-443ab80d-7d31-4b68-b87d-0fe0a4ba9dc8 req-c3d6640e-762c-4aca-a83f-69a08e7ce53e service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Received unexpected event network-vif-plugged-7f4d2694-64e4-4dd0-af87-84d67de89287 for instance with vm_state active and task_state reboot_started.
Apr 11 15:43:34 user nova-compute[71229]: DEBUG nova.compute.manager [req-443ab80d-7d31-4b68-b87d-0fe0a4ba9dc8 req-c3d6640e-762c-4aca-a83f-69a08e7ce53e service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Received event network-vif-unplugged-7f4d2694-64e4-4dd0-af87-84d67de89287 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:43:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-443ab80d-7d31-4b68-b87d-0fe0a4ba9dc8 req-c3d6640e-762c-4aca-a83f-69a08e7ce53e service nova] Acquiring lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:43:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-443ab80d-7d31-4b68-b87d-0fe0a4ba9dc8 req-c3d6640e-762c-4aca-a83f-69a08e7ce53e service nova] Lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:43:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-443ab80d-7d31-4b68-b87d-0fe0a4ba9dc8 req-c3d6640e-762c-4aca-a83f-69a08e7ce53e service nova] Lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:43:34 user nova-compute[71229]: DEBUG nova.compute.manager [req-443ab80d-7d31-4b68-b87d-0fe0a4ba9dc8 req-c3d6640e-762c-4aca-a83f-69a08e7ce53e service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] No waiting events found dispatching network-vif-unplugged-7f4d2694-64e4-4dd0-af87-84d67de89287 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:43:34 user nova-compute[71229]: WARNING nova.compute.manager [req-443ab80d-7d31-4b68-b87d-0fe0a4ba9dc8 req-c3d6640e-762c-4aca-a83f-69a08e7ce53e service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Received unexpected event network-vif-unplugged-7f4d2694-64e4-4dd0-af87-84d67de89287 for instance with vm_state active and task_state reboot_started.
Apr 11 15:43:34 user nova-compute[71229]: DEBUG nova.compute.manager [req-443ab80d-7d31-4b68-b87d-0fe0a4ba9dc8 req-c3d6640e-762c-4aca-a83f-69a08e7ce53e service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Received event network-vif-plugged-7f4d2694-64e4-4dd0-af87-84d67de89287 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:43:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-443ab80d-7d31-4b68-b87d-0fe0a4ba9dc8 req-c3d6640e-762c-4aca-a83f-69a08e7ce53e service nova] Acquiring lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:43:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-443ab80d-7d31-4b68-b87d-0fe0a4ba9dc8 req-c3d6640e-762c-4aca-a83f-69a08e7ce53e service nova] Lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:43:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-443ab80d-7d31-4b68-b87d-0fe0a4ba9dc8 req-c3d6640e-762c-4aca-a83f-69a08e7ce53e service nova] Lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:43:34 user nova-compute[71229]: DEBUG nova.compute.manager [req-443ab80d-7d31-4b68-b87d-0fe0a4ba9dc8 req-c3d6640e-762c-4aca-a83f-69a08e7ce53e service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] No waiting events found dispatching network-vif-plugged-7f4d2694-64e4-4dd0-af87-84d67de89287 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:43:34 user nova-compute[71229]: WARNING nova.compute.manager [req-443ab80d-7d31-4b68-b87d-0fe0a4ba9dc8 req-c3d6640e-762c-4aca-a83f-69a08e7ce53e service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Received unexpected event network-vif-plugged-7f4d2694-64e4-4dd0-af87-84d67de89287 for instance with vm_state active and task_state reboot_started.
Apr 11 15:43:34 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:43:34 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:43:34 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:43:36 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Removed pending event for 8e816ce5-4da8-4366-9fa1-c33a45ba87fd due to event {{(pid=71229) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 15:43:36 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227816.3117764, 8e816ce5-4da8-4366-9fa1-c33a45ba87fd => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:43:36 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] VM Resumed (Lifecycle Event)
Apr 11 15:43:36 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Instance running successfully.
Apr 11 15:43:36 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-df250bbc-01c5-4c88-bc17-52c9df50a082 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Instance soft rebooted successfully.
Apr 11 15:43:36 user nova-compute[71229]: DEBUG nova.compute.manager [None req-df250bbc-01c5-4c88-bc17-52c9df50a082 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:43:36 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:43:36 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:43:36 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] During sync_power_state the instance has a pending task (reboot_started). Skip.
Apr 11 15:43:36 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227816.313513, 8e816ce5-4da8-4366-9fa1-c33a45ba87fd => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:43:36 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] VM Started (Lifecycle Event)
Apr 11 15:43:36 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:43:36 user nova-compute[71229]: DEBUG nova.compute.manager [req-27b2e11e-357d-4504-a737-cd506c47a412 req-40eb2a5a-fc60-404f-8640-bc48420eed8f service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Received event network-vif-plugged-7f4d2694-64e4-4dd0-af87-84d67de89287 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:43:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-27b2e11e-357d-4504-a737-cd506c47a412 req-40eb2a5a-fc60-404f-8640-bc48420eed8f service nova] Acquiring lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:43:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-27b2e11e-357d-4504-a737-cd506c47a412 req-40eb2a5a-fc60-404f-8640-bc48420eed8f service nova] Lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:43:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-27b2e11e-357d-4504-a737-cd506c47a412 req-40eb2a5a-fc60-404f-8640-bc48420eed8f service nova] Lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:43:36 user nova-compute[71229]: DEBUG nova.compute.manager [req-27b2e11e-357d-4504-a737-cd506c47a412 req-40eb2a5a-fc60-404f-8640-bc48420eed8f service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] No waiting events found dispatching network-vif-plugged-7f4d2694-64e4-4dd0-af87-84d67de89287 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:43:36 user nova-compute[71229]: WARNING nova.compute.manager [req-27b2e11e-357d-4504-a737-cd506c47a412 req-40eb2a5a-fc60-404f-8640-bc48420eed8f service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Received unexpected event network-vif-plugged-7f4d2694-64e4-4dd0-af87-84d67de89287 for instance with vm_state active and task_state reboot_started.
Apr 11 15:43:36 user nova-compute[71229]: DEBUG nova.compute.manager [req-27b2e11e-357d-4504-a737-cd506c47a412 req-40eb2a5a-fc60-404f-8640-bc48420eed8f service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Received event network-vif-plugged-7f4d2694-64e4-4dd0-af87-84d67de89287 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:43:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-27b2e11e-357d-4504-a737-cd506c47a412 req-40eb2a5a-fc60-404f-8640-bc48420eed8f service nova] Acquiring lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:43:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-27b2e11e-357d-4504-a737-cd506c47a412 req-40eb2a5a-fc60-404f-8640-bc48420eed8f service nova] Lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:43:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-27b2e11e-357d-4504-a737-cd506c47a412 req-40eb2a5a-fc60-404f-8640-bc48420eed8f service nova] Lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:43:36 user nova-compute[71229]: DEBUG nova.compute.manager [req-27b2e11e-357d-4504-a737-cd506c47a412 req-40eb2a5a-fc60-404f-8640-bc48420eed8f service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] No waiting events found dispatching network-vif-plugged-7f4d2694-64e4-4dd0-af87-84d67de89287 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:43:36 user nova-compute[71229]: WARNING nova.compute.manager [req-27b2e11e-357d-4504-a737-cd506c47a412 req-40eb2a5a-fc60-404f-8640-bc48420eed8f service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Received unexpected event network-vif-plugged-7f4d2694-64e4-4dd0-af87-84d67de89287 for instance with vm_state active and task_state reboot_started.
Apr 11 15:43:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-df250bbc-01c5-4c88-bc17-52c9df50a082 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.563s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:43:36 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:43:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:43:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:43:42 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:43:42 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:43:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:43:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:43:52 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:43:52 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:43:52 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ffce2921-d4a5-4bcb-8032-62a6dc321fb4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:43:52 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ffce2921-d4a5-4bcb-8032-62a6dc321fb4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:43:52 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "ffce2921-d4a5-4bcb-8032-62a6dc321fb4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:43:52 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ffce2921-d4a5-4bcb-8032-62a6dc321fb4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:43:52 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ffce2921-d4a5-4bcb-8032-62a6dc321fb4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:43:52 user nova-compute[71229]: INFO nova.compute.manager [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Terminating instance
Apr 11 15:43:52 user nova-compute[71229]: DEBUG nova.compute.manager [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Start destroying the instance on the hypervisor. {{(pid=71229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 15:43:52 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:43:52 user nova-compute[71229]: DEBUG nova.compute.manager [req-8e40cddb-cbed-4a38-8d5e-c4fb5203de7d req-30f8400c-6d91-4eca-b0b4-258ac3e2b58c service nova] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Received event network-vif-unplugged-910fb3d4-3965-41a2-8f97-9de79ee78c78 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:43:52 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-8e40cddb-cbed-4a38-8d5e-c4fb5203de7d req-30f8400c-6d91-4eca-b0b4-258ac3e2b58c service nova] Acquiring lock "ffce2921-d4a5-4bcb-8032-62a6dc321fb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:43:52 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-8e40cddb-cbed-4a38-8d5e-c4fb5203de7d req-30f8400c-6d91-4eca-b0b4-258ac3e2b58c service nova] Lock "ffce2921-d4a5-4bcb-8032-62a6dc321fb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:43:52 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-8e40cddb-cbed-4a38-8d5e-c4fb5203de7d req-30f8400c-6d91-4eca-b0b4-258ac3e2b58c service nova] Lock "ffce2921-d4a5-4bcb-8032-62a6dc321fb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:43:52 user nova-compute[71229]: DEBUG nova.compute.manager [req-8e40cddb-cbed-4a38-8d5e-c4fb5203de7d req-30f8400c-6d91-4eca-b0b4-258ac3e2b58c service nova] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] No waiting events found dispatching network-vif-unplugged-910fb3d4-3965-41a2-8f97-9de79ee78c78 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:43:52 user nova-compute[71229]: DEBUG nova.compute.manager [req-8e40cddb-cbed-4a38-8d5e-c4fb5203de7d req-30f8400c-6d91-4eca-b0b4-258ac3e2b58c service nova] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Received event network-vif-unplugged-910fb3d4-3965-41a2-8f97-9de79ee78c78 for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 15:43:52 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:43:52 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:43:53 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Instance destroyed successfully.
Apr 11 15:43:53 user nova-compute[71229]: DEBUG nova.objects.instance [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lazy-loading 'resources' on Instance uuid ffce2921-d4a5-4bcb-8032-62a6dc321fb4 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:37:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-794339141',display_name='tempest-ServerActionsTestJSON-server-794339141',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-794339141',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfAJGQ+GOa8zW+jlKgD9Kz6/k6iEv9pZIOIjICzcstJ92AAS94+47mc3fRsqyx5FaTMV9P4lTsW4Fy7tKIAtMpRx0Sl7sa6ttQnPbPhlcYqfbdWbTqmmKi6+BuZpqSknA==',key_name='tempest-keypair-1137963694',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:39:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bb7660e8f76b471487136806ee9eec62',ramdisk_id='',reservation_id='r-g3c0fmpg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1659503440',owner_user_name='tempest-ServerActionsTestJSON-1659503440-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:41:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10720df0ac4f4e62a0a5c9883d600add',uuid=ffce2921-d4a5-4bcb-8032-62a6dc321fb4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "910fb3d4-3965-41a2-8f97-9de79ee78c78", "address": "fa:16:3e:50:1e:37", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap910fb3d4-39", "ovs_interfaceid": "910fb3d4-3965-41a2-8f97-9de79ee78c78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Converting VIF {"id": "910fb3d4-3965-41a2-8f97-9de79ee78c78", "address": "fa:16:3e:50:1e:37", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap910fb3d4-39", "ovs_interfaceid": "910fb3d4-3965-41a2-8f97-9de79ee78c78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:1e:37,bridge_name='br-int',has_traffic_filtering=True,id=910fb3d4-3965-41a2-8f97-9de79ee78c78,network=Network(1bd215e8-0459-4dd2-893b-096b6e31ac08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap910fb3d4-39') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG os_vif [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:1e:37,bridge_name='br-int',has_traffic_filtering=True,id=910fb3d4-3965-41a2-8f97-9de79ee78c78,network=Network(1bd215e8-0459-4dd2-893b-096b6e31ac08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap910fb3d4-39') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap910fb3d4-39, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:43:53 user nova-compute[71229]: INFO os_vif [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:1e:37,bridge_name='br-int',has_traffic_filtering=True,id=910fb3d4-3965-41a2-8f97-9de79ee78c78,network=Network(1bd215e8-0459-4dd2-893b-096b6e31ac08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap910fb3d4-39')
Apr 11 15:43:53 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gSNaBYAr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:43:53 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:43:53 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4855f339-31f5-44e6-88de-c4b13c89525d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 15:43:53 user nova-compute[71229]: No targets found.
Apr 11 15:43:53 user nova-compute[71229]: iSNS:
Apr 11 15:43:53 user nova-compute[71229]: No targets found.
Apr 11 15:43:53 user nova-compute[71229]: STATIC:
Apr 11 15:43:53 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79
Apr 11 15:43:53 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:43:53 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:43:53 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68
Apr 11 15:43:53 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:43:53 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:43:53 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea
Apr 11 15:43:53 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:43:53 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:43:53 user nova-compute[71229]: FIRMWARE:
Apr 11 15:43:53 user nova-compute[71229]: No targets found.
Apr 11 15:43:53 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 15:43:53 user nova-compute[71229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 15:43:53 user nova-compute[71229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71229) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68', 0)] {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d79916-7b30-44cf-85e5-8981c3fa4570]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[99cad23b-991b-4cd7-a544-90d167fda13c]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 (non-flash)
Apr 11 15:43:53 user nova-compute[71229]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea (non-flash)
Apr 11 15:43:53 user nova-compute[71229]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79 (non-flash)
Apr 11 15:43:53 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 (non-flash)
Apr 11 15:43:53 user nova-compute[71229]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea (non-flash)
Apr 11 15:43:53 user nova-compute[71229]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79 (non-flash)
Apr 11 15:43:53 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb5c2feb00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68'): ({'sdc'}, set())}) {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Removing single pathed devices sdc {{(pid=71229) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6bceb68-93d9-41cb-a87c-32b291c10235]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b282434a-9e3f-4c52-8690-2276f0466667]: (4, ('ok\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Flushing IO for device /dev/sdc {{(pid=71229) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8556e8d-5a0e-48de-9718-107d3a68a43d]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71229) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.061s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac492937-d184-411b-8dfb-7c8194c03987]: (4, ('1', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] SCSI volumes sdc have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68')] {{(pid=71229) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd38f021-c90a-41d0-a9ce-e74d3317a2ac]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 -p 172.16.0.220:3260 --logout {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9161807f-ffcf-40b8-963b-e97f4b7cd2f6]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68, portal: 172.16.0.220,3260]
Apr 11 15:43:53 user nova-compute[71229]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68, portal: 172.16.0.220,3260] successful.
Apr 11 15:43:53 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 -p 172.16.0.220:3260 --op delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d29c73-7b06-45f4-90e0-01a41825cc68 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[807804f3-6594-4b23-80d9-8f221c65c8ce]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] <== disconnect_volume: return (318ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 15:43:53 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Deleting instance files /opt/stack/data/nova/instances/ffce2921-d4a5-4bcb-8032-62a6dc321fb4_del
Apr 11 15:43:53 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Deletion of /opt/stack/data/nova/instances/ffce2921-d4a5-4bcb-8032-62a6dc321fb4_del complete
Apr 11 15:43:53 user nova-compute[71229]: INFO nova.compute.manager [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Took 1.17 seconds to destroy the instance on the hypervisor.
Apr 11 15:43:53 user nova-compute[71229]: DEBUG oslo.service.loopingcall [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71229) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG nova.compute.manager [-] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Deallocating network for instance {{(pid=71229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 15:43:53 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] deallocate_for_instance() {{(pid=71229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 15:43:54 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:43:54 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Took 0.70 seconds to deallocate network for instance.
Apr 11 15:43:54 user nova-compute[71229]: DEBUG nova.compute.manager [req-84e8d2a0-1deb-4b58-848d-e404f9764276 req-01026e6a-1828-4906-b5df-2d10d96971b5 service nova] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Received event network-vif-deleted-910fb3d4-3965-41a2-8f97-9de79ee78c78 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:43:54 user nova-compute[71229]: DEBUG nova.compute.manager [req-0cdf54c3-bc7f-40d6-9bf2-ee165d1805bc req-7ccf93cc-7e7b-457f-8f77-2e7c90008ea4 service nova] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Received event network-vif-plugged-910fb3d4-3965-41a2-8f97-9de79ee78c78 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:43:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-0cdf54c3-bc7f-40d6-9bf2-ee165d1805bc req-7ccf93cc-7e7b-457f-8f77-2e7c90008ea4 service nova] Acquiring lock "ffce2921-d4a5-4bcb-8032-62a6dc321fb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:43:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-0cdf54c3-bc7f-40d6-9bf2-ee165d1805bc req-7ccf93cc-7e7b-457f-8f77-2e7c90008ea4 service nova] Lock "ffce2921-d4a5-4bcb-8032-62a6dc321fb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:43:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-0cdf54c3-bc7f-40d6-9bf2-ee165d1805bc req-7ccf93cc-7e7b-457f-8f77-2e7c90008ea4 service nova] Lock "ffce2921-d4a5-4bcb-8032-62a6dc321fb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:43:54 user nova-compute[71229]: DEBUG nova.compute.manager [req-0cdf54c3-bc7f-40d6-9bf2-ee165d1805bc req-7ccf93cc-7e7b-457f-8f77-2e7c90008ea4 service nova] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] No waiting events found dispatching network-vif-plugged-910fb3d4-3965-41a2-8f97-9de79ee78c78 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:43:54 user nova-compute[71229]: WARNING nova.compute.manager [req-0cdf54c3-bc7f-40d6-9bf2-ee165d1805bc req-7ccf93cc-7e7b-457f-8f77-2e7c90008ea4 service nova] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Received unexpected event network-vif-plugged-910fb3d4-3965-41a2-8f97-9de79ee78c78 for instance with vm_state active and task_state deleting.
Apr 11 15:43:55 user nova-compute[71229]: INFO nova.compute.manager [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Took 0.81 seconds to detach 1 volumes for instance.
Apr 11 15:43:55 user nova-compute[71229]: DEBUG nova.compute.manager [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Deleting volume: 98d29c73-7b06-45f4-90e0-01a41825cc68 {{(pid=71229) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 11 15:43:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:43:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:43:55 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:43:55 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:43:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.240s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:43:55 user nova-compute[71229]: INFO nova.scheduler.client.report [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Deleted allocations for instance ffce2921-d4a5-4bcb-8032-62a6dc321fb4
Apr 11 15:43:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-17c6ea45-61a5-46aa-b72f-6a36dff1001d tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "ffce2921-d4a5-4bcb-8032-62a6dc321fb4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.169s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:43:57 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:43:58 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:44:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:44:03 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:44:04 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:44:04 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 15:44:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "4f51cc22-e687-40e2-899a-72f2f169b154" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:44:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "4f51cc22-e687-40e2-899a-72f2f169b154" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:44:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "4f51cc22-e687-40e2-899a-72f2f169b154-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:44:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "4f51cc22-e687-40e2-899a-72f2f169b154-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:44:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "4f51cc22-e687-40e2-899a-72f2f169b154-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:44:05 user nova-compute[71229]: INFO nova.compute.manager [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Terminating instance
Apr 11 15:44:05 user nova-compute[71229]: DEBUG nova.compute.manager [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Start destroying the instance on the hypervisor. {{(pid=71229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 15:44:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:44:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:44:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:44:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG nova.compute.manager [req-592adfef-6b71-4e3b-afeb-6bf5512c77bc req-70c12964-8b4a-41a0-858c-548f708ef6e6 service nova] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Received event network-vif-unplugged-66c0193e-7320-4344-8ef3-419b21bbbba7 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-592adfef-6b71-4e3b-afeb-6bf5512c77bc req-70c12964-8b4a-41a0-858c-548f708ef6e6 service nova] Acquiring lock "4f51cc22-e687-40e2-899a-72f2f169b154-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-592adfef-6b71-4e3b-afeb-6bf5512c77bc req-70c12964-8b4a-41a0-858c-548f708ef6e6 service nova] Lock "4f51cc22-e687-40e2-899a-72f2f169b154-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-592adfef-6b71-4e3b-afeb-6bf5512c77bc req-70c12964-8b4a-41a0-858c-548f708ef6e6 service nova] Lock "4f51cc22-e687-40e2-899a-72f2f169b154-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG nova.compute.manager [req-592adfef-6b71-4e3b-afeb-6bf5512c77bc req-70c12964-8b4a-41a0-858c-548f708ef6e6 service nova] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] No waiting events found dispatching network-vif-unplugged-66c0193e-7320-4344-8ef3-419b21bbbba7 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG nova.compute.manager [req-592adfef-6b71-4e3b-afeb-6bf5512c77bc req-70c12964-8b4a-41a0-858c-548f708ef6e6 service nova] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Received event network-vif-unplugged-66c0193e-7320-4344-8ef3-419b21bbbba7 for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 15:44:06 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Instance destroyed successfully.
Apr 11 15:44:06 user nova-compute[71229]: DEBUG nova.objects.instance [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lazy-loading 'resources' on Instance uuid 4f51cc22-e687-40e2-899a-72f2f169b154 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:42:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-430537775',display_name='tempest-TestVolumeBootPattern-server-430537775',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-430537775',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:42:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='312851c65ba1434691eca0cd2a8cd6d2',ramdisk_id='',reservation_id='r-wbk5o8e3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1933582504',owner_user_name='tempest-TestVolumeBootPattern-1933582504-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:42:32Z,user_data=None,user_id='c2110b74f38642afa560e1c9790d3f81',uuid=4f51cc22-e687-40e2-899a-72f2f169b154,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "66c0193e-7320-4344-8ef3-419b21bbbba7", "address": "fa:16:3e:83:ef:5b", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c0193e-73", "ovs_interfaceid": "66c0193e-7320-4344-8ef3-419b21bbbba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Converting VIF {"id": "66c0193e-7320-4344-8ef3-419b21bbbba7", "address": "fa:16:3e:83:ef:5b", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c0193e-73", "ovs_interfaceid": "66c0193e-7320-4344-8ef3-419b21bbbba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:ef:5b,bridge_name='br-int',has_traffic_filtering=True,id=66c0193e-7320-4344-8ef3-419b21bbbba7,network=Network(8d262ba8-b9c3-44ed-8431-6c295eb9ea24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66c0193e-73') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG os_vif [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:ef:5b,bridge_name='br-int',has_traffic_filtering=True,id=66c0193e-7320-4344-8ef3-419b21bbbba7,network=Network(8d262ba8-b9c3-44ed-8431-6c295eb9ea24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66c0193e-73') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap66c0193e-73, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:44:06 user nova-compute[71229]: INFO os_vif [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:ef:5b,bridge_name='br-int',has_traffic_filtering=True,id=66c0193e-7320-4344-8ef3-419b21bbbba7,network=Network(8d262ba8-b9c3-44ed-8431-6c295eb9ea24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66c0193e-73')
Apr 11 15:44:06 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZPGqhwAD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:44:06 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:44:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03721a4-29b0-4486-a635-1b277f1d8168]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 15:44:06 user nova-compute[71229]: No targets found.
Apr 11 15:44:06 user nova-compute[71229]: iSNS:
Apr 11 15:44:06 user nova-compute[71229]: No targets found.
Apr 11 15:44:06 user nova-compute[71229]: STATIC:
Apr 11 15:44:06 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79
Apr 11 15:44:06 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:44:06 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:44:06 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea
Apr 11 15:44:06 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:44:06 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:44:06 user nova-compute[71229]: FIRMWARE:
Apr 11 15:44:06 user nova-compute[71229]: No targets found.
Apr 11 15:44:06 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 15:44:06 user nova-compute[71229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 15:44:06 user nova-compute[71229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71229) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea', 0)] {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[81771b3c-d868-4c74-9af6-38019a431fa4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[accec0fa-5ec2-46a0-be5e-65d7614073f7]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea (non-flash)
Apr 11 15:44:06 user nova-compute[71229]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79 (non-flash)
Apr 11 15:44:06 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea (non-flash)
Apr 11 15:44:06 user nova-compute[71229]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79 (non-flash)
Apr 11 15:44:06 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb5c2829e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea'): ({'sdb'}, set())}) {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Removing single pathed devices sdb {{(pid=71229) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5f773f-b7e0-4e66-bb64-5040f976098b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1bc2e9-07ac-41da-af65-d3b64e12fad0]: (4, ('ok\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Flushing IO for device /dev/sdb {{(pid=71229) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5e6815-b1d3-4c60-8854-94a65b0c08bb]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71229) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[610505d3-91bc-495b-ae03-a81494ec5102]: (4, ('1', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] SCSI volumes sdb have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26365303962373864', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_35d5af2f', '/dev/disk/by-id/scsi-1SCST_BIO35d5af2f-ce09b78dbb195c76') {{(pid=81310) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[93462b54-ab67-4b06-aa90-9110f7ba8a9e]: (4, None) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea')] {{(pid=71229) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce45e4d-dea5-4c4b-b7c7-1b5663ac3c52]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea -p 172.16.0.220:3260 --logout {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[126e28cd-87ab-4836-b905-3827c0a145bc]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea, portal: 172.16.0.220,3260]
Apr 11 15:44:06 user nova-compute[71229]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea, portal: 172.16.0.220,3260] successful.
Apr 11 15:44:06 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea -p 172.16.0.220:3260 --op delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75f6a2d2-2c23-4678-a4bd-7e61625149ea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d43a517-4326-4604-8a9c-05f9a7864ac3]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] <== disconnect_volume: return (305ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 15:44:06 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Deleting instance files /opt/stack/data/nova/instances/4f51cc22-e687-40e2-899a-72f2f169b154_del
Apr 11 15:44:06 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Deletion of /opt/stack/data/nova/instances/4f51cc22-e687-40e2-899a-72f2f169b154_del complete
Apr 11 15:44:06 user nova-compute[71229]: INFO nova.compute.manager [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Took 1.12 seconds to destroy the instance on the hypervisor.
Apr 11 15:44:06 user nova-compute[71229]: DEBUG oslo.service.loopingcall [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71229) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG nova.compute.manager [-] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Deallocating network for instance {{(pid=71229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 15:44:06 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] deallocate_for_instance() {{(pid=71229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 15:44:07 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:44:07 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Took 0.44 seconds to deallocate network for instance.
Apr 11 15:44:07 user nova-compute[71229]: DEBUG nova.compute.manager [req-52e52f5c-2716-4348-b82a-9950ee63644d req-8710c892-073c-4ed3-8221-186dc694cabb service nova] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Received event network-vif-deleted-66c0193e-7320-4344-8ef3-419b21bbbba7 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:44:07 user nova-compute[71229]: INFO nova.compute.manager [req-52e52f5c-2716-4348-b82a-9950ee63644d req-8710c892-073c-4ed3-8221-186dc694cabb service nova] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Neutron deleted interface 66c0193e-7320-4344-8ef3-419b21bbbba7; detaching it from the instance and deleting it from the info cache
Apr 11 15:44:07 user nova-compute[71229]: DEBUG nova.network.neutron [req-52e52f5c-2716-4348-b82a-9950ee63644d req-8710c892-073c-4ed3-8221-186dc694cabb service nova] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:44:07 user nova-compute[71229]: DEBUG nova.compute.manager [req-52e52f5c-2716-4348-b82a-9950ee63644d req-8710c892-073c-4ed3-8221-186dc694cabb service nova] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Detach interface failed, port_id=66c0193e-7320-4344-8ef3-419b21bbbba7, reason: Instance 4f51cc22-e687-40e2-899a-72f2f169b154 could not be found. {{(pid=71229) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 15:44:08 user nova-compute[71229]: DEBUG nova.compute.manager [req-0744d034-2256-4947-b77d-1a14291a76b5 req-0f7c478c-ca73-44f4-8e00-272a776765ca service nova] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Received event network-vif-plugged-66c0193e-7320-4344-8ef3-419b21bbbba7 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:44:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-0744d034-2256-4947-b77d-1a14291a76b5 req-0f7c478c-ca73-44f4-8e00-272a776765ca service nova] Acquiring lock "4f51cc22-e687-40e2-899a-72f2f169b154-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:44:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-0744d034-2256-4947-b77d-1a14291a76b5 req-0f7c478c-ca73-44f4-8e00-272a776765ca service nova] Lock "4f51cc22-e687-40e2-899a-72f2f169b154-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:44:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-0744d034-2256-4947-b77d-1a14291a76b5 req-0f7c478c-ca73-44f4-8e00-272a776765ca service nova] Lock "4f51cc22-e687-40e2-899a-72f2f169b154-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:44:08 user nova-compute[71229]: DEBUG nova.compute.manager [req-0744d034-2256-4947-b77d-1a14291a76b5 req-0f7c478c-ca73-44f4-8e00-272a776765ca service nova] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] No waiting events found dispatching network-vif-plugged-66c0193e-7320-4344-8ef3-419b21bbbba7 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:44:08 user nova-compute[71229]: WARNING nova.compute.manager [req-0744d034-2256-4947-b77d-1a14291a76b5 req-0f7c478c-ca73-44f4-8e00-272a776765ca service nova] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Received unexpected event network-vif-plugged-66c0193e-7320-4344-8ef3-419b21bbbba7 for instance with vm_state active and task_state deleting.
Apr 11 15:44:08 user nova-compute[71229]: INFO nova.compute.manager [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Took 0.77 seconds to detach 1 volumes for instance.
Apr 11 15:44:08 user nova-compute[71229]: DEBUG nova.compute.manager [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Deleting volume: 75f6a2d2-2c23-4678-a4bd-7e61625149ea {{(pid=71229) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 11 15:44:08 user nova-compute[71229]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681227833.1315413, ffce2921-d4a5-4bcb-8032-62a6dc321fb4 => Stopped> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:44:08 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] VM Stopped (Lifecycle Event)
Apr 11 15:44:08 user nova-compute[71229]: DEBUG nova.compute.manager [None req-f3f505af-b65c-4ca6-a2a9-c31ce900969b None None] [instance: ffce2921-d4a5-4bcb-8032-62a6dc321fb4] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:44:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:44:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:44:08 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:44:08 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:44:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.197s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:44:08 user nova-compute[71229]: INFO nova.scheduler.client.report [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Deleted allocations for instance 4f51cc22-e687-40e2-899a-72f2f169b154
Apr 11 15:44:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-613586bd-8358-4d6a-92b2-cb699cdcde42 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "4f51cc22-e687-40e2-899a-72f2f169b154" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.901s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:44:08 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:44:08 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:44:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:44:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:44:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:44:08 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 15:44:08 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e816ce5-4da8-4366-9fa1-c33a45ba87fd/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:44:08 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e816ce5-4da8-4366-9fa1-c33a45ba87fd/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:44:08 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e816ce5-4da8-4366-9fa1-c33a45ba87fd/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:44:09 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e816ce5-4da8-4366-9fa1-c33a45ba87fd/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:44:09 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:44:09 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:44:09 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:44:09 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:44:09 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:44:09 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:44:09 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:44:09 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:44:09 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:44:09 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:44:09 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:44:09 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:44:09 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:44:10 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:44:10 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:44:10 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:44:10 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:44:10 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:44:10 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:44:10 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8431MB free_disk=25.98682403564453GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 15:44:10 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:44:10 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:44:10 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance dcbfcbfd-7e96-4271-94ee-60ef937e3b7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:44:10 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 6f6ae64a-c760-4ba3-8a50-d380835d9913 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:44:10 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 058df5ba-07ab-4bdd-9a47-907e7b0e0e59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:44:10 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 8e816ce5-4da8-4366-9fa1-c33a45ba87fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:44:10 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 15:44:10 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 15:44:10 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:44:10 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:44:10 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 15:44:10 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.270s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:44:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:44:12 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:44:12 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:44:12 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 15:44:12 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Rebuilding the list of instances to heal {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 15:44:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "refresh_cache-dcbfcbfd-7e96-4271-94ee-60ef937e3b7e" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:44:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquired lock "refresh_cache-dcbfcbfd-7e96-4271-94ee-60ef937e3b7e" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:44:13 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Forcefully refreshing network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 15:44:13 user nova-compute[71229]: DEBUG nova.objects.instance [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lazy-loading 'info_cache' on Instance uuid dcbfcbfd-7e96-4271-94ee-60ef937e3b7e {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:44:13 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Updating instance_info_cache with network_info: [{"id": "32c006ee-14e2-47d8-b999-bafc729aa67a", "address": "fa:16:3e:1a:bd:54", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c006ee-14", "ovs_interfaceid": "32c006ee-14e2-47d8-b999-bafc729aa67a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:44:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Releasing lock "refresh_cache-dcbfcbfd-7e96-4271-94ee-60ef937e3b7e" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:44:13 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Updated the network info_cache for instance {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 15:44:13 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:44:13 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:44:14 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:44:15 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:44:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:44:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:44:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:44:20 user nova-compute[71229]: DEBUG nova.compute.manager [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Starting instance... {{(pid=71229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 15:44:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:44:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:44:20 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 15:44:20 user nova-compute[71229]: INFO nova.compute.claims [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Claim successful on node user
Apr 11 15:44:20 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:44:20 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:44:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.270s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:44:20 user nova-compute[71229]: DEBUG nova.compute.manager [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Start building networks asynchronously for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 15:44:21 user nova-compute[71229]: DEBUG nova.compute.manager [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Allocating IP information in the background. {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 15:44:21 user nova-compute[71229]: DEBUG nova.network.neutron [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] allocate_for_instance() {{(pid=71229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 15:44:21 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 15:44:21 user nova-compute[71229]: DEBUG nova.compute.manager [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Start building block device mappings for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 15:44:21 user nova-compute[71229]: DEBUG nova.policy [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5c8492f96e5d4f54aaae3679c82b6759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd700a53aa25849e0afd562b05881d09a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71229) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 15:44:21 user nova-compute[71229]: DEBUG nova.compute.manager [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Start spawning the instance on the hypervisor. {{(pid=71229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 15:44:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Creating instance directory {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 15:44:21 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Creating image(s)
Apr 11 15:44:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "/opt/stack/data/nova/instances/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:44:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "/opt/stack/data/nova/instances/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:44:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "/opt/stack/data/nova/instances/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:44:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:44:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.139s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:44:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:44:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:44:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:44:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.143s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:44:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/disk 1073741824 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:44:21 user nova-compute[71229]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681227846.4875832, 4f51cc22-e687-40e2-899a-72f2f169b154 => Stopped> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:44:21 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] VM Stopped (Lifecycle Event)
Apr 11 15:44:21 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:44:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/disk 1073741824" returned: 0 in 0.073s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:44:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:44:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:44:21 user nova-compute[71229]: DEBUG nova.compute.manager [None req-58d65b17-69c5-438c-a0fa-0491792ccc38 None None] [instance: 4f51cc22-e687-40e2-899a-72f2f169b154] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:44:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.189s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:44:21 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/disk. size=1073741824 {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 15:44:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:44:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:44:21 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Cannot resize image /opt/stack/data/nova/instances/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/disk to a smaller size. {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 15:44:21 user nova-compute[71229]: DEBUG nova.objects.instance [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lazy-loading 'migration_context' on Instance uuid c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:44:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Created local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 15:44:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Ensure instance console log exists: /opt/stack/data/nova/instances/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 15:44:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:44:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:44:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:44:22 user nova-compute[71229]: DEBUG nova.network.neutron [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Successfully created port: 35ac8f6f-2998-4274-ab63-df7086194703 {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 15:44:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:44:22 user nova-compute[71229]: DEBUG nova.network.neutron [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Successfully updated port: 35ac8f6f-2998-4274-ab63-df7086194703 {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:44:22 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "refresh_cache-c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:44:22 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquired lock "refresh_cache-c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:44:22 user nova-compute[71229]: DEBUG nova.network.neutron [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:44:22 user nova-compute[71229]: DEBUG nova.compute.manager [req-8d06e4ac-ef49-4b32-af0b-6b2bd71765c5 req-4f1e6b7e-4469-44d3-8c14-03709cb6dcda service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Received event network-changed-35ac8f6f-2998-4274-ab63-df7086194703 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:44:22 user nova-compute[71229]: DEBUG nova.compute.manager [req-8d06e4ac-ef49-4b32-af0b-6b2bd71765c5 req-4f1e6b7e-4469-44d3-8c14-03709cb6dcda service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Refreshing instance network info cache due to event network-changed-35ac8f6f-2998-4274-ab63-df7086194703. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:44:22 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-8d06e4ac-ef49-4b32-af0b-6b2bd71765c5 req-4f1e6b7e-4469-44d3-8c14-03709cb6dcda service nova] Acquiring lock "refresh_cache-c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:44:22 user nova-compute[71229]: DEBUG nova.network.neutron [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:44:23 user nova-compute[71229]: DEBUG nova.network.neutron [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Updating instance_info_cache with network_info: [{"id": "35ac8f6f-2998-4274-ab63-df7086194703", "address": "fa:16:3e:47:3b:c6", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ac8f6f-29", "ovs_interfaceid": "35ac8f6f-2998-4274-ab63-df7086194703", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:44:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Releasing lock "refresh_cache-c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:44:23 user nova-compute[71229]: DEBUG nova.compute.manager [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Instance network_info: |[{"id": "35ac8f6f-2998-4274-ab63-df7086194703", "address": "fa:16:3e:47:3b:c6", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ac8f6f-29", "ovs_interfaceid": "35ac8f6f-2998-4274-ab63-df7086194703", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 15:44:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-8d06e4ac-ef49-4b32-af0b-6b2bd71765c5 req-4f1e6b7e-4469-44d3-8c14-03709cb6dcda service nova] Acquired lock "refresh_cache-c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:44:23 user nova-compute[71229]: DEBUG nova.network.neutron [req-8d06e4ac-ef49-4b32-af0b-6b2bd71765c5 req-4f1e6b7e-4469-44d3-8c14-03709cb6dcda service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Refreshing network info cache for port 35ac8f6f-2998-4274-ab63-df7086194703 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:44:23 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Start _get_guest_xml network_info=[{"id": "35ac8f6f-2998-4274-ab63-df7086194703", "address": "fa:16:3e:47:3b:c6", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ac8f6f-29", "ovs_interfaceid": "35ac8f6f-2998-4274-ab63-df7086194703", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '52fe638c-5ada-47d5-b376-233bfa808a37'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:44:23 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:44:23 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:44:23 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:44:23 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:44:23 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:44:23 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:44:23 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:44:23 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:44:23 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:44:23 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:44:23 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:44:23 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:44:23 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:44:23 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:44:23 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:44:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1921913590',display_name='tempest-ServerRescueNegativeTestJSON-server-1921913590',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1921913590',id=33,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPYdVbZDtC1igDufA6PhMZJpvm+SfaXlWlDTwlgCYAsIhgsTCFIatXSmQzAx4qEEtvrM9m6Ml8tgUz/SNa6YjJmdUHImSQvQGbvvCZehYMuZMwW6pbpX8JfbeU5smcaBw==',key_name='tempest-keypair-1367691795',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d700a53aa25849e0afd562b05881d09a',ramdisk_id='',reservation_id='r-kvyblfid',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1491000769',owner_user_name='tempest-ServerRescueNegativeTestJSON-1491000769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:44:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c8492f96e5d4f54aaae3679c82b6759',uuid=c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35ac8f6f-2998-4274-ab63-df7086194703", "address": "fa:16:3e:47:3b:c6", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ac8f6f-29", "ovs_interfaceid": "35ac8f6f-2998-4274-ab63-df7086194703", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:44:23 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Converting VIF {"id": "35ac8f6f-2998-4274-ab63-df7086194703", "address": "fa:16:3e:47:3b:c6", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ac8f6f-29", "ovs_interfaceid": "35ac8f6f-2998-4274-ab63-df7086194703", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:44:23 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:3b:c6,bridge_name='br-int',has_traffic_filtering=True,id=35ac8f6f-2998-4274-ab63-df7086194703,network=Network(7ba20249-9c62-46d7-810c-8144c1a1f17e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35ac8f6f-29') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:44:23 user nova-compute[71229]: DEBUG nova.objects.instance [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lazy-loading 'pci_devices' on Instance uuid c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:44:23 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:44:23 user nova-compute[71229]:   <uuid>c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a</uuid>
Apr 11 15:44:23 user nova-compute[71229]:   <name>instance-00000021</name>
Apr 11 15:44:23 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:44:23 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:44:23 user nova-compute[71229]:   <metadata>
Apr 11 15:44:23 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:44:23 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:44:23 user nova-compute[71229]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1921913590</nova:name>
Apr 11 15:44:23 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:44:23</nova:creationTime>
Apr 11 15:44:23 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:44:23 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:44:23 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:44:23 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:44:23 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:44:23 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:44:23 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:44:23 user nova-compute[71229]:       <nova:owner>
Apr 11 15:44:23 user nova-compute[71229]:         <nova:user uuid="5c8492f96e5d4f54aaae3679c82b6759">tempest-ServerRescueNegativeTestJSON-1491000769-project-member</nova:user>
Apr 11 15:44:23 user nova-compute[71229]:         <nova:project uuid="d700a53aa25849e0afd562b05881d09a">tempest-ServerRescueNegativeTestJSON-1491000769</nova:project>
Apr 11 15:44:23 user nova-compute[71229]:       </nova:owner>
Apr 11 15:44:23 user nova-compute[71229]:       <nova:root type="image" uuid="52fe638c-5ada-47d5-b376-233bfa808a37"/>
Apr 11 15:44:23 user nova-compute[71229]:       <nova:ports>
Apr 11 15:44:23 user nova-compute[71229]:         <nova:port uuid="35ac8f6f-2998-4274-ab63-df7086194703">
Apr 11 15:44:23 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 11 15:44:23 user nova-compute[71229]:         </nova:port>
Apr 11 15:44:23 user nova-compute[71229]:       </nova:ports>
Apr 11 15:44:23 user nova-compute[71229]:     </nova:instance>
Apr 11 15:44:23 user nova-compute[71229]:   </metadata>
Apr 11 15:44:23 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:44:23 user nova-compute[71229]:     <system>
Apr 11 15:44:23 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:44:23 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:44:23 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:44:23 user nova-compute[71229]:       <entry name="serial">c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a</entry>
Apr 11 15:44:23 user nova-compute[71229]:       <entry name="uuid">c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a</entry>
Apr 11 15:44:23 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:44:23 user nova-compute[71229]:     </system>
Apr 11 15:44:23 user nova-compute[71229]:   </sysinfo>
Apr 11 15:44:23 user nova-compute[71229]:   <os>
Apr 11 15:44:23 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:44:23 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 15:44:23 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:44:23 user nova-compute[71229]:   </os>
Apr 11 15:44:23 user nova-compute[71229]:   <features>
Apr 11 15:44:23 user nova-compute[71229]:     <acpi/>
Apr 11 15:44:23 user nova-compute[71229]:     <apic/>
Apr 11 15:44:23 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:44:23 user nova-compute[71229]:   </features>
Apr 11 15:44:23 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:44:23 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:44:23 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:44:23 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:44:23 user nova-compute[71229]:   </clock>
Apr 11 15:44:23 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:44:23 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:44:23 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:44:23 user nova-compute[71229]:   </cpu>
Apr 11 15:44:23 user nova-compute[71229]:   <devices>
Apr 11 15:44:23 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 15:44:23 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 15:44:23 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/disk"/>
Apr 11 15:44:23 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:44:23 user nova-compute[71229]:     </disk>
Apr 11 15:44:23 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:44:23 user nova-compute[71229]:       <mac address="fa:16:3e:47:3b:c6"/>
Apr 11 15:44:23 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:44:23 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:44:23 user nova-compute[71229]:       <target dev="tap35ac8f6f-29"/>
Apr 11 15:44:23 user nova-compute[71229]:     </interface>
Apr 11 15:44:23 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:44:23 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/console.log" append="off"/>
Apr 11 15:44:23 user nova-compute[71229]:     </serial>
Apr 11 15:44:23 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:44:23 user nova-compute[71229]:     <video>
Apr 11 15:44:23 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:44:23 user nova-compute[71229]:     </video>
Apr 11 15:44:23 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:44:23 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:44:23 user nova-compute[71229]:     </rng>
Apr 11 15:44:23 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:44:23 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:44:23 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:44:23 user nova-compute[71229]:     </memballoon>
Apr 11 15:44:23 user nova-compute[71229]:   </devices>
Apr 11 15:44:23 user nova-compute[71229]: </domain>
Apr 11 15:44:23 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:44:23 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:44:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1921913590',display_name='tempest-ServerRescueNegativeTestJSON-server-1921913590',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1921913590',id=33,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPYdVbZDtC1igDufA6PhMZJpvm+SfaXlWlDTwlgCYAsIhgsTCFIatXSmQzAx4qEEtvrM9m6Ml8tgUz/SNa6YjJmdUHImSQvQGbvvCZehYMuZMwW6pbpX8JfbeU5smcaBw==',key_name='tempest-keypair-1367691795',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d700a53aa25849e0afd562b05881d09a',ramdisk_id='',reservation_id='r-kvyblfid',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1491000769',owner_user_name='tempest-ServerRescueNegativeTestJSON-1491000769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:44:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c8492f96e5d4f54aaae3679c82b6759',uuid=c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35ac8f6f-2998-4274-ab63-df7086194703", "address": "fa:16:3e:47:3b:c6", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ac8f6f-29", "ovs_interfaceid": "35ac8f6f-2998-4274-ab63-df7086194703", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:44:23 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Converting VIF {"id": "35ac8f6f-2998-4274-ab63-df7086194703", "address": "fa:16:3e:47:3b:c6", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ac8f6f-29", "ovs_interfaceid": "35ac8f6f-2998-4274-ab63-df7086194703", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:44:23 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:3b:c6,bridge_name='br-int',has_traffic_filtering=True,id=35ac8f6f-2998-4274-ab63-df7086194703,network=Network(7ba20249-9c62-46d7-810c-8144c1a1f17e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35ac8f6f-29') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:44:23 user nova-compute[71229]: DEBUG os_vif [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:3b:c6,bridge_name='br-int',has_traffic_filtering=True,id=35ac8f6f-2998-4274-ab63-df7086194703,network=Network(7ba20249-9c62-46d7-810c-8144c1a1f17e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35ac8f6f-29') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:44:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:44:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:44:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:44:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:44:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap35ac8f6f-29, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:44:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap35ac8f6f-29, col_values=(('external_ids', {'iface-id': '35ac8f6f-2998-4274-ab63-df7086194703', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:3b:c6', 'vm-uuid': 'c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:44:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:44:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:44:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:44:23 user nova-compute[71229]: INFO os_vif [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:3b:c6,bridge_name='br-int',has_traffic_filtering=True,id=35ac8f6f-2998-4274-ab63-df7086194703,network=Network(7ba20249-9c62-46d7-810c-8144c1a1f17e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35ac8f6f-29')
Apr 11 15:44:23 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:44:23 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] No VIF found with MAC fa:16:3e:47:3b:c6, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:44:23 user nova-compute[71229]: DEBUG nova.network.neutron [req-8d06e4ac-ef49-4b32-af0b-6b2bd71765c5 req-4f1e6b7e-4469-44d3-8c14-03709cb6dcda service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Updated VIF entry in instance network info cache for port 35ac8f6f-2998-4274-ab63-df7086194703. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:44:23 user nova-compute[71229]: DEBUG nova.network.neutron [req-8d06e4ac-ef49-4b32-af0b-6b2bd71765c5 req-4f1e6b7e-4469-44d3-8c14-03709cb6dcda service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Updating instance_info_cache with network_info: [{"id": "35ac8f6f-2998-4274-ab63-df7086194703", "address": "fa:16:3e:47:3b:c6", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ac8f6f-29", "ovs_interfaceid": "35ac8f6f-2998-4274-ab63-df7086194703", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:44:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-8d06e4ac-ef49-4b32-af0b-6b2bd71765c5 req-4f1e6b7e-4469-44d3-8c14-03709cb6dcda service nova] Releasing lock "refresh_cache-c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:44:24 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:44:24 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:44:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:44:25 user nova-compute[71229]: DEBUG nova.compute.manager [req-75a25abd-7a0a-4820-b1ae-62793be0dcd2 req-55d1f788-b80b-43df-ae4f-a30ce0875c2e service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Received event network-vif-plugged-35ac8f6f-2998-4274-ab63-df7086194703 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:44:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-75a25abd-7a0a-4820-b1ae-62793be0dcd2 req-55d1f788-b80b-43df-ae4f-a30ce0875c2e service nova] Acquiring lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:44:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-75a25abd-7a0a-4820-b1ae-62793be0dcd2 req-55d1f788-b80b-43df-ae4f-a30ce0875c2e service nova] Lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:44:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-75a25abd-7a0a-4820-b1ae-62793be0dcd2 req-55d1f788-b80b-43df-ae4f-a30ce0875c2e service nova] Lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:44:25 user nova-compute[71229]: DEBUG nova.compute.manager [req-75a25abd-7a0a-4820-b1ae-62793be0dcd2 req-55d1f788-b80b-43df-ae4f-a30ce0875c2e service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] No waiting events found dispatching network-vif-plugged-35ac8f6f-2998-4274-ab63-df7086194703 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:44:25 user nova-compute[71229]: WARNING nova.compute.manager [req-75a25abd-7a0a-4820-b1ae-62793be0dcd2 req-55d1f788-b80b-43df-ae4f-a30ce0875c2e service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Received unexpected event network-vif-plugged-35ac8f6f-2998-4274-ab63-df7086194703 for instance with vm_state building and task_state spawning.
Apr 11 15:44:26 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227866.887073, c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:44:26 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] VM Resumed (Lifecycle Event)
Apr 11 15:44:26 user nova-compute[71229]: DEBUG nova.compute.manager [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 15:44:26 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Guest created on hypervisor {{(pid=71229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 15:44:26 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Instance spawned successfully.
Apr 11 15:44:26 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 15:44:26 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:44:26 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:44:26 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Found default for hw_cdrom_bus of ide {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:44:26 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Found default for hw_disk_bus of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:44:26 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Found default for hw_input_bus of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:44:26 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Found default for hw_pointer_model of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:44:26 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Found default for hw_video_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:44:26 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Found default for hw_vif_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:44:27 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:44:27 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:44:27 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227866.8883514, c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:44:27 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] VM Started (Lifecycle Event)
Apr 11 15:44:27 user nova-compute[71229]: DEBUG nova.compute.manager [req-1ae1628d-b107-405d-bcab-5b1822bb9f8a req-2e336834-82e9-4188-b953-396a0904f55e service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Received event network-vif-plugged-35ac8f6f-2998-4274-ab63-df7086194703 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:44:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-1ae1628d-b107-405d-bcab-5b1822bb9f8a req-2e336834-82e9-4188-b953-396a0904f55e service nova] Acquiring lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:44:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-1ae1628d-b107-405d-bcab-5b1822bb9f8a req-2e336834-82e9-4188-b953-396a0904f55e service nova] Lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:44:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-1ae1628d-b107-405d-bcab-5b1822bb9f8a req-2e336834-82e9-4188-b953-396a0904f55e service nova] Lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:44:27 user nova-compute[71229]: DEBUG nova.compute.manager [req-1ae1628d-b107-405d-bcab-5b1822bb9f8a req-2e336834-82e9-4188-b953-396a0904f55e service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] No waiting events found dispatching network-vif-plugged-35ac8f6f-2998-4274-ab63-df7086194703 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:44:27 user nova-compute[71229]: WARNING nova.compute.manager [req-1ae1628d-b107-405d-bcab-5b1822bb9f8a req-2e336834-82e9-4188-b953-396a0904f55e service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Received unexpected event network-vif-plugged-35ac8f6f-2998-4274-ab63-df7086194703 for instance with vm_state building and task_state spawning.
Apr 11 15:44:27 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:44:27 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:44:27 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:44:27 user nova-compute[71229]: INFO nova.compute.manager [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Took 6.19 seconds to spawn the instance on the hypervisor.
Apr 11 15:44:27 user nova-compute[71229]: DEBUG nova.compute.manager [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:44:27 user nova-compute[71229]: INFO nova.compute.manager [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Took 6.74 seconds to build instance.
Apr 11 15:44:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-742f17d4-66a1-47f4-a8c1-dbcef04bcdd5 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.858s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:44:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:44:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:44:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:44:42 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:44:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-541e9cd6-35df-4dbc-a4fd-0ec3e640a850 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "dcbfcbfd-7e96-4271-94ee-60ef937e3b7e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:44:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-541e9cd6-35df-4dbc-a4fd-0ec3e640a850 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "dcbfcbfd-7e96-4271-94ee-60ef937e3b7e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:44:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-541e9cd6-35df-4dbc-a4fd-0ec3e640a850 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "dcbfcbfd-7e96-4271-94ee-60ef937e3b7e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:44:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-541e9cd6-35df-4dbc-a4fd-0ec3e640a850 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "dcbfcbfd-7e96-4271-94ee-60ef937e3b7e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:44:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-541e9cd6-35df-4dbc-a4fd-0ec3e640a850 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "dcbfcbfd-7e96-4271-94ee-60ef937e3b7e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:44:42 user nova-compute[71229]: INFO nova.compute.manager [None req-541e9cd6-35df-4dbc-a4fd-0ec3e640a850 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Terminating instance
Apr 11 15:44:42 user nova-compute[71229]: DEBUG nova.compute.manager [None req-541e9cd6-35df-4dbc-a4fd-0ec3e640a850 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Start destroying the instance on the hypervisor. {{(pid=71229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 15:44:42 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:44:42 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:44:43 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:44:43 user nova-compute[71229]: DEBUG nova.compute.manager [req-ed0d8361-d206-46fe-b6e1-63386c0b9945 req-51d463aa-07df-462d-b46d-027e7e706e90 service nova] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Received event network-vif-unplugged-32c006ee-14e2-47d8-b999-bafc729aa67a {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:44:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-ed0d8361-d206-46fe-b6e1-63386c0b9945 req-51d463aa-07df-462d-b46d-027e7e706e90 service nova] Acquiring lock "dcbfcbfd-7e96-4271-94ee-60ef937e3b7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:44:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-ed0d8361-d206-46fe-b6e1-63386c0b9945 req-51d463aa-07df-462d-b46d-027e7e706e90 service nova] Lock "dcbfcbfd-7e96-4271-94ee-60ef937e3b7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:44:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-ed0d8361-d206-46fe-b6e1-63386c0b9945 req-51d463aa-07df-462d-b46d-027e7e706e90 service nova] Lock "dcbfcbfd-7e96-4271-94ee-60ef937e3b7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:44:43 user nova-compute[71229]: DEBUG nova.compute.manager [req-ed0d8361-d206-46fe-b6e1-63386c0b9945 req-51d463aa-07df-462d-b46d-027e7e706e90 service nova] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] No waiting events found dispatching network-vif-unplugged-32c006ee-14e2-47d8-b999-bafc729aa67a {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:44:43 user nova-compute[71229]: DEBUG nova.compute.manager [req-ed0d8361-d206-46fe-b6e1-63386c0b9945 req-51d463aa-07df-462d-b46d-027e7e706e90 service nova] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Received event network-vif-unplugged-32c006ee-14e2-47d8-b999-bafc729aa67a for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 15:44:43 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:44:43 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:44:43 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Instance destroyed successfully.
Apr 11 15:44:43 user nova-compute[71229]: DEBUG nova.objects.instance [None req-541e9cd6-35df-4dbc-a4fd-0ec3e640a850 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lazy-loading 'resources' on Instance uuid dcbfcbfd-7e96-4271-94ee-60ef937e3b7e {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:44:43 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-541e9cd6-35df-4dbc-a4fd-0ec3e640a850 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:35:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1108207278',display_name='tempest-ServerActionsTestJSON-server-1108207278',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1108207278',id=26,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfAJGQ+GOa8zW+jlKgD9Kz6/k6iEv9pZIOIjICzcstJ92AAS94+47mc3fRsqyx5FaTMV9P4lTsW4Fy7tKIAtMpRx0Sl7sa6ttQnPbPhlcYqfbdWbTqmmKi6+BuZpqSknA==',key_name='tempest-keypair-1137963694',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:35:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bb7660e8f76b471487136806ee9eec62',ramdisk_id='',reservation_id='r-k9tu04rs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1659503440',owner_user_name='tempest-ServerActionsTestJSON-1659503440-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:35:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10720df0ac4f4e62a0a5c9883d600add',uuid=dcbfcbfd-7e96-4271-94ee-60ef937e3b7e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32c006ee-14e2-47d8-b999-bafc729aa67a", "address": "fa:16:3e:1a:bd:54", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c006ee-14", "ovs_interfaceid": "32c006ee-14e2-47d8-b999-bafc729aa67a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:44:43 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-541e9cd6-35df-4dbc-a4fd-0ec3e640a850 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Converting VIF {"id": "32c006ee-14e2-47d8-b999-bafc729aa67a", "address": "fa:16:3e:1a:bd:54", "network": {"id": "1bd215e8-0459-4dd2-893b-096b6e31ac08", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-665410087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7660e8f76b471487136806ee9eec62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c006ee-14", "ovs_interfaceid": "32c006ee-14e2-47d8-b999-bafc729aa67a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:44:43 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-541e9cd6-35df-4dbc-a4fd-0ec3e640a850 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:bd:54,bridge_name='br-int',has_traffic_filtering=True,id=32c006ee-14e2-47d8-b999-bafc729aa67a,network=Network(1bd215e8-0459-4dd2-893b-096b6e31ac08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c006ee-14') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:44:43 user nova-compute[71229]: DEBUG os_vif [None req-541e9cd6-35df-4dbc-a4fd-0ec3e640a850 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:bd:54,bridge_name='br-int',has_traffic_filtering=True,id=32c006ee-14e2-47d8-b999-bafc729aa67a,network=Network(1bd215e8-0459-4dd2-893b-096b6e31ac08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c006ee-14') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:44:43 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:44:43 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap32c006ee-14, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:44:43 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:44:43 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:44:43 user nova-compute[71229]: INFO os_vif [None req-541e9cd6-35df-4dbc-a4fd-0ec3e640a850 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:bd:54,bridge_name='br-int',has_traffic_filtering=True,id=32c006ee-14e2-47d8-b999-bafc729aa67a,network=Network(1bd215e8-0459-4dd2-893b-096b6e31ac08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c006ee-14')
Apr 11 15:44:43 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-541e9cd6-35df-4dbc-a4fd-0ec3e640a850 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Deleting instance files /opt/stack/data/nova/instances/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e_del
Apr 11 15:44:43 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-541e9cd6-35df-4dbc-a4fd-0ec3e640a850 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Deletion of /opt/stack/data/nova/instances/dcbfcbfd-7e96-4271-94ee-60ef937e3b7e_del complete
Apr 11 15:44:43 user nova-compute[71229]: INFO nova.compute.manager [None req-541e9cd6-35df-4dbc-a4fd-0ec3e640a850 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Took 0.66 seconds to destroy the instance on the hypervisor.
Apr 11 15:44:43 user nova-compute[71229]: DEBUG oslo.service.loopingcall [None req-541e9cd6-35df-4dbc-a4fd-0ec3e640a850 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71229) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 15:44:43 user nova-compute[71229]: DEBUG nova.compute.manager [-] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Deallocating network for instance {{(pid=71229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 15:44:43 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] deallocate_for_instance() {{(pid=71229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 15:44:44 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:44:44 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Took 0.78 seconds to deallocate network for instance.
Apr 11 15:44:44 user nova-compute[71229]: DEBUG nova.compute.manager [req-78f49594-b491-4ea6-b7b4-e6cb4c3b7e9f req-d69e6fb5-bcee-4e77-8f09-dee211d2c27f service nova] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Received event network-vif-deleted-32c006ee-14e2-47d8-b999-bafc729aa67a {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:44:44 user nova-compute[71229]: INFO nova.compute.manager [req-78f49594-b491-4ea6-b7b4-e6cb4c3b7e9f req-d69e6fb5-bcee-4e77-8f09-dee211d2c27f service nova] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Neutron deleted interface 32c006ee-14e2-47d8-b999-bafc729aa67a; detaching it from the instance and deleting it from the info cache
Apr 11 15:44:44 user nova-compute[71229]: DEBUG nova.network.neutron [req-78f49594-b491-4ea6-b7b4-e6cb4c3b7e9f req-d69e6fb5-bcee-4e77-8f09-dee211d2c27f service nova] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:44:44 user nova-compute[71229]: DEBUG nova.compute.manager [req-78f49594-b491-4ea6-b7b4-e6cb4c3b7e9f req-d69e6fb5-bcee-4e77-8f09-dee211d2c27f service nova] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Detach interface failed, port_id=32c006ee-14e2-47d8-b999-bafc729aa67a, reason: Instance dcbfcbfd-7e96-4271-94ee-60ef937e3b7e could not be found. {{(pid=71229) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 15:44:44 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-541e9cd6-35df-4dbc-a4fd-0ec3e640a850 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:44:44 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-541e9cd6-35df-4dbc-a4fd-0ec3e640a850 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:44:44 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-541e9cd6-35df-4dbc-a4fd-0ec3e640a850 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:44:44 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-541e9cd6-35df-4dbc-a4fd-0ec3e640a850 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:44:44 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-541e9cd6-35df-4dbc-a4fd-0ec3e640a850 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.193s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:44:44 user nova-compute[71229]: INFO nova.scheduler.client.report [None req-541e9cd6-35df-4dbc-a4fd-0ec3e640a850 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Deleted allocations for instance dcbfcbfd-7e96-4271-94ee-60ef937e3b7e
Apr 11 15:44:44 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-541e9cd6-35df-4dbc-a4fd-0ec3e640a850 tempest-ServerActionsTestJSON-1659503440 tempest-ServerActionsTestJSON-1659503440-project-member] Lock "dcbfcbfd-7e96-4271-94ee-60ef937e3b7e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.805s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:44:45 user nova-compute[71229]: DEBUG nova.compute.manager [req-f0673460-790e-47b9-ba6e-904eb30f61c1 req-4f97f67a-e3f2-4838-98e8-ea73e4c37c3c service nova] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Received event network-vif-plugged-32c006ee-14e2-47d8-b999-bafc729aa67a {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:44:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-f0673460-790e-47b9-ba6e-904eb30f61c1 req-4f97f67a-e3f2-4838-98e8-ea73e4c37c3c service nova] Acquiring lock "dcbfcbfd-7e96-4271-94ee-60ef937e3b7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:44:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-f0673460-790e-47b9-ba6e-904eb30f61c1 req-4f97f67a-e3f2-4838-98e8-ea73e4c37c3c service nova] Lock "dcbfcbfd-7e96-4271-94ee-60ef937e3b7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:44:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-f0673460-790e-47b9-ba6e-904eb30f61c1 req-4f97f67a-e3f2-4838-98e8-ea73e4c37c3c service nova] Lock "dcbfcbfd-7e96-4271-94ee-60ef937e3b7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:44:45 user nova-compute[71229]: DEBUG nova.compute.manager [req-f0673460-790e-47b9-ba6e-904eb30f61c1 req-4f97f67a-e3f2-4838-98e8-ea73e4c37c3c service nova] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] No waiting events found dispatching network-vif-plugged-32c006ee-14e2-47d8-b999-bafc729aa67a {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:44:45 user nova-compute[71229]: WARNING nova.compute.manager [req-f0673460-790e-47b9-ba6e-904eb30f61c1 req-4f97f67a-e3f2-4838-98e8-ea73e4c37c3c service nova] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Received unexpected event network-vif-plugged-32c006ee-14e2-47d8-b999-bafc729aa67a for instance with vm_state deleted and task_state None.
Apr 11 15:44:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:44:48 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:44:52 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:44:53 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:44:57 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:44:58 user nova-compute[71229]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681227883.4446445, dcbfcbfd-7e96-4271-94ee-60ef937e3b7e => Stopped> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:44:58 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] VM Stopped (Lifecycle Event)
Apr 11 15:44:58 user nova-compute[71229]: DEBUG nova.compute.manager [None req-461ee8c1-3c29-4468-8373-5935bbc0e99f None None] [instance: dcbfcbfd-7e96-4271-94ee-60ef937e3b7e] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:44:58 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:45:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:45:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:45:01 user nova-compute[71229]: DEBUG nova.compute.manager [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Starting instance... {{(pid=71229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 15:45:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:45:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:45:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 15:45:01 user nova-compute[71229]: INFO nova.compute.claims [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Claim successful on node user
Apr 11 15:45:01 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:45:01 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:45:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.299s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:45:01 user nova-compute[71229]: DEBUG nova.compute.manager [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Start building networks asynchronously for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 15:45:02 user nova-compute[71229]: DEBUG nova.compute.manager [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Allocating IP information in the background. {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 15:45:02 user nova-compute[71229]: DEBUG nova.network.neutron [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] allocate_for_instance() {{(pid=71229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 15:45:02 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 15:45:02 user nova-compute[71229]: DEBUG nova.compute.manager [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Start building block device mappings for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 15:45:02 user nova-compute[71229]: INFO nova.virt.block_device [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Booting with volume 60e0670e-2a18-47f6-921a-c69a3f375392 at /dev/vda
Apr 11 15:45:02 user nova-compute[71229]: DEBUG nova.policy [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c2110b74f38642afa560e1c9790d3f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312851c65ba1434691eca0cd2a8cd6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71229) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 15:45:02 user nova-compute[71229]: DEBUG os_brick.utils [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:45:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:45:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:45:02 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8d5e8e-da65-4370-8329-da52c24978d2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d55e24a97c90\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:45:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:45:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:45:02 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e429cce9-c55d-41ec-830d-fa2a70de0636]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:45:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:45:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:45:02 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9609c7b-1525-4b5a-865d-5412b65faeb3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:45:02 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8b001c-939b-4e69-9887-8e2f466d8006]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:45:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Running cmd (subprocess): nvme version {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:45:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 'nvme version' failed. Not Retrying. {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:45:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] nvme not present on system {{(pid=71229) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 15:45:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:45:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:45:02 user nova-compute[71229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 15:45:02 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[391d48ad-9cb2-4687-9815-c2fa489cfd08]: (4, '') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:45:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71229) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 15:45:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 15:45:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] LIGHTOS: no hostnqn found. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 15:45:02 user nova-compute[71229]: DEBUG os_brick.utils [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d55e24a97c90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:45:02 user nova-compute[71229]: DEBUG nova.virt.block_device [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Updating existing volume attachment record: 79de0c97-25cc-4680-b66b-e0490c6da63a {{(pid=71229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 15:45:02 user nova-compute[71229]: DEBUG nova.network.neutron [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Successfully created port: 8eaf93f6-bd22-4804-8044-4cd18b84370a {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 15:45:03 user nova-compute[71229]: DEBUG nova.network.neutron [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Successfully updated port: 8eaf93f6-bd22-4804-8044-4cd18b84370a {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:45:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "refresh_cache-07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:45:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquired lock "refresh_cache-07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:45:03 user nova-compute[71229]: DEBUG nova.network.neutron [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:45:03 user nova-compute[71229]: DEBUG nova.compute.manager [req-d6bcb0cf-139e-458a-a0dc-37640aa94a49 req-daa2ff94-f41f-4e60-a989-8ccb491981dd service nova] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Received event network-changed-8eaf93f6-bd22-4804-8044-4cd18b84370a {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:45:03 user nova-compute[71229]: DEBUG nova.compute.manager [req-d6bcb0cf-139e-458a-a0dc-37640aa94a49 req-daa2ff94-f41f-4e60-a989-8ccb491981dd service nova] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Refreshing instance network info cache due to event network-changed-8eaf93f6-bd22-4804-8044-4cd18b84370a. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:45:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-d6bcb0cf-139e-458a-a0dc-37640aa94a49 req-daa2ff94-f41f-4e60-a989-8ccb491981dd service nova] Acquiring lock "refresh_cache-07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:45:03 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:45:03 user nova-compute[71229]: DEBUG nova.network.neutron [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:45:03 user nova-compute[71229]: DEBUG nova.network.neutron [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Updating instance_info_cache with network_info: [{"id": "8eaf93f6-bd22-4804-8044-4cd18b84370a", "address": "fa:16:3e:e9:db:03", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eaf93f6-bd", "ovs_interfaceid": "8eaf93f6-bd22-4804-8044-4cd18b84370a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:45:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Releasing lock "refresh_cache-07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:45:03 user nova-compute[71229]: DEBUG nova.compute.manager [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Instance network_info: |[{"id": "8eaf93f6-bd22-4804-8044-4cd18b84370a", "address": "fa:16:3e:e9:db:03", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eaf93f6-bd", "ovs_interfaceid": "8eaf93f6-bd22-4804-8044-4cd18b84370a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 15:45:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-d6bcb0cf-139e-458a-a0dc-37640aa94a49 req-daa2ff94-f41f-4e60-a989-8ccb491981dd service nova] Acquired lock "refresh_cache-07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:45:03 user nova-compute[71229]: DEBUG nova.network.neutron [req-d6bcb0cf-139e-458a-a0dc-37640aa94a49 req-daa2ff94-f41f-4e60-a989-8ccb491981dd service nova] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Refreshing network info cache for port 8eaf93f6-bd22-4804-8044-4cd18b84370a {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:45:04 user nova-compute[71229]: DEBUG nova.network.neutron [req-d6bcb0cf-139e-458a-a0dc-37640aa94a49 req-daa2ff94-f41f-4e60-a989-8ccb491981dd service nova] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Updated VIF entry in instance network info cache for port 8eaf93f6-bd22-4804-8044-4cd18b84370a. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:45:04 user nova-compute[71229]: DEBUG nova.network.neutron [req-d6bcb0cf-139e-458a-a0dc-37640aa94a49 req-daa2ff94-f41f-4e60-a989-8ccb491981dd service nova] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Updating instance_info_cache with network_info: [{"id": "8eaf93f6-bd22-4804-8044-4cd18b84370a", "address": "fa:16:3e:e9:db:03", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eaf93f6-bd", "ovs_interfaceid": "8eaf93f6-bd22-4804-8044-4cd18b84370a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:45:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-d6bcb0cf-139e-458a-a0dc-37640aa94a49 req-daa2ff94-f41f-4e60-a989-8ccb491981dd service nova] Releasing lock "refresh_cache-07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:45:05 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:45:05 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG nova.compute.manager [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Start spawning the instance on the hypervisor. {{(pid=71229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Creating instance directory {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 15:45:06 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Creating image(s)
Apr 11 15:45:06 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Did not create local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Ensure instance console log exists: /opt/stack/data/nova/instances/07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Start _get_guest_xml network_info=[{"id": "8eaf93f6-bd22-4804-8044-4cd18b84370a", "address": "fa:16:3e:e9:db:03", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eaf93f6-bd", "ovs_interfaceid": "8eaf93f6-bd22-4804-8044-4cd18b84370a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'obEmVaHN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d', 'attached_at': '', 'detached_at': '', 'volume_id': '60e0670e-2a18-47f6-921a-c69a3f375392', 'serial': '60e0670e-2a18-47f6-921a-c69a3f375392'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '79de0c97-25cc-4680-b66b-e0490c6da63a', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:45:06 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:45:06 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:45:06 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'obEmVaHN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:45:06 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:45:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:45:06 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:45:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:45:06 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 15:45:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392 -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2e4a6e-8016-4850-821d-4d537619e1cc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 15:45:06 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392 -p 172.16.0.220:3260 --interface default --op new {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6248ebd1-b9c9-4261-b706-b48618237037]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392] added\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392] added
Apr 11 15:45:06 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7e9e29-28af-48d5-85b3-1a646a2e4a44]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[37864462-6857-4ad5-bda1-2fcd8beb1183]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v obEmVaHN {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v obEmVaHN" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2234168a-d131-4c45-9956-70055a0ed493]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'obEmVaHN'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d7d0e9-130c-4f12-9506-17d447c7bc73]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e839a9b-bf2d-4e70-9bde-19ce4a88fcc7]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79 (non-flash)
Apr 11 15:45:06 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79 (non-flash)
Apr 11 15:45:06 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392 -p 172.16.0.220:3260 --login {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[47eb5e58-a0f1-4fba-9fd7-a5e67598733e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392, portal: 172.16.0.220,3260]
Apr 11 15:45:06 user nova-compute[71229]: Login to [iface: default, target: iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392, portal: 172.16.0.220,3260] successful.
Apr 11 15:45:06 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eafc1df-ebc9-4eb9-8d86-ebfdef2f3560]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd3c4a7-1a0c-4ea8-830b-96f76a3712fa]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79 (non-flash)
Apr 11 15:45:06 user nova-compute[71229]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392 (non-flash)
Apr 11 15:45:06 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79 (non-flash)
Apr 11 15:45:06 user nova-compute[71229]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392 (non-flash)
Apr 11 15:45:06 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[522b47f4-3f92-4c1f-b248-a12972eb15bb]: (4, ('- - 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:45:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'obEmVaHN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 15:45:07 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:45:07 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23436656561656266', 'path': '/dev/sdb'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:45:07 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23436656561656266', 'path': '/dev/sdb'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 15:45:07 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:45:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1177972057',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1177972057',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1177972057',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='312851c65ba1434691eca0cd2a8cd6d2',ramdisk_id='',reservation_id='r-x09jj22u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1933582504',owner_user_name='tempest-TestVolumeBootPattern-1933582504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:45:02Z,user_data=None,user_id='c2110b74f38642afa560e1c9790d3f81',uuid=07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8eaf93f6-bd22-4804-8044-4cd18b84370a", "address": "fa:16:3e:e9:db:03", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eaf93f6-bd", "ovs_interfaceid": "8eaf93f6-bd22-4804-8044-4cd18b84370a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:45:07 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Converting VIF {"id": "8eaf93f6-bd22-4804-8044-4cd18b84370a", "address": "fa:16:3e:e9:db:03", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eaf93f6-bd", "ovs_interfaceid": "8eaf93f6-bd22-4804-8044-4cd18b84370a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:45:07 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:db:03,bridge_name='br-int',has_traffic_filtering=True,id=8eaf93f6-bd22-4804-8044-4cd18b84370a,network=Network(8d262ba8-b9c3-44ed-8431-6c295eb9ea24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eaf93f6-bd') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:45:07 user nova-compute[71229]: DEBUG nova.objects.instance [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lazy-loading 'pci_devices' on Instance uuid 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:45:07 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:45:07 user nova-compute[71229]:   <uuid>07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d</uuid>
Apr 11 15:45:07 user nova-compute[71229]:   <name>instance-00000022</name>
Apr 11 15:45:07 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:45:07 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:45:07 user nova-compute[71229]:   <metadata>
Apr 11 15:45:07 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:45:07 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:45:07 user nova-compute[71229]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1177972057</nova:name>
Apr 11 15:45:07 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:45:06</nova:creationTime>
Apr 11 15:45:07 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:45:07 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:45:07 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:45:07 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:45:07 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:45:07 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:45:07 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:45:07 user nova-compute[71229]:       <nova:owner>
Apr 11 15:45:07 user nova-compute[71229]:         <nova:user uuid="c2110b74f38642afa560e1c9790d3f81">tempest-TestVolumeBootPattern-1933582504-project-member</nova:user>
Apr 11 15:45:07 user nova-compute[71229]:         <nova:project uuid="312851c65ba1434691eca0cd2a8cd6d2">tempest-TestVolumeBootPattern-1933582504</nova:project>
Apr 11 15:45:07 user nova-compute[71229]:       </nova:owner>
Apr 11 15:45:07 user nova-compute[71229]:       <nova:ports>
Apr 11 15:45:07 user nova-compute[71229]:         <nova:port uuid="8eaf93f6-bd22-4804-8044-4cd18b84370a">
Apr 11 15:45:07 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 11 15:45:07 user nova-compute[71229]:         </nova:port>
Apr 11 15:45:07 user nova-compute[71229]:       </nova:ports>
Apr 11 15:45:07 user nova-compute[71229]:     </nova:instance>
Apr 11 15:45:07 user nova-compute[71229]:   </metadata>
Apr 11 15:45:07 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:45:07 user nova-compute[71229]:     <system>
Apr 11 15:45:07 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:45:07 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:45:07 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:45:07 user nova-compute[71229]:       <entry name="serial">07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d</entry>
Apr 11 15:45:07 user nova-compute[71229]:       <entry name="uuid">07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d</entry>
Apr 11 15:45:07 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:45:07 user nova-compute[71229]:     </system>
Apr 11 15:45:07 user nova-compute[71229]:   </sysinfo>
Apr 11 15:45:07 user nova-compute[71229]:   <os>
Apr 11 15:45:07 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:45:07 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 15:45:07 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:45:07 user nova-compute[71229]:   </os>
Apr 11 15:45:07 user nova-compute[71229]:   <features>
Apr 11 15:45:07 user nova-compute[71229]:     <acpi/>
Apr 11 15:45:07 user nova-compute[71229]:     <apic/>
Apr 11 15:45:07 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:45:07 user nova-compute[71229]:   </features>
Apr 11 15:45:07 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:45:07 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:45:07 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:45:07 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:45:07 user nova-compute[71229]:   </clock>
Apr 11 15:45:07 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:45:07 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:45:07 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:45:07 user nova-compute[71229]:   </cpu>
Apr 11 15:45:07 user nova-compute[71229]:   <devices>
Apr 11 15:45:07 user nova-compute[71229]:     <disk type="block" device="disk">
Apr 11 15:45:07 user nova-compute[71229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:45:07 user nova-compute[71229]:       <source dev="/dev/sdb"/>
Apr 11 15:45:07 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:45:07 user nova-compute[71229]:       <serial>60e0670e-2a18-47f6-921a-c69a3f375392</serial>
Apr 11 15:45:07 user nova-compute[71229]:     </disk>
Apr 11 15:45:07 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:45:07 user nova-compute[71229]:       <mac address="fa:16:3e:e9:db:03"/>
Apr 11 15:45:07 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:45:07 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:45:07 user nova-compute[71229]:       <target dev="tap8eaf93f6-bd"/>
Apr 11 15:45:07 user nova-compute[71229]:     </interface>
Apr 11 15:45:07 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:45:07 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d/console.log" append="off"/>
Apr 11 15:45:07 user nova-compute[71229]:     </serial>
Apr 11 15:45:07 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:45:07 user nova-compute[71229]:     <video>
Apr 11 15:45:07 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:45:07 user nova-compute[71229]:     </video>
Apr 11 15:45:07 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:45:07 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:45:07 user nova-compute[71229]:     </rng>
Apr 11 15:45:07 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:45:07 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:45:07 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:45:07 user nova-compute[71229]:     </memballoon>
Apr 11 15:45:07 user nova-compute[71229]:   </devices>
Apr 11 15:45:07 user nova-compute[71229]: </domain>
Apr 11 15:45:07 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:45:07 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:45:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1177972057',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1177972057',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1177972057',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='312851c65ba1434691eca0cd2a8cd6d2',ramdisk_id='',reservation_id='r-x09jj22u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1933582504',owner_user_name='tempest-TestVolumeBootPattern-1933582504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:45:02Z,user_data=None,user_id='c2110b74f38642afa560e1c9790d3f81',uuid=07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8eaf93f6-bd22-4804-8044-4cd18b84370a", "address": "fa:16:3e:e9:db:03", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eaf93f6-bd", "ovs_interfaceid": "8eaf93f6-bd22-4804-8044-4cd18b84370a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:45:07 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Converting VIF {"id": "8eaf93f6-bd22-4804-8044-4cd18b84370a", "address": "fa:16:3e:e9:db:03", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eaf93f6-bd", "ovs_interfaceid": "8eaf93f6-bd22-4804-8044-4cd18b84370a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:45:07 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:db:03,bridge_name='br-int',has_traffic_filtering=True,id=8eaf93f6-bd22-4804-8044-4cd18b84370a,network=Network(8d262ba8-b9c3-44ed-8431-6c295eb9ea24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eaf93f6-bd') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:45:07 user nova-compute[71229]: DEBUG os_vif [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:db:03,bridge_name='br-int',has_traffic_filtering=True,id=8eaf93f6-bd22-4804-8044-4cd18b84370a,network=Network(8d262ba8-b9c3-44ed-8431-6c295eb9ea24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eaf93f6-bd') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:45:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:45:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:45:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:45:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:45:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8eaf93f6-bd, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:45:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8eaf93f6-bd, col_values=(('external_ids', {'iface-id': '8eaf93f6-bd22-4804-8044-4cd18b84370a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:db:03', 'vm-uuid': '07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:45:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:45:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:45:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:45:07 user nova-compute[71229]: INFO os_vif [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:db:03,bridge_name='br-int',has_traffic_filtering=True,id=8eaf93f6-bd22-4804-8044-4cd18b84370a,network=Network(8d262ba8-b9c3-44ed-8431-6c295eb9ea24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eaf93f6-bd')
Apr 11 15:45:07 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:45:07 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] No VIF found with MAC fa:16:3e:e9:db:03, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:45:09 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:45:09 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:45:09 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:45:09 user nova-compute[71229]: DEBUG nova.compute.manager [req-f32a10b1-330a-4f47-a7ed-6b6e1ab77768 req-e9a5746f-9aee-4063-86d7-dacb1865b304 service nova] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Received event network-vif-plugged-8eaf93f6-bd22-4804-8044-4cd18b84370a {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:45:09 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-f32a10b1-330a-4f47-a7ed-6b6e1ab77768 req-e9a5746f-9aee-4063-86d7-dacb1865b304 service nova] Acquiring lock "07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:45:09 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-f32a10b1-330a-4f47-a7ed-6b6e1ab77768 req-e9a5746f-9aee-4063-86d7-dacb1865b304 service nova] Lock "07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:45:09 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-f32a10b1-330a-4f47-a7ed-6b6e1ab77768 req-e9a5746f-9aee-4063-86d7-dacb1865b304 service nova] Lock "07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:45:09 user nova-compute[71229]: DEBUG nova.compute.manager [req-f32a10b1-330a-4f47-a7ed-6b6e1ab77768 req-e9a5746f-9aee-4063-86d7-dacb1865b304 service nova] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] No waiting events found dispatching network-vif-plugged-8eaf93f6-bd22-4804-8044-4cd18b84370a {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:45:09 user nova-compute[71229]: WARNING nova.compute.manager [req-f32a10b1-330a-4f47-a7ed-6b6e1ab77768 req-e9a5746f-9aee-4063-86d7-dacb1865b304 service nova] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Received unexpected event network-vif-plugged-8eaf93f6-bd22-4804-8044-4cd18b84370a for instance with vm_state building and task_state spawning.
Apr 11 15:45:09 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:45:09 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:45:09 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:45:09 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:45:09 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:45:09 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 15:45:09 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:45:09 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:45:09 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e816ce5-4da8-4366-9fa1-c33a45ba87fd/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:45:09 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:45:10 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e816ce5-4da8-4366-9fa1-c33a45ba87fd/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:45:10 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e816ce5-4da8-4366-9fa1-c33a45ba87fd/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:45:10 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e816ce5-4da8-4366-9fa1-c33a45ba87fd/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:45:10 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:45:10 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:45:10 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:45:10 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:45:10 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json" returned: 0 in 0.152s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:45:10 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:45:10 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:45:10 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:45:10 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:45:10 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:45:10 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:45:10 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:45:10 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:45:11 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:45:11 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:45:11 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:45:11 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:45:11 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:45:11 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227911.4200191, 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:45:11 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] VM Resumed (Lifecycle Event)
Apr 11 15:45:11 user nova-compute[71229]: DEBUG nova.compute.manager [req-7b146b7b-d555-4d94-833b-1a133e8c9da4 req-b6fff1c7-a5e8-4be8-b692-19d139e04ac6 service nova] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Received event network-vif-plugged-8eaf93f6-bd22-4804-8044-4cd18b84370a {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:45:11 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-7b146b7b-d555-4d94-833b-1a133e8c9da4 req-b6fff1c7-a5e8-4be8-b692-19d139e04ac6 service nova] Acquiring lock "07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:45:11 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-7b146b7b-d555-4d94-833b-1a133e8c9da4 req-b6fff1c7-a5e8-4be8-b692-19d139e04ac6 service nova] Lock "07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:45:11 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-7b146b7b-d555-4d94-833b-1a133e8c9da4 req-b6fff1c7-a5e8-4be8-b692-19d139e04ac6 service nova] Lock "07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:45:11 user nova-compute[71229]: DEBUG nova.compute.manager [req-7b146b7b-d555-4d94-833b-1a133e8c9da4 req-b6fff1c7-a5e8-4be8-b692-19d139e04ac6 service nova] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] No waiting events found dispatching network-vif-plugged-8eaf93f6-bd22-4804-8044-4cd18b84370a {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:45:11 user nova-compute[71229]: WARNING nova.compute.manager [req-7b146b7b-d555-4d94-833b-1a133e8c9da4 req-b6fff1c7-a5e8-4be8-b692-19d139e04ac6 service nova] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Received unexpected event network-vif-plugged-8eaf93f6-bd22-4804-8044-4cd18b84370a for instance with vm_state building and task_state spawning.
Apr 11 15:45:11 user nova-compute[71229]: DEBUG nova.compute.manager [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 15:45:11 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Guest created on hypervisor {{(pid=71229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 15:45:11 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:45:11 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:45:11 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:45:11 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8438MB free_disk=25.976089477539062GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 15:45:11 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:45:11 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:45:11 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Instance spawned successfully.
Apr 11 15:45:11 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 15:45:11 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:45:11 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Found default for hw_cdrom_bus of ide {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:45:11 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Found default for hw_disk_bus of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:45:11 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Found default for hw_input_bus of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:45:11 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Found default for hw_pointer_model of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:45:11 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Found default for hw_video_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:45:11 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Found default for hw_vif_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:45:11 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:45:11 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227911.4213321, 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:45:11 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] VM Started (Lifecycle Event)
Apr 11 15:45:11 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:45:11 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:45:11 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:45:11 user nova-compute[71229]: INFO nova.compute.manager [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Took 5.43 seconds to spawn the instance on the hypervisor.
Apr 11 15:45:11 user nova-compute[71229]: DEBUG nova.compute.manager [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:45:11 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 6f6ae64a-c760-4ba3-8a50-d380835d9913 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:45:11 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 058df5ba-07ab-4bdd-9a47-907e7b0e0e59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:45:11 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 8e816ce5-4da8-4366-9fa1-c33a45ba87fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:45:11 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:45:11 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:45:11 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 15:45:11 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=1152MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 15:45:12 user nova-compute[71229]: INFO nova.compute.manager [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Took 10.42 seconds to build instance.
Apr 11 15:45:12 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1a7c6b1c-3d00-4ac1-a96f-9011a8575274 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.515s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:45:12 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:45:12 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:45:12 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 15:45:12 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.369s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:45:12 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:45:12 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:45:15 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:45:15 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:45:15 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 15:45:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "refresh_cache-6f6ae64a-c760-4ba3-8a50-d380835d9913" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:45:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquired lock "refresh_cache-6f6ae64a-c760-4ba3-8a50-d380835d9913" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:45:15 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Forcefully refreshing network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 15:45:15 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Updating instance_info_cache with network_info: [{"id": "2b891eeb-973f-492a-9059-55961bb956bf", "address": "fa:16:3e:97:b1:ae", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b891eeb-97", "ovs_interfaceid": "2b891eeb-973f-492a-9059-55961bb956bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:45:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Releasing lock "refresh_cache-6f6ae64a-c760-4ba3-8a50-d380835d9913" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:45:15 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Updated the network info_cache for instance {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 15:45:15 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:45:15 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:45:15 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:45:15 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:45:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:45:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:45:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 15:45:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 15:45:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 15:45:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:45:20 user nova-compute[71229]: DEBUG nova.compute.manager [req-05d5b462-2043-4c4d-bede-42143195a7b0 req-577f8045-02d7-4f71-aee1-ea5d3d2182a4 service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Received event network-changed-7f4d2694-64e4-4dd0-af87-84d67de89287 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:45:20 user nova-compute[71229]: DEBUG nova.compute.manager [req-05d5b462-2043-4c4d-bede-42143195a7b0 req-577f8045-02d7-4f71-aee1-ea5d3d2182a4 service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Refreshing instance network info cache due to event network-changed-7f4d2694-64e4-4dd0-af87-84d67de89287. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:45:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-05d5b462-2043-4c4d-bede-42143195a7b0 req-577f8045-02d7-4f71-aee1-ea5d3d2182a4 service nova] Acquiring lock "refresh_cache-8e816ce5-4da8-4366-9fa1-c33a45ba87fd" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:45:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-05d5b462-2043-4c4d-bede-42143195a7b0 req-577f8045-02d7-4f71-aee1-ea5d3d2182a4 service nova] Acquired lock "refresh_cache-8e816ce5-4da8-4366-9fa1-c33a45ba87fd" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:45:20 user nova-compute[71229]: DEBUG nova.network.neutron [req-05d5b462-2043-4c4d-bede-42143195a7b0 req-577f8045-02d7-4f71-aee1-ea5d3d2182a4 service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Refreshing network info cache for port 7f4d2694-64e4-4dd0-af87-84d67de89287 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:45:20 user nova-compute[71229]: DEBUG nova.network.neutron [req-05d5b462-2043-4c4d-bede-42143195a7b0 req-577f8045-02d7-4f71-aee1-ea5d3d2182a4 service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Updated VIF entry in instance network info cache for port 7f4d2694-64e4-4dd0-af87-84d67de89287. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:45:20 user nova-compute[71229]: DEBUG nova.network.neutron [req-05d5b462-2043-4c4d-bede-42143195a7b0 req-577f8045-02d7-4f71-aee1-ea5d3d2182a4 service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Updating instance_info_cache with network_info: [{"id": "7f4d2694-64e4-4dd0-af87-84d67de89287", "address": "fa:16:3e:29:f1:87", "network": {"id": "b1189892-ba9d-4316-9962-c737b27f14bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1737061315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c23461a3d7ca49f6a77d3fde6f1009d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f4d2694-64", "ovs_interfaceid": "7f4d2694-64e4-4dd0-af87-84d67de89287", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:45:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-05d5b462-2043-4c4d-bede-42143195a7b0 req-577f8045-02d7-4f71-aee1-ea5d3d2182a4 service nova] Releasing lock "refresh_cache-8e816ce5-4da8-4366-9fa1-c33a45ba87fd" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:45:21 user nova-compute[71229]: DEBUG nova.compute.manager [req-9daab920-1a57-40e2-875d-ea668dce96c6 req-3cb63d98-794a-45a7-9368-2069ebb394ab service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Received event network-changed-7f4d2694-64e4-4dd0-af87-84d67de89287 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:45:21 user nova-compute[71229]: DEBUG nova.compute.manager [req-9daab920-1a57-40e2-875d-ea668dce96c6 req-3cb63d98-794a-45a7-9368-2069ebb394ab service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Refreshing instance network info cache due to event network-changed-7f4d2694-64e4-4dd0-af87-84d67de89287. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:45:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-9daab920-1a57-40e2-875d-ea668dce96c6 req-3cb63d98-794a-45a7-9368-2069ebb394ab service nova] Acquiring lock "refresh_cache-8e816ce5-4da8-4366-9fa1-c33a45ba87fd" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:45:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-9daab920-1a57-40e2-875d-ea668dce96c6 req-3cb63d98-794a-45a7-9368-2069ebb394ab service nova] Acquired lock "refresh_cache-8e816ce5-4da8-4366-9fa1-c33a45ba87fd" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:45:21 user nova-compute[71229]: DEBUG nova.network.neutron [req-9daab920-1a57-40e2-875d-ea668dce96c6 req-3cb63d98-794a-45a7-9368-2069ebb394ab service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Refreshing network info cache for port 7f4d2694-64e4-4dd0-af87-84d67de89287 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:45:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-7cde4341-193d-40ff-93b3-3dfda2f274a4 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:45:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-7cde4341-193d-40ff-93b3-3dfda2f274a4 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:45:21 user nova-compute[71229]: INFO nova.compute.manager [None req-7cde4341-193d-40ff-93b3-3dfda2f274a4 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Detaching volume 65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79
Apr 11 15:45:21 user nova-compute[71229]: INFO nova.virt.block_device [None req-7cde4341-193d-40ff-93b3-3dfda2f274a4 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Attempting to driver detach volume 65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79 from mountpoint /dev/vdb
Apr 11 15:45:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-7cde4341-193d-40ff-93b3-3dfda2f274a4 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Attempting to detach device vdb from instance 8e816ce5-4da8-4366-9fa1-c33a45ba87fd from the persistent domain config. {{(pid=71229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 15:45:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-7cde4341-193d-40ff-93b3-3dfda2f274a4 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 15:45:21 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:45:21 user nova-compute[71229]:   <source dev="/dev/sdd"/>
Apr 11 15:45:21 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 15:45:21 user nova-compute[71229]:   <serial>65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79</serial>
Apr 11 15:45:21 user nova-compute[71229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 15:45:21 user nova-compute[71229]: </disk>
Apr 11 15:45:21 user nova-compute[71229]:  {{(pid=71229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 15:45:21 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-7cde4341-193d-40ff-93b3-3dfda2f274a4 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Successfully detached device vdb from instance 8e816ce5-4da8-4366-9fa1-c33a45ba87fd from the persistent domain config.
Apr 11 15:45:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-7cde4341-193d-40ff-93b3-3dfda2f274a4 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8e816ce5-4da8-4366-9fa1-c33a45ba87fd from the live domain config. {{(pid=71229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 15:45:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-7cde4341-193d-40ff-93b3-3dfda2f274a4 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 15:45:21 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:45:21 user nova-compute[71229]:   <source dev="/dev/sdd"/>
Apr 11 15:45:21 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 15:45:21 user nova-compute[71229]:   <serial>65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79</serial>
Apr 11 15:45:21 user nova-compute[71229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 15:45:21 user nova-compute[71229]: </disk>
Apr 11 15:45:21 user nova-compute[71229]:  {{(pid=71229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 15:45:21 user nova-compute[71229]: DEBUG nova.network.neutron [req-9daab920-1a57-40e2-875d-ea668dce96c6 req-3cb63d98-794a-45a7-9368-2069ebb394ab service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Updated VIF entry in instance network info cache for port 7f4d2694-64e4-4dd0-af87-84d67de89287. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:45:21 user nova-compute[71229]: DEBUG nova.network.neutron [req-9daab920-1a57-40e2-875d-ea668dce96c6 req-3cb63d98-794a-45a7-9368-2069ebb394ab service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Updating instance_info_cache with network_info: [{"id": "7f4d2694-64e4-4dd0-af87-84d67de89287", "address": "fa:16:3e:29:f1:87", "network": {"id": "b1189892-ba9d-4316-9962-c737b27f14bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1737061315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c23461a3d7ca49f6a77d3fde6f1009d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f4d2694-64", "ovs_interfaceid": "7f4d2694-64e4-4dd0-af87-84d67de89287", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:45:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-9daab920-1a57-40e2-875d-ea668dce96c6 req-3cb63d98-794a-45a7-9368-2069ebb394ab service nova] Releasing lock "refresh_cache-8e816ce5-4da8-4366-9fa1-c33a45ba87fd" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:45:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Received event <DeviceRemovedEvent: 1681227921.98418, 8e816ce5-4da8-4366-9fa1-c33a45ba87fd => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71229) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 15:45:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-7cde4341-193d-40ff-93b3-3dfda2f274a4 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8e816ce5-4da8-4366-9fa1-c33a45ba87fd {{(pid=71229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 15:45:21 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-7cde4341-193d-40ff-93b3-3dfda2f274a4 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Successfully detached device vdb from instance 8e816ce5-4da8-4366-9fa1-c33a45ba87fd from the live domain config.
Apr 11 15:45:22 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cde4341-193d-40ff-93b3-3dfda2f274a4 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 15:45:22 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cde4341-193d-40ff-93b3-3dfda2f274a4 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gLYHaXcb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:45:22 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-7cde4341-193d-40ff-93b3-3dfda2f274a4 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:45:22 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-7cde4341-193d-40ff-93b3-3dfda2f274a4 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:45:22 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-7cde4341-193d-40ff-93b3-3dfda2f274a4 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:45:22 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:45:22 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:45:22 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d94c1e-56c6-46cc-876e-b5b4f029eb2c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:45:22 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cde4341-193d-40ff-93b3-3dfda2f274a4 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 15:45:22 user nova-compute[71229]: No targets found.
Apr 11 15:45:22 user nova-compute[71229]: iSNS:
Apr 11 15:45:22 user nova-compute[71229]: No targets found.
Apr 11 15:45:22 user nova-compute[71229]: STATIC:
Apr 11 15:45:22 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79
Apr 11 15:45:22 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:45:22 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:45:22 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392
Apr 11 15:45:22 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:45:22 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:45:22 user nova-compute[71229]: FIRMWARE:
Apr 11 15:45:22 user nova-compute[71229]: No targets found.
Apr 11 15:45:22 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:45:22 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cde4341-193d-40ff-93b3-3dfda2f274a4 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 15:45:22 user nova-compute[71229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 15:45:22 user nova-compute[71229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71229) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 15:45:22 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cde4341-193d-40ff-93b3-3dfda2f274a4 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79', 0)] {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 15:45:22 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:45:22 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:45:22 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f22240a-1cc1-4936-b4c1-a348bc95ab0d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:45:22 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:45:22 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:45:22 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4467b6ae-a374-4395-b91b-bc512b08de19]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:45:22 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cde4341-193d-40ff-93b3-3dfda2f274a4 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79 (non-flash)
Apr 11 15:45:22 user nova-compute[71229]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392 (non-flash)
Apr 11 15:45:22 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:45:22 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cde4341-193d-40ff-93b3-3dfda2f274a4 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79 (non-flash)
Apr 11 15:45:22 user nova-compute[71229]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392 (non-flash)
Apr 11 15:45:22 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:45:22 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cde4341-193d-40ff-93b3-3dfda2f274a4 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb67a14ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79'): ({'sdd'}, set())}) {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 15:45:22 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-7cde4341-193d-40ff-93b3-3dfda2f274a4 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Removing single pathed devices sdd {{(pid=71229) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 15:45:22 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:45:22 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:45:22 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd97d42c-764a-421b-a9d4-1eb7310e22a1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:45:22 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:45:22 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.029s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:45:22 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[520f88f8-233e-40a5-b89b-3dfd5b515aff]: (4, ('ok\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:45:22 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-7cde4341-193d-40ff-93b3-3dfda2f274a4 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Flushing IO for device /dev/sdd {{(pid=71229) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 15:45:22 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:45:22 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:45:22 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[491acb24-df1f-4bfa-8e89-cc6a43b3bd84]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:45:22 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-7cde4341-193d-40ff-93b3-3dfda2f274a4 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71229) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 15:45:22 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:45:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:45:22 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.058s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:45:22 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2378cc7e-40ff-46cb-a794-5b9c20869e43]: (4, ('1', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:45:22 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-7cde4341-193d-40ff-93b3-3dfda2f274a4 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 15:45:22 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-7cde4341-193d-40ff-93b3-3dfda2f274a4 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] SCSI volumes sdd have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 15:45:22 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cde4341-193d-40ff-93b3-3dfda2f274a4 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79')] {{(pid=71229) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 15:45:22 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:45:22 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:45:22 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9829377-837f-4b9f-8500-13c6bec45acb]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:45:22 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cde4341-193d-40ff-93b3-3dfda2f274a4 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:45:22 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79 -p 172.16.0.220:3260 --logout {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:45:22 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:45:22 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b18a25a-9a25-4cc3-a077-f55d880c76a5]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:45:22 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cde4341-193d-40ff-93b3-3dfda2f274a4 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79, portal: 172.16.0.220,3260]
Apr 11 15:45:22 user nova-compute[71229]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79, portal: 172.16.0.220,3260] successful.
Apr 11 15:45:22 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:45:22 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79 -p 172.16.0.220:3260 --op delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:45:22 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65c0b921-0d2d-48d4-8bc5-19cdd6dd6d79 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:45:22 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38ee2d1-c88a-4039-ba8f-499e385e2b8c]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:45:22 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cde4341-193d-40ff-93b3-3dfda2f274a4 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:45:22 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-7cde4341-193d-40ff-93b3-3dfda2f274a4 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:45:22 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cde4341-193d-40ff-93b3-3dfda2f274a4 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] <== disconnect_volume: return (367ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:45:22 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cde4341-193d-40ff-93b3-3dfda2f274a4 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 15:45:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:45:23 user nova-compute[71229]: DEBUG nova.objects.instance [None req-7cde4341-193d-40ff-93b3-3dfda2f274a4 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lazy-loading 'flavor' on Instance uuid 8e816ce5-4da8-4366-9fa1-c33a45ba87fd {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:45:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-7cde4341-193d-40ff-93b3-3dfda2f274a4 tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.540s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:45:26 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:45:27 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:45:27 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:45:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:45:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:45:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:45:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:45:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:45:42 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:45:42 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:45:44 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:45:45 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:45:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:45:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:45:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:45:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:45:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:45:49 user nova-compute[71229]: DEBUG nova.compute.manager [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Starting instance... {{(pid=71229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 15:45:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:45:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:45:49 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 15:45:49 user nova-compute[71229]: INFO nova.compute.claims [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Claim successful on node user
Apr 11 15:45:50 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:45:50 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:45:50 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.289s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:45:50 user nova-compute[71229]: DEBUG nova.compute.manager [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Start building networks asynchronously for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 15:45:50 user nova-compute[71229]: DEBUG nova.compute.manager [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Allocating IP information in the background. {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 15:45:50 user nova-compute[71229]: DEBUG nova.network.neutron [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] allocate_for_instance() {{(pid=71229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 15:45:50 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 15:45:50 user nova-compute[71229]: DEBUG nova.compute.manager [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Start building block device mappings for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 15:45:50 user nova-compute[71229]: DEBUG nova.policy [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0b244004380d43699c5a06e817224b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c9dbdbc7b641f096dc292ea7bf7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71229) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 15:45:50 user nova-compute[71229]: DEBUG nova.compute.manager [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Start spawning the instance on the hypervisor. {{(pid=71229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 15:45:50 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Creating instance directory {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 15:45:50 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Creating image(s)
Apr 11 15:45:50 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "/opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:45:50 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "/opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:45:50 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "/opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:45:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:45:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.135s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:45:50 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:45:50 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:45:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:45:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.133s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:45:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk 1073741824 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:45:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk 1073741824" returned: 0 in 0.067s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:45:50 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.208s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:45:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:45:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.130s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:45:50 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk. size=1073741824 {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 15:45:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:45:50 user nova-compute[71229]: DEBUG nova.network.neutron [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Successfully created port: cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 15:45:50 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:45:50 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Cannot resize image /opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk to a smaller size. {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 15:45:50 user nova-compute[71229]: DEBUG nova.objects.instance [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lazy-loading 'migration_context' on Instance uuid f0fc18ff-897c-4f97-95b6-9f25d11dba88 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:45:51 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Created local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 15:45:51 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Ensure instance console log exists: /opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 15:45:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:45:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:45:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:45:51 user nova-compute[71229]: DEBUG nova.network.neutron [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Successfully updated port: cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:45:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "refresh_cache-f0fc18ff-897c-4f97-95b6-9f25d11dba88" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:45:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquired lock "refresh_cache-f0fc18ff-897c-4f97-95b6-9f25d11dba88" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:45:51 user nova-compute[71229]: DEBUG nova.network.neutron [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:45:51 user nova-compute[71229]: DEBUG nova.compute.manager [req-b6a46873-a90c-4e57-ab69-957053e35591 req-873b0cf4-99fd-40f7-92ad-0f27b41ee1a2 service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Received event network-changed-cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:45:51 user nova-compute[71229]: DEBUG nova.compute.manager [req-b6a46873-a90c-4e57-ab69-957053e35591 req-873b0cf4-99fd-40f7-92ad-0f27b41ee1a2 service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Refreshing instance network info cache due to event network-changed-cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:45:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-b6a46873-a90c-4e57-ab69-957053e35591 req-873b0cf4-99fd-40f7-92ad-0f27b41ee1a2 service nova] Acquiring lock "refresh_cache-f0fc18ff-897c-4f97-95b6-9f25d11dba88" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:45:51 user nova-compute[71229]: DEBUG nova.network.neutron [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:45:52 user nova-compute[71229]: DEBUG nova.network.neutron [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Updating instance_info_cache with network_info: [{"id": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01", "address": "fa:16:3e:39:51:c6", "network": {"id": "81031696-fd25-42a1-8c36-43a6eacbab12", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1627850915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c9dbdbc7b641f096dc292ea7bf7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf0cc1bf-40", "ovs_interfaceid": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:45:52 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Releasing lock "refresh_cache-f0fc18ff-897c-4f97-95b6-9f25d11dba88" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:45:52 user nova-compute[71229]: DEBUG nova.compute.manager [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Instance network_info: |[{"id": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01", "address": "fa:16:3e:39:51:c6", "network": {"id": "81031696-fd25-42a1-8c36-43a6eacbab12", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1627850915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c9dbdbc7b641f096dc292ea7bf7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf0cc1bf-40", "ovs_interfaceid": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 15:45:52 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-b6a46873-a90c-4e57-ab69-957053e35591 req-873b0cf4-99fd-40f7-92ad-0f27b41ee1a2 service nova] Acquired lock "refresh_cache-f0fc18ff-897c-4f97-95b6-9f25d11dba88" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:45:52 user nova-compute[71229]: DEBUG nova.network.neutron [req-b6a46873-a90c-4e57-ab69-957053e35591 req-873b0cf4-99fd-40f7-92ad-0f27b41ee1a2 service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Refreshing network info cache for port cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:45:52 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Start _get_guest_xml network_info=[{"id": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01", "address": "fa:16:3e:39:51:c6", "network": {"id": "81031696-fd25-42a1-8c36-43a6eacbab12", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1627850915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c9dbdbc7b641f096dc292ea7bf7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf0cc1bf-40", "ovs_interfaceid": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '52fe638c-5ada-47d5-b376-233bfa808a37'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:45:52 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:45:52 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:45:52 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:45:52 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:45:52 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:45:52 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:45:52 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:45:52 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:45:52 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:45:52 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:45:52 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:45:52 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:45:52 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:45:52 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:45:52 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:45:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-264655155',display_name='tempest-ServerStableDeviceRescueTest-server-264655155',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-264655155',id=35,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESSrnhmezC7HQi+h0OdTtButyUJkAu5n8hHJP9eUrxeUgZ1v8+l+B++ncR6In95oR0ORBJlzSH/RoWq4EEt/BxSJF7IPv0bb8yRJgYBk+JaLJ0rhNGgPTIehYPdLc82UA==',key_name='tempest-keypair-363003976',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85c9dbdbc7b641f096dc292ea7bf7cd4',ramdisk_id='',reservation_id='r-o21y4kmv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1990539250',owner_user_name='tempest-ServerStableDeviceRescueTest-1990539250-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:45:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b244004380d43699c5a06e817224b3e',uuid=f0fc18ff-897c-4f97-95b6-9f25d11dba88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01", "address": "fa:16:3e:39:51:c6", "network": {"id": "81031696-fd25-42a1-8c36-43a6eacbab12", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1627850915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c9dbdbc7b641f096dc292ea7bf7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf0cc1bf-40", "ovs_interfaceid": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:45:52 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Converting VIF {"id": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01", "address": "fa:16:3e:39:51:c6", "network": {"id": "81031696-fd25-42a1-8c36-43a6eacbab12", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1627850915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c9dbdbc7b641f096dc292ea7bf7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf0cc1bf-40", "ovs_interfaceid": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:45:52 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:51:c6,bridge_name='br-int',has_traffic_filtering=True,id=cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01,network=Network(81031696-fd25-42a1-8c36-43a6eacbab12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf0cc1bf-40') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:45:52 user nova-compute[71229]: DEBUG nova.objects.instance [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lazy-loading 'pci_devices' on Instance uuid f0fc18ff-897c-4f97-95b6-9f25d11dba88 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:45:52 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:45:52 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:45:52 user nova-compute[71229]:   <uuid>f0fc18ff-897c-4f97-95b6-9f25d11dba88</uuid>
Apr 11 15:45:52 user nova-compute[71229]:   <name>instance-00000023</name>
Apr 11 15:45:52 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:45:52 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:45:52 user nova-compute[71229]:   <metadata>
Apr 11 15:45:52 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:45:52 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:45:52 user nova-compute[71229]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-264655155</nova:name>
Apr 11 15:45:52 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:45:52</nova:creationTime>
Apr 11 15:45:52 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:45:52 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:45:52 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:45:52 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:45:52 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:45:52 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:45:52 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:45:52 user nova-compute[71229]:       <nova:owner>
Apr 11 15:45:52 user nova-compute[71229]:         <nova:user uuid="0b244004380d43699c5a06e817224b3e">tempest-ServerStableDeviceRescueTest-1990539250-project-member</nova:user>
Apr 11 15:45:52 user nova-compute[71229]:         <nova:project uuid="85c9dbdbc7b641f096dc292ea7bf7cd4">tempest-ServerStableDeviceRescueTest-1990539250</nova:project>
Apr 11 15:45:52 user nova-compute[71229]:       </nova:owner>
Apr 11 15:45:52 user nova-compute[71229]:       <nova:root type="image" uuid="52fe638c-5ada-47d5-b376-233bfa808a37"/>
Apr 11 15:45:52 user nova-compute[71229]:       <nova:ports>
Apr 11 15:45:52 user nova-compute[71229]:         <nova:port uuid="cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01">
Apr 11 15:45:52 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 11 15:45:52 user nova-compute[71229]:         </nova:port>
Apr 11 15:45:52 user nova-compute[71229]:       </nova:ports>
Apr 11 15:45:52 user nova-compute[71229]:     </nova:instance>
Apr 11 15:45:52 user nova-compute[71229]:   </metadata>
Apr 11 15:45:52 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:45:52 user nova-compute[71229]:     <system>
Apr 11 15:45:52 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:45:52 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:45:52 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:45:52 user nova-compute[71229]:       <entry name="serial">f0fc18ff-897c-4f97-95b6-9f25d11dba88</entry>
Apr 11 15:45:52 user nova-compute[71229]:       <entry name="uuid">f0fc18ff-897c-4f97-95b6-9f25d11dba88</entry>
Apr 11 15:45:52 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:45:52 user nova-compute[71229]:     </system>
Apr 11 15:45:52 user nova-compute[71229]:   </sysinfo>
Apr 11 15:45:52 user nova-compute[71229]:   <os>
Apr 11 15:45:52 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:45:52 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 15:45:52 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:45:52 user nova-compute[71229]:   </os>
Apr 11 15:45:52 user nova-compute[71229]:   <features>
Apr 11 15:45:52 user nova-compute[71229]:     <acpi/>
Apr 11 15:45:52 user nova-compute[71229]:     <apic/>
Apr 11 15:45:52 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:45:52 user nova-compute[71229]:   </features>
Apr 11 15:45:52 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:45:52 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:45:52 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:45:52 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:45:52 user nova-compute[71229]:   </clock>
Apr 11 15:45:52 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:45:52 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:45:52 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:45:52 user nova-compute[71229]:   </cpu>
Apr 11 15:45:52 user nova-compute[71229]:   <devices>
Apr 11 15:45:52 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 15:45:52 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 15:45:52 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk"/>
Apr 11 15:45:52 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:45:52 user nova-compute[71229]:     </disk>
Apr 11 15:45:52 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:45:52 user nova-compute[71229]:       <mac address="fa:16:3e:39:51:c6"/>
Apr 11 15:45:52 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:45:52 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:45:52 user nova-compute[71229]:       <target dev="tapcf0cc1bf-40"/>
Apr 11 15:45:52 user nova-compute[71229]:     </interface>
Apr 11 15:45:52 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:45:52 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/console.log" append="off"/>
Apr 11 15:45:52 user nova-compute[71229]:     </serial>
Apr 11 15:45:52 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:45:52 user nova-compute[71229]:     <video>
Apr 11 15:45:52 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:45:52 user nova-compute[71229]:     </video>
Apr 11 15:45:52 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:45:52 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:45:52 user nova-compute[71229]:     </rng>
Apr 11 15:45:52 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:45:52 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:45:52 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:45:52 user nova-compute[71229]:     </memballoon>
Apr 11 15:45:52 user nova-compute[71229]:   </devices>
Apr 11 15:45:52 user nova-compute[71229]: </domain>
Apr 11 15:45:52 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:45:52 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:45:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-264655155',display_name='tempest-ServerStableDeviceRescueTest-server-264655155',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-264655155',id=35,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESSrnhmezC7HQi+h0OdTtButyUJkAu5n8hHJP9eUrxeUgZ1v8+l+B++ncR6In95oR0ORBJlzSH/RoWq4EEt/BxSJF7IPv0bb8yRJgYBk+JaLJ0rhNGgPTIehYPdLc82UA==',key_name='tempest-keypair-363003976',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85c9dbdbc7b641f096dc292ea7bf7cd4',ramdisk_id='',reservation_id='r-o21y4kmv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1990539250',owner_user_name='tempest-ServerStableDeviceRescueTest-1990539250-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:45:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b244004380d43699c5a06e817224b3e',uuid=f0fc18ff-897c-4f97-95b6-9f25d11dba88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01", "address": "fa:16:3e:39:51:c6", "network": {"id": "81031696-fd25-42a1-8c36-43a6eacbab12", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1627850915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c9dbdbc7b641f096dc292ea7bf7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf0cc1bf-40", "ovs_interfaceid": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:45:52 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Converting VIF {"id": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01", "address": "fa:16:3e:39:51:c6", "network": {"id": "81031696-fd25-42a1-8c36-43a6eacbab12", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1627850915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c9dbdbc7b641f096dc292ea7bf7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf0cc1bf-40", "ovs_interfaceid": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:45:52 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:51:c6,bridge_name='br-int',has_traffic_filtering=True,id=cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01,network=Network(81031696-fd25-42a1-8c36-43a6eacbab12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf0cc1bf-40') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:45:52 user nova-compute[71229]: DEBUG os_vif [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:51:c6,bridge_name='br-int',has_traffic_filtering=True,id=cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01,network=Network(81031696-fd25-42a1-8c36-43a6eacbab12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf0cc1bf-40') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:45:52 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:45:52 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:45:52 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:45:52 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:45:52 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcf0cc1bf-40, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:45:52 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcf0cc1bf-40, col_values=(('external_ids', {'iface-id': 'cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:51:c6', 'vm-uuid': 'f0fc18ff-897c-4f97-95b6-9f25d11dba88'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:45:52 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:45:52 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:45:52 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:45:52 user nova-compute[71229]: INFO os_vif [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:51:c6,bridge_name='br-int',has_traffic_filtering=True,id=cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01,network=Network(81031696-fd25-42a1-8c36-43a6eacbab12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf0cc1bf-40')
Apr 11 15:45:52 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:45:52 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] No VIF found with MAC fa:16:3e:39:51:c6, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:45:52 user nova-compute[71229]: DEBUG nova.network.neutron [req-b6a46873-a90c-4e57-ab69-957053e35591 req-873b0cf4-99fd-40f7-92ad-0f27b41ee1a2 service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Updated VIF entry in instance network info cache for port cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:45:52 user nova-compute[71229]: DEBUG nova.network.neutron [req-b6a46873-a90c-4e57-ab69-957053e35591 req-873b0cf4-99fd-40f7-92ad-0f27b41ee1a2 service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Updating instance_info_cache with network_info: [{"id": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01", "address": "fa:16:3e:39:51:c6", "network": {"id": "81031696-fd25-42a1-8c36-43a6eacbab12", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1627850915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c9dbdbc7b641f096dc292ea7bf7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf0cc1bf-40", "ovs_interfaceid": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:45:52 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-b6a46873-a90c-4e57-ab69-957053e35591 req-873b0cf4-99fd-40f7-92ad-0f27b41ee1a2 service nova] Releasing lock "refresh_cache-f0fc18ff-897c-4f97-95b6-9f25d11dba88" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:45:53 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:45:53 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:45:53 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:45:54 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:45:54 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:45:54 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:45:54 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:45:54 user nova-compute[71229]: DEBUG nova.compute.manager [req-2f9bf738-15a2-4305-9378-c9147de151c5 req-72bfe26a-1f8a-4df9-81ed-078f9fa330a8 service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Received event network-vif-plugged-cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:45:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2f9bf738-15a2-4305-9378-c9147de151c5 req-72bfe26a-1f8a-4df9-81ed-078f9fa330a8 service nova] Acquiring lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:45:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2f9bf738-15a2-4305-9378-c9147de151c5 req-72bfe26a-1f8a-4df9-81ed-078f9fa330a8 service nova] Lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:45:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2f9bf738-15a2-4305-9378-c9147de151c5 req-72bfe26a-1f8a-4df9-81ed-078f9fa330a8 service nova] Lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:45:54 user nova-compute[71229]: DEBUG nova.compute.manager [req-2f9bf738-15a2-4305-9378-c9147de151c5 req-72bfe26a-1f8a-4df9-81ed-078f9fa330a8 service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] No waiting events found dispatching network-vif-plugged-cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:45:54 user nova-compute[71229]: WARNING nova.compute.manager [req-2f9bf738-15a2-4305-9378-c9147de151c5 req-72bfe26a-1f8a-4df9-81ed-078f9fa330a8 service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Received unexpected event network-vif-plugged-cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 for instance with vm_state building and task_state spawning.
Apr 11 15:45:55 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227955.782861, f0fc18ff-897c-4f97-95b6-9f25d11dba88 => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:45:55 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] VM Resumed (Lifecycle Event)
Apr 11 15:45:55 user nova-compute[71229]: DEBUG nova.compute.manager [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 15:45:55 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Guest created on hypervisor {{(pid=71229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 15:45:55 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Instance spawned successfully.
Apr 11 15:45:55 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 15:45:55 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:45:55 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:45:55 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Found default for hw_cdrom_bus of ide {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:45:55 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Found default for hw_disk_bus of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:45:55 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Found default for hw_input_bus of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:45:55 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Found default for hw_pointer_model of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:45:55 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Found default for hw_video_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:45:55 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Found default for hw_vif_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:45:55 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:45:55 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227955.7831278, f0fc18ff-897c-4f97-95b6-9f25d11dba88 => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:45:55 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] VM Started (Lifecycle Event)
Apr 11 15:45:55 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:45:55 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:45:55 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:45:55 user nova-compute[71229]: INFO nova.compute.manager [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Took 5.56 seconds to spawn the instance on the hypervisor.
Apr 11 15:45:55 user nova-compute[71229]: DEBUG nova.compute.manager [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:45:55 user nova-compute[71229]: INFO nova.compute.manager [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Took 6.15 seconds to build instance.
Apr 11 15:45:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-821dda6b-6c77-48b0-a51f-c295db286ecd tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.248s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:45:56 user nova-compute[71229]: DEBUG nova.compute.manager [req-f97c3db1-a316-41e4-afb9-223f4adb5bff req-fa0fcd25-71b4-45ef-b408-16ecd221c7a0 service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Received event network-vif-plugged-cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:45:56 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-f97c3db1-a316-41e4-afb9-223f4adb5bff req-fa0fcd25-71b4-45ef-b408-16ecd221c7a0 service nova] Acquiring lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:45:56 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-f97c3db1-a316-41e4-afb9-223f4adb5bff req-fa0fcd25-71b4-45ef-b408-16ecd221c7a0 service nova] Lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:45:56 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-f97c3db1-a316-41e4-afb9-223f4adb5bff req-fa0fcd25-71b4-45ef-b408-16ecd221c7a0 service nova] Lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:45:56 user nova-compute[71229]: DEBUG nova.compute.manager [req-f97c3db1-a316-41e4-afb9-223f4adb5bff req-fa0fcd25-71b4-45ef-b408-16ecd221c7a0 service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] No waiting events found dispatching network-vif-plugged-cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:45:56 user nova-compute[71229]: WARNING nova.compute.manager [req-f97c3db1-a316-41e4-afb9-223f4adb5bff req-fa0fcd25-71b4-45ef-b408-16ecd221c7a0 service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Received unexpected event network-vif-plugged-cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 for instance with vm_state active and task_state None.
Apr 11 15:45:57 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:45:57 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:46:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:46:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:46:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:46:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:46:07 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:46:07 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 15:46:10 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:46:10 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:46:10 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:46:10 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:46:10 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 15:46:10 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e816ce5-4da8-4366-9fa1-c33a45ba87fd/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:46:10 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e816ce5-4da8-4366-9fa1-c33a45ba87fd/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:46:10 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e816ce5-4da8-4366-9fa1-c33a45ba87fd/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:46:11 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e816ce5-4da8-4366-9fa1-c33a45ba87fd/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:46:11 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:46:11 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:46:11 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:46:11 user nova-compute[71229]: DEBUG nova.compute.manager [req-43baf712-8783-437c-8633-615f47286637 req-e173f183-f6df-4ced-a141-cfb38b9ca8b9 service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Received event network-changed-35ac8f6f-2998-4274-ab63-df7086194703 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:46:11 user nova-compute[71229]: DEBUG nova.compute.manager [req-43baf712-8783-437c-8633-615f47286637 req-e173f183-f6df-4ced-a141-cfb38b9ca8b9 service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Refreshing instance network info cache due to event network-changed-35ac8f6f-2998-4274-ab63-df7086194703. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:46:11 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-43baf712-8783-437c-8633-615f47286637 req-e173f183-f6df-4ced-a141-cfb38b9ca8b9 service nova] Acquiring lock "refresh_cache-c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:46:11 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-43baf712-8783-437c-8633-615f47286637 req-e173f183-f6df-4ced-a141-cfb38b9ca8b9 service nova] Acquired lock "refresh_cache-c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:46:11 user nova-compute[71229]: DEBUG nova.network.neutron [req-43baf712-8783-437c-8633-615f47286637 req-e173f183-f6df-4ced-a141-cfb38b9ca8b9 service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Refreshing network info cache for port 35ac8f6f-2998-4274-ab63-df7086194703 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:46:11 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:46:11 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:46:11 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:46:11 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:46:11 user nova-compute[71229]: DEBUG nova.objects.instance [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lazy-loading 'flavor' on Instance uuid c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:46:11 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:46:11 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:46:11 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.098s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:46:11 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:46:11 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:46:11 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:46:11 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:46:11 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:46:11 user nova-compute[71229]: INFO nova.compute.manager [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Attaching volume a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 to /dev/vdb
Apr 11 15:46:11 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:46:11 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:46:11 user nova-compute[71229]: DEBUG os_brick.utils [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:46:11 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:46:11 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:46:11 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[28fe700e-4292-4368-a23e-7881b657ba53]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d55e24a97c90\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:46:11 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:46:11 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:46:11 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f663e933-1770-4843-94c3-d16c43a2d75f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:46:11 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:46:11 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:46:11 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55f040b-1f1f-4b5c-b0db-208d9c013d6a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:46:11 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e648d849-68ae-4826-b310-58951c41b557]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:46:11 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Running cmd (subprocess): nvme version {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:46:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] 'nvme version' failed. Not Retrying. {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:46:12 user nova-compute[71229]: DEBUG nova.network.neutron [req-43baf712-8783-437c-8633-615f47286637 req-e173f183-f6df-4ced-a141-cfb38b9ca8b9 service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Updated VIF entry in instance network info cache for port 35ac8f6f-2998-4274-ab63-df7086194703. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:46:12 user nova-compute[71229]: DEBUG nova.network.neutron [req-43baf712-8783-437c-8633-615f47286637 req-e173f183-f6df-4ced-a141-cfb38b9ca8b9 service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Updating instance_info_cache with network_info: [{"id": "35ac8f6f-2998-4274-ab63-df7086194703", "address": "fa:16:3e:47:3b:c6", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ac8f6f-29", "ovs_interfaceid": "35ac8f6f-2998-4274-ab63-df7086194703", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:46:12 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] nvme not present on system {{(pid=71229) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 15:46:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:46:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:46:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:46:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:46:12 user nova-compute[71229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 15:46:12 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[079b72c7-74bb-4e1e-817c-e1f397df7f46]: (4, '') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:46:12 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-43baf712-8783-437c-8633-615f47286637 req-e173f183-f6df-4ced-a141-cfb38b9ca8b9 service nova] Releasing lock "refresh_cache-c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:46:12 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71229) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 15:46:12 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 15:46:12 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] LIGHTOS: no hostnqn found. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 15:46:12 user nova-compute[71229]: DEBUG os_brick.utils [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] <== get_connector_properties: return (177ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d55e24a97c90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:46:12 user nova-compute[71229]: DEBUG nova.virt.block_device [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Updating existing volume attachment record: 2e4cb74b-7548-4541-92e9-294f6729b090 {{(pid=71229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 15:46:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:46:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:46:12 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:46:12 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:46:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:46:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:46:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:46:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:46:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:46:13 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:46:13 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:46:13 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8239MB free_disk=25.95305633544922GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 15:46:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:46:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:46:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d177e21f-2fb0-40a2-a4ba-93626572460e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:46:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d177e21f-2fb0-40a2-a4ba-93626572460e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:46:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d177e21f-2fb0-40a2-a4ba-93626572460e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:46:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d177e21f-2fb0-40a2-a4ba-93626572460e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:46:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d177e21f-2fb0-40a2-a4ba-93626572460e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:46:13 user nova-compute[71229]: INFO nova.compute.manager [None req-d177e21f-2fb0-40a2-a4ba-93626572460e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Terminating instance
Apr 11 15:46:13 user nova-compute[71229]: DEBUG nova.compute.manager [None req-d177e21f-2fb0-40a2-a4ba-93626572460e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Start destroying the instance on the hypervisor. {{(pid=71229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 15:46:13 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:46:13 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 6f6ae64a-c760-4ba3-8a50-d380835d9913 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:46:13 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 058df5ba-07ab-4bdd-9a47-907e7b0e0e59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:46:13 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 8e816ce5-4da8-4366-9fa1-c33a45ba87fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:46:13 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:46:13 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:46:13 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance f0fc18ff-897c-4f97-95b6-9f25d11dba88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:46:13 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 15:46:13 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=1280MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 15:46:13 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:46:13 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:46:13 user nova-compute[71229]: DEBUG nova.compute.manager [req-a2d33932-6007-43bf-8c8e-770e6ddf4b60 req-123218f1-183c-410f-a79b-10dca6c7c5c4 service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Received event network-vif-unplugged-7f4d2694-64e4-4dd0-af87-84d67de89287 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:46:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a2d33932-6007-43bf-8c8e-770e6ddf4b60 req-123218f1-183c-410f-a79b-10dca6c7c5c4 service nova] Acquiring lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:46:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a2d33932-6007-43bf-8c8e-770e6ddf4b60 req-123218f1-183c-410f-a79b-10dca6c7c5c4 service nova] Lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:46:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a2d33932-6007-43bf-8c8e-770e6ddf4b60 req-123218f1-183c-410f-a79b-10dca6c7c5c4 service nova] Lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:46:13 user nova-compute[71229]: DEBUG nova.compute.manager [req-a2d33932-6007-43bf-8c8e-770e6ddf4b60 req-123218f1-183c-410f-a79b-10dca6c7c5c4 service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] No waiting events found dispatching network-vif-unplugged-7f4d2694-64e4-4dd0-af87-84d67de89287 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:46:13 user nova-compute[71229]: DEBUG nova.compute.manager [req-a2d33932-6007-43bf-8c8e-770e6ddf4b60 req-123218f1-183c-410f-a79b-10dca6c7c5c4 service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Received event network-vif-unplugged-7f4d2694-64e4-4dd0-af87-84d67de89287 for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 15:46:13 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:46:13 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:46:13 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 15:46:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.383s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:46:13 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Instance destroyed successfully.
Apr 11 15:46:13 user nova-compute[71229]: DEBUG nova.objects.instance [None req-d177e21f-2fb0-40a2-a4ba-93626572460e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lazy-loading 'resources' on Instance uuid 8e816ce5-4da8-4366-9fa1-c33a45ba87fd {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:46:13 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-d177e21f-2fb0-40a2-a4ba-93626572460e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:41:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-658332042',display_name='tempest-TestMinimumBasicScenario-server-658332042',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-658332042',id=31,image_ref='549c0060-ec14-4185-b1e7-cc908fe9383a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEi4e2JA/PL1tAOhcKlKt8FTH71kaR0W8XoERLXcyazkBigSjzY+dpYEFC9a+OYtBKc4ccV+zmtRPE4sE6bLSGB//HIVXoOcZ03OattPC2GZ2XpT9tuqlDYpxg3EGGGEOg==',key_name='tempest-TestMinimumBasicScenario-476755655',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:41:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c23461a3d7ca49f6a77d3fde6f1009d3',ramdisk_id='',reservation_id='r-vjgzwdqb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='549c0060-ec14-4185-b1e7-cc908fe9383a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-673773229',owner_user_name='tempest-TestMinimumBasicScenario-673773229-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:43:36Z,user_data=None,user_id='044f17aee3324b3a97bebe935548b3b4',uuid=8e816ce5-4da8-4366-9fa1-c33a45ba87fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f4d2694-64e4-4dd0-af87-84d67de89287", "address": "fa:16:3e:29:f1:87", "network": {"id": "b1189892-ba9d-4316-9962-c737b27f14bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1737061315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c23461a3d7ca49f6a77d3fde6f1009d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f4d2694-64", "ovs_interfaceid": "7f4d2694-64e4-4dd0-af87-84d67de89287", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:46:13 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-d177e21f-2fb0-40a2-a4ba-93626572460e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Converting VIF {"id": "7f4d2694-64e4-4dd0-af87-84d67de89287", "address": "fa:16:3e:29:f1:87", "network": {"id": "b1189892-ba9d-4316-9962-c737b27f14bb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1737061315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c23461a3d7ca49f6a77d3fde6f1009d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f4d2694-64", "ovs_interfaceid": "7f4d2694-64e4-4dd0-af87-84d67de89287", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:46:13 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-d177e21f-2fb0-40a2-a4ba-93626572460e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:f1:87,bridge_name='br-int',has_traffic_filtering=True,id=7f4d2694-64e4-4dd0-af87-84d67de89287,network=Network(b1189892-ba9d-4316-9962-c737b27f14bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f4d2694-64') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:46:13 user nova-compute[71229]: DEBUG os_vif [None req-d177e21f-2fb0-40a2-a4ba-93626572460e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:f1:87,bridge_name='br-int',has_traffic_filtering=True,id=7f4d2694-64e4-4dd0-af87-84d67de89287,network=Network(b1189892-ba9d-4316-9962-c737b27f14bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f4d2694-64') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:46:13 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:46:13 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f4d2694-64, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:46:13 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:46:13 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:46:13 user nova-compute[71229]: INFO os_vif [None req-d177e21f-2fb0-40a2-a4ba-93626572460e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:f1:87,bridge_name='br-int',has_traffic_filtering=True,id=7f4d2694-64e4-4dd0-af87-84d67de89287,network=Network(b1189892-ba9d-4316-9962-c737b27f14bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f4d2694-64')
Apr 11 15:46:13 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-d177e21f-2fb0-40a2-a4ba-93626572460e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Deleting instance files /opt/stack/data/nova/instances/8e816ce5-4da8-4366-9fa1-c33a45ba87fd_del
Apr 11 15:46:13 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-d177e21f-2fb0-40a2-a4ba-93626572460e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Deletion of /opt/stack/data/nova/instances/8e816ce5-4da8-4366-9fa1-c33a45ba87fd_del complete
Apr 11 15:46:13 user nova-compute[71229]: INFO nova.compute.manager [None req-d177e21f-2fb0-40a2-a4ba-93626572460e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Took 0.84 seconds to destroy the instance on the hypervisor.
Apr 11 15:46:13 user nova-compute[71229]: DEBUG oslo.service.loopingcall [None req-d177e21f-2fb0-40a2-a4ba-93626572460e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71229) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 15:46:13 user nova-compute[71229]: DEBUG nova.compute.manager [-] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Deallocating network for instance {{(pid=71229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 15:46:13 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] deallocate_for_instance() {{(pid=71229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 15:46:14 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:46:14 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Took 0.46 seconds to deallocate network for instance.
Apr 11 15:46:14 user nova-compute[71229]: DEBUG nova.compute.manager [req-dd9a0d32-8b1e-4639-ac53-6efe4596ccfd req-43914ae4-2cda-46ae-b2d6-23e61c369522 service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Received event network-vif-deleted-7f4d2694-64e4-4dd0-af87-84d67de89287 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:46:14 user nova-compute[71229]: INFO nova.compute.manager [req-dd9a0d32-8b1e-4639-ac53-6efe4596ccfd req-43914ae4-2cda-46ae-b2d6-23e61c369522 service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Neutron deleted interface 7f4d2694-64e4-4dd0-af87-84d67de89287; detaching it from the instance and deleting it from the info cache
Apr 11 15:46:14 user nova-compute[71229]: DEBUG nova.network.neutron [req-dd9a0d32-8b1e-4639-ac53-6efe4596ccfd req-43914ae4-2cda-46ae-b2d6-23e61c369522 service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:46:14 user nova-compute[71229]: DEBUG nova.compute.manager [req-dd9a0d32-8b1e-4639-ac53-6efe4596ccfd req-43914ae4-2cda-46ae-b2d6-23e61c369522 service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Detach interface failed, port_id=7f4d2694-64e4-4dd0-af87-84d67de89287, reason: Instance 8e816ce5-4da8-4366-9fa1-c33a45ba87fd could not be found. {{(pid=71229) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 15:46:14 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d177e21f-2fb0-40a2-a4ba-93626572460e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:46:14 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d177e21f-2fb0-40a2-a4ba-93626572460e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:46:14 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:46:14 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 15:46:14 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "refresh_cache-058df5ba-07ab-4bdd-9a47-907e7b0e0e59" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:46:14 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquired lock "refresh_cache-058df5ba-07ab-4bdd-9a47-907e7b0e0e59" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:46:14 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Forcefully refreshing network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 15:46:14 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-d177e21f-2fb0-40a2-a4ba-93626572460e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:46:14 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-d177e21f-2fb0-40a2-a4ba-93626572460e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:46:14 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d177e21f-2fb0-40a2-a4ba-93626572460e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.242s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:46:14 user nova-compute[71229]: INFO nova.scheduler.client.report [None req-d177e21f-2fb0-40a2-a4ba-93626572460e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Deleted allocations for instance 8e816ce5-4da8-4366-9fa1-c33a45ba87fd
Apr 11 15:46:14 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d177e21f-2fb0-40a2-a4ba-93626572460e tempest-TestMinimumBasicScenario-673773229 tempest-TestMinimumBasicScenario-673773229-project-member] Lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.720s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:46:15 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Updating instance_info_cache with network_info: [{"id": "cdfec3e6-f5dc-42e6-98a8-651f46bd37f4", "address": "fa:16:3e:47:d3:74", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdfec3e6-f5", "ovs_interfaceid": "cdfec3e6-f5dc-42e6-98a8-651f46bd37f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:46:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Releasing lock "refresh_cache-058df5ba-07ab-4bdd-9a47-907e7b0e0e59" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:46:15 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Updated the network info_cache for instance {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 15:46:15 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:46:15 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:46:15 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:46:15 user nova-compute[71229]: DEBUG nova.compute.manager [req-1002bdc2-35c2-4bf5-a563-6de27ced34f5 req-88360f50-2c34-4500-8a83-b3812a643e3e service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Received event network-vif-plugged-7f4d2694-64e4-4dd0-af87-84d67de89287 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:46:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-1002bdc2-35c2-4bf5-a563-6de27ced34f5 req-88360f50-2c34-4500-8a83-b3812a643e3e service nova] Acquiring lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:46:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-1002bdc2-35c2-4bf5-a563-6de27ced34f5 req-88360f50-2c34-4500-8a83-b3812a643e3e service nova] Lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:46:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-1002bdc2-35c2-4bf5-a563-6de27ced34f5 req-88360f50-2c34-4500-8a83-b3812a643e3e service nova] Lock "8e816ce5-4da8-4366-9fa1-c33a45ba87fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:46:15 user nova-compute[71229]: DEBUG nova.compute.manager [req-1002bdc2-35c2-4bf5-a563-6de27ced34f5 req-88360f50-2c34-4500-8a83-b3812a643e3e service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] No waiting events found dispatching network-vif-plugged-7f4d2694-64e4-4dd0-af87-84d67de89287 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:46:15 user nova-compute[71229]: WARNING nova.compute.manager [req-1002bdc2-35c2-4bf5-a563-6de27ced34f5 req-88360f50-2c34-4500-8a83-b3812a643e3e service nova] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Received unexpected event network-vif-plugged-7f4d2694-64e4-4dd0-af87-84d67de89287 for instance with vm_state deleted and task_state None.
Apr 11 15:46:15 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bDuJPMck', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:46:16 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:46:16 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:46:16 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:46:16 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:46:16 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 15:46:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c628abdf-3b7f-47a6-9b21-d96974f578c0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 15:46:16 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 -p 172.16.0.220:3260 --interface default --op new {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed3905e-e665-4c94-bd64-2dc28b120f69]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3] added\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3] added
Apr 11 15:46:16 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a02c3d-f0d0-48bd-9f30-5bfb1b42131c]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd2346f-51f0-4f67-8f20-057dc56f2c3f]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bDuJPMck {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bDuJPMck" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a66fe08-c724-4813-ab51-242835f49187]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bDuJPMck'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8431af5-2dc9-4703-a619-47109e9f9241]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7175e3-1090-437e-a5d9-1a2fd3cddab9]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392 (non-flash)
Apr 11 15:46:16 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392 (non-flash)
Apr 11 15:46:16 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 -p 172.16.0.220:3260 --login {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42bb2df-9a61-4007-8a1e-186e1c42bc27]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3, portal: 172.16.0.220,3260]
Apr 11 15:46:16 user nova-compute[71229]: Login to [iface: default, target: iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3, portal: 172.16.0.220,3260] successful.
Apr 11 15:46:16 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4684ae0-a0d4-4b58-82de-c5d51ab5b577]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7f60d2-32ec-42e7-847a-e1d34ec05c8e]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392 (non-flash)
Apr 11 15:46:16 user nova-compute[71229]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 (non-flash)
Apr 11 15:46:16 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392 (non-flash)
Apr 11 15:46:16 user nova-compute[71229]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 (non-flash)
Apr 11 15:46:16 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[46205850-581d-4887-87d6-e184bc7ba03f]: (4, ('- - 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: None {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:46:16 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:46:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:46:17 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:46:17 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bDuJPMck', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 15:46:17 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:46:17 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '23532373464383530', 'path': '/dev/sdc'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:46:17 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532373464383530', 'path': '/dev/sdc'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 15:46:17 user nova-compute[71229]: DEBUG nova.objects.instance [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lazy-loading 'flavor' on Instance uuid c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:46:17 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 15:46:17 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:46:17 user nova-compute[71229]:   <source dev="/dev/sdc"/>
Apr 11 15:46:17 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 15:46:17 user nova-compute[71229]:   <serial>a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3</serial>
Apr 11 15:46:17 user nova-compute[71229]: </disk>
Apr 11 15:46:17 user nova-compute[71229]:  {{(pid=71229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 15:46:17 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:46:18 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:46:18 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:46:18 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] No VIF found with MAC fa:16:3e:47:3b:c6, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:46:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-7f47f70e-5c7a-44fe-91db-c744bd915016 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.345s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:46:18 user nova-compute[71229]: INFO nova.compute.manager [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Rescuing
Apr 11 15:46:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "refresh_cache-c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:46:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquired lock "refresh_cache-c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:46:18 user nova-compute[71229]: DEBUG nova.network.neutron [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:46:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:46:18 user nova-compute[71229]: DEBUG nova.network.neutron [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Updating instance_info_cache with network_info: [{"id": "35ac8f6f-2998-4274-ab63-df7086194703", "address": "fa:16:3e:47:3b:c6", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ac8f6f-29", "ovs_interfaceid": "35ac8f6f-2998-4274-ab63-df7086194703", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:46:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Releasing lock "refresh_cache-c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:46:19 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:46:19 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:46:19 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:46:19 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Instance destroyed successfully.
Apr 11 15:46:19 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Attempting rescue
Apr 11 15:46:19 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71229) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 11 15:46:19 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Instance directory exists: not creating {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 15:46:19 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Creating image(s)
Apr 11 15:46:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "/opt/stack/data/nova/instances/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:46:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "/opt/stack/data/nova/instances/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:46:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "/opt/stack/data/nova/instances/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:46:19 user nova-compute[71229]: DEBUG nova.objects.instance [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lazy-loading 'trusted_certs' on Instance uuid c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:46:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:46:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:46:19 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:46:19 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.137s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:46:19 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/disk.rescue {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:46:19 user nova-compute[71229]: DEBUG nova.compute.manager [req-85285fb0-a6ab-4f76-b723-8ce16701f8a2 req-94fab5aa-82b3-414d-934b-4260b8e8ce06 service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Received event network-vif-unplugged-35ac8f6f-2998-4274-ab63-df7086194703 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:46:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-85285fb0-a6ab-4f76-b723-8ce16701f8a2 req-94fab5aa-82b3-414d-934b-4260b8e8ce06 service nova] Acquiring lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:46:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-85285fb0-a6ab-4f76-b723-8ce16701f8a2 req-94fab5aa-82b3-414d-934b-4260b8e8ce06 service nova] Lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:46:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-85285fb0-a6ab-4f76-b723-8ce16701f8a2 req-94fab5aa-82b3-414d-934b-4260b8e8ce06 service nova] Lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:46:19 user nova-compute[71229]: DEBUG nova.compute.manager [req-85285fb0-a6ab-4f76-b723-8ce16701f8a2 req-94fab5aa-82b3-414d-934b-4260b8e8ce06 service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] No waiting events found dispatching network-vif-unplugged-35ac8f6f-2998-4274-ab63-df7086194703 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:46:19 user nova-compute[71229]: WARNING nova.compute.manager [req-85285fb0-a6ab-4f76-b723-8ce16701f8a2 req-94fab5aa-82b3-414d-934b-4260b8e8ce06 service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Received unexpected event network-vif-unplugged-35ac8f6f-2998-4274-ab63-df7086194703 for instance with vm_state active and task_state rescuing.
Apr 11 15:46:19 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/disk.rescue" returned: 0 in 0.054s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:46:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:46:19 user nova-compute[71229]: DEBUG nova.objects.instance [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lazy-loading 'migration_context' on Instance uuid c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:46:19 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Created local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 15:46:19 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Start _get_guest_xml network_info=[{"id": "35ac8f6f-2998-4274-ab63-df7086194703", "address": "fa:16:3e:47:3b:c6", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "vif_mac": "fa:16:3e:47:3b:c6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ac8f6f-29", "ovs_interfaceid": "35ac8f6f-2998-4274-ab63-df7086194703", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '52fe638c-5ada-47d5-b376-233bfa808a37', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:46:19 user nova-compute[71229]: DEBUG nova.objects.instance [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lazy-loading 'resources' on Instance uuid c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:46:19 user nova-compute[71229]: DEBUG nova.objects.instance [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lazy-loading 'numa_topology' on Instance uuid c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:46:19 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:46:19 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:46:19 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:46:19 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:46:19 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:46:19 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:46:19 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:46:19 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:46:19 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:46:19 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:46:19 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:46:19 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:46:19 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:46:19 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:46:19 user nova-compute[71229]: DEBUG nova.objects.instance [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lazy-loading 'vcpu_model' on Instance uuid c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:46:19 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:44:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1921913590',display_name='tempest-ServerRescueNegativeTestJSON-server-1921913590',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1921913590',id=33,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPYdVbZDtC1igDufA6PhMZJpvm+SfaXlWlDTwlgCYAsIhgsTCFIatXSmQzAx4qEEtvrM9m6Ml8tgUz/SNa6YjJmdUHImSQvQGbvvCZehYMuZMwW6pbpX8JfbeU5smcaBw==',key_name='tempest-keypair-1367691795',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:44:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d700a53aa25849e0afd562b05881d09a',ramdisk_id='',reservation_id='r-kvyblfid',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1491000769',owner_user_name='tempest-ServerRescueNegativeTestJSON-1491000769-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:44:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c8492f96e5d4f54aaae3679c82b6759',uuid=c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35ac8f6f-2998-4274-ab63-df7086194703", "address": "fa:16:3e:47:3b:c6", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "vif_mac": "fa:16:3e:47:3b:c6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ac8f6f-29", "ovs_interfaceid": "35ac8f6f-2998-4274-ab63-df7086194703", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:46:19 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Converting VIF {"id": "35ac8f6f-2998-4274-ab63-df7086194703", "address": "fa:16:3e:47:3b:c6", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "vif_mac": "fa:16:3e:47:3b:c6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ac8f6f-29", "ovs_interfaceid": "35ac8f6f-2998-4274-ab63-df7086194703", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:46:19 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:3b:c6,bridge_name='br-int',has_traffic_filtering=True,id=35ac8f6f-2998-4274-ab63-df7086194703,network=Network(7ba20249-9c62-46d7-810c-8144c1a1f17e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35ac8f6f-29') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:46:19 user nova-compute[71229]: DEBUG nova.objects.instance [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lazy-loading 'pci_devices' on Instance uuid c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:46:19 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:46:19 user nova-compute[71229]:   <uuid>c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a</uuid>
Apr 11 15:46:19 user nova-compute[71229]:   <name>instance-00000021</name>
Apr 11 15:46:19 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:46:19 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:46:19 user nova-compute[71229]:   <metadata>
Apr 11 15:46:19 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:46:19 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:46:19 user nova-compute[71229]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1921913590</nova:name>
Apr 11 15:46:19 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:46:19</nova:creationTime>
Apr 11 15:46:19 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:46:19 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:46:19 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:46:19 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:46:19 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:46:19 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:46:19 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:46:19 user nova-compute[71229]:       <nova:owner>
Apr 11 15:46:19 user nova-compute[71229]:         <nova:user uuid="5c8492f96e5d4f54aaae3679c82b6759">tempest-ServerRescueNegativeTestJSON-1491000769-project-member</nova:user>
Apr 11 15:46:19 user nova-compute[71229]:         <nova:project uuid="d700a53aa25849e0afd562b05881d09a">tempest-ServerRescueNegativeTestJSON-1491000769</nova:project>
Apr 11 15:46:19 user nova-compute[71229]:       </nova:owner>
Apr 11 15:46:19 user nova-compute[71229]:       <nova:root type="image" uuid="52fe638c-5ada-47d5-b376-233bfa808a37"/>
Apr 11 15:46:19 user nova-compute[71229]:       <nova:ports>
Apr 11 15:46:19 user nova-compute[71229]:         <nova:port uuid="35ac8f6f-2998-4274-ab63-df7086194703">
Apr 11 15:46:19 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 11 15:46:19 user nova-compute[71229]:         </nova:port>
Apr 11 15:46:19 user nova-compute[71229]:       </nova:ports>
Apr 11 15:46:19 user nova-compute[71229]:     </nova:instance>
Apr 11 15:46:19 user nova-compute[71229]:   </metadata>
Apr 11 15:46:19 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:46:19 user nova-compute[71229]:     <system>
Apr 11 15:46:19 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:46:19 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:46:19 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:46:19 user nova-compute[71229]:       <entry name="serial">c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a</entry>
Apr 11 15:46:19 user nova-compute[71229]:       <entry name="uuid">c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a</entry>
Apr 11 15:46:19 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:46:19 user nova-compute[71229]:     </system>
Apr 11 15:46:19 user nova-compute[71229]:   </sysinfo>
Apr 11 15:46:19 user nova-compute[71229]:   <os>
Apr 11 15:46:19 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:46:19 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:46:19 user nova-compute[71229]:   </os>
Apr 11 15:46:19 user nova-compute[71229]:   <features>
Apr 11 15:46:19 user nova-compute[71229]:     <acpi/>
Apr 11 15:46:19 user nova-compute[71229]:     <apic/>
Apr 11 15:46:19 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:46:19 user nova-compute[71229]:   </features>
Apr 11 15:46:19 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:46:19 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:46:19 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:46:19 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:46:19 user nova-compute[71229]:   </clock>
Apr 11 15:46:19 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:46:19 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:46:19 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:46:19 user nova-compute[71229]:   </cpu>
Apr 11 15:46:19 user nova-compute[71229]:   <devices>
Apr 11 15:46:19 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 15:46:19 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 15:46:19 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/disk.rescue"/>
Apr 11 15:46:19 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:46:19 user nova-compute[71229]:     </disk>
Apr 11 15:46:19 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 15:46:19 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 15:46:19 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/disk"/>
Apr 11 15:46:19 user nova-compute[71229]:       <target dev="vdb" bus="virtio"/>
Apr 11 15:46:19 user nova-compute[71229]:     </disk>
Apr 11 15:46:19 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:46:19 user nova-compute[71229]:       <mac address="fa:16:3e:47:3b:c6"/>
Apr 11 15:46:19 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:46:19 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:46:19 user nova-compute[71229]:       <target dev="tap35ac8f6f-29"/>
Apr 11 15:46:19 user nova-compute[71229]:     </interface>
Apr 11 15:46:19 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:46:19 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/console.log" append="off"/>
Apr 11 15:46:19 user nova-compute[71229]:     </serial>
Apr 11 15:46:19 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:46:19 user nova-compute[71229]:     <video>
Apr 11 15:46:19 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:46:19 user nova-compute[71229]:     </video>
Apr 11 15:46:19 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:46:19 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:46:19 user nova-compute[71229]:     </rng>
Apr 11 15:46:19 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:46:19 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:46:19 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:46:19 user nova-compute[71229]:     </memballoon>
Apr 11 15:46:19 user nova-compute[71229]:   </devices>
Apr 11 15:46:19 user nova-compute[71229]: </domain>
Apr 11 15:46:19 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:46:19 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Instance destroyed successfully.
Apr 11 15:46:20 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:46:20 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:46:20 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] No VIF found with MAC fa:16:3e:47:3b:c6, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:46:21 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:46:21 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:46:21 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:46:21 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:46:21 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:46:21 user nova-compute[71229]: DEBUG nova.compute.manager [req-619e7683-6ca8-4703-b642-7d3c5dc5032a req-ff70caa9-f40c-4503-998c-0d7e5c5b4cef service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Received event network-vif-plugged-35ac8f6f-2998-4274-ab63-df7086194703 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:46:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-619e7683-6ca8-4703-b642-7d3c5dc5032a req-ff70caa9-f40c-4503-998c-0d7e5c5b4cef service nova] Acquiring lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:46:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-619e7683-6ca8-4703-b642-7d3c5dc5032a req-ff70caa9-f40c-4503-998c-0d7e5c5b4cef service nova] Lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:46:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-619e7683-6ca8-4703-b642-7d3c5dc5032a req-ff70caa9-f40c-4503-998c-0d7e5c5b4cef service nova] Lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:46:21 user nova-compute[71229]: DEBUG nova.compute.manager [req-619e7683-6ca8-4703-b642-7d3c5dc5032a req-ff70caa9-f40c-4503-998c-0d7e5c5b4cef service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] No waiting events found dispatching network-vif-plugged-35ac8f6f-2998-4274-ab63-df7086194703 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:46:21 user nova-compute[71229]: WARNING nova.compute.manager [req-619e7683-6ca8-4703-b642-7d3c5dc5032a req-ff70caa9-f40c-4503-998c-0d7e5c5b4cef service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Received unexpected event network-vif-plugged-35ac8f6f-2998-4274-ab63-df7086194703 for instance with vm_state active and task_state rescuing.
Apr 11 15:46:21 user nova-compute[71229]: DEBUG nova.compute.manager [req-619e7683-6ca8-4703-b642-7d3c5dc5032a req-ff70caa9-f40c-4503-998c-0d7e5c5b4cef service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Received event network-vif-plugged-35ac8f6f-2998-4274-ab63-df7086194703 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:46:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-619e7683-6ca8-4703-b642-7d3c5dc5032a req-ff70caa9-f40c-4503-998c-0d7e5c5b4cef service nova] Acquiring lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:46:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-619e7683-6ca8-4703-b642-7d3c5dc5032a req-ff70caa9-f40c-4503-998c-0d7e5c5b4cef service nova] Lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:46:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-619e7683-6ca8-4703-b642-7d3c5dc5032a req-ff70caa9-f40c-4503-998c-0d7e5c5b4cef service nova] Lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:46:21 user nova-compute[71229]: DEBUG nova.compute.manager [req-619e7683-6ca8-4703-b642-7d3c5dc5032a req-ff70caa9-f40c-4503-998c-0d7e5c5b4cef service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] No waiting events found dispatching network-vif-plugged-35ac8f6f-2998-4274-ab63-df7086194703 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:46:21 user nova-compute[71229]: WARNING nova.compute.manager [req-619e7683-6ca8-4703-b642-7d3c5dc5032a req-ff70caa9-f40c-4503-998c-0d7e5c5b4cef service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Received unexpected event network-vif-plugged-35ac8f6f-2998-4274-ab63-df7086194703 for instance with vm_state active and task_state rescuing.
Apr 11 15:46:21 user nova-compute[71229]: DEBUG nova.compute.manager [req-619e7683-6ca8-4703-b642-7d3c5dc5032a req-ff70caa9-f40c-4503-998c-0d7e5c5b4cef service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Received event network-vif-plugged-35ac8f6f-2998-4274-ab63-df7086194703 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:46:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-619e7683-6ca8-4703-b642-7d3c5dc5032a req-ff70caa9-f40c-4503-998c-0d7e5c5b4cef service nova] Acquiring lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:46:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-619e7683-6ca8-4703-b642-7d3c5dc5032a req-ff70caa9-f40c-4503-998c-0d7e5c5b4cef service nova] Lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:46:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-619e7683-6ca8-4703-b642-7d3c5dc5032a req-ff70caa9-f40c-4503-998c-0d7e5c5b4cef service nova] Lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:46:21 user nova-compute[71229]: DEBUG nova.compute.manager [req-619e7683-6ca8-4703-b642-7d3c5dc5032a req-ff70caa9-f40c-4503-998c-0d7e5c5b4cef service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] No waiting events found dispatching network-vif-plugged-35ac8f6f-2998-4274-ab63-df7086194703 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:46:21 user nova-compute[71229]: WARNING nova.compute.manager [req-619e7683-6ca8-4703-b642-7d3c5dc5032a req-ff70caa9-f40c-4503-998c-0d7e5c5b4cef service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Received unexpected event network-vif-plugged-35ac8f6f-2998-4274-ab63-df7086194703 for instance with vm_state active and task_state rescuing.
Apr 11 15:46:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:46:23 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Removed pending event for c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a due to event {{(pid=71229) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 15:46:23 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227983.6975935, c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:46:23 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] VM Resumed (Lifecycle Event)
Apr 11 15:46:23 user nova-compute[71229]: DEBUG nova.compute.manager [None req-1df1f9b3-b866-4198-82c6-2f2de5e6ccd7 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:46:23 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:46:23 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:46:23 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 11 15:46:23 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681227983.6989071, c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:46:23 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] VM Started (Lifecycle Event)
Apr 11 15:46:23 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:46:23 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:46:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:46:27 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:46:28 user nova-compute[71229]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681227973.8786345, 8e816ce5-4da8-4366-9fa1-c33a45ba87fd => Stopped> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:46:28 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] VM Stopped (Lifecycle Event)
Apr 11 15:46:28 user nova-compute[71229]: DEBUG nova.compute.manager [None req-dca8767a-8270-4877-8bab-4354d5d6b342 None None] [instance: 8e816ce5-4da8-4366-9fa1-c33a45ba87fd] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:46:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:46:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:46:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:46:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:46:42 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:46:43 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:46:48 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:46:52 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:46:53 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:46:53 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Cleaning up deleted instances {{(pid=71229) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 15:46:53 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] There are 0 instances to clean {{(pid=71229) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 15:46:53 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:46:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "f4f0b39a-e99b-4bc7-aecc-24d4f754e674" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:46:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "f4f0b39a-e99b-4bc7-aecc-24d4f754e674" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:46:55 user nova-compute[71229]: DEBUG nova.compute.manager [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Starting instance... {{(pid=71229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 15:46:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:46:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:46:55 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 15:46:55 user nova-compute[71229]: INFO nova.compute.claims [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Claim successful on node user
Apr 11 15:46:56 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:46:56 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:46:56 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.325s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:46:56 user nova-compute[71229]: DEBUG nova.compute.manager [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Start building networks asynchronously for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 15:46:56 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 15:46:56 user nova-compute[71229]: DEBUG nova.compute.manager [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Allocating IP information in the background. {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 15:46:56 user nova-compute[71229]: DEBUG nova.network.neutron [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] allocate_for_instance() {{(pid=71229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 15:46:56 user nova-compute[71229]: DEBUG nova.compute.manager [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Start building block device mappings for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 15:46:56 user nova-compute[71229]: INFO nova.virt.block_device [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Booting with volume snapshot 6df8d911-049c-42c0-8e12-edbc89102025 at /dev/vda
Apr 11 15:46:56 user nova-compute[71229]: DEBUG nova.policy [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c2110b74f38642afa560e1c9790d3f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312851c65ba1434691eca0cd2a8cd6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71229) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 15:46:56 user nova-compute[71229]: DEBUG nova.network.neutron [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Successfully created port: 53647a47-cc0c-42e6-a4c0-c12a1dab3deb {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 15:46:57 user nova-compute[71229]: DEBUG nova.network.neutron [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Successfully updated port: 53647a47-cc0c-42e6-a4c0-c12a1dab3deb {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:46:57 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "refresh_cache-f4f0b39a-e99b-4bc7-aecc-24d4f754e674" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:46:57 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquired lock "refresh_cache-f4f0b39a-e99b-4bc7-aecc-24d4f754e674" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:46:57 user nova-compute[71229]: DEBUG nova.network.neutron [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:46:57 user nova-compute[71229]: DEBUG nova.compute.manager [req-9a231c9e-07eb-443d-b50a-2a33feffdd2a req-90b2506f-13b6-478e-94b1-5ef7d3801523 service nova] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Received event network-changed-53647a47-cc0c-42e6-a4c0-c12a1dab3deb {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:46:57 user nova-compute[71229]: DEBUG nova.compute.manager [req-9a231c9e-07eb-443d-b50a-2a33feffdd2a req-90b2506f-13b6-478e-94b1-5ef7d3801523 service nova] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Refreshing instance network info cache due to event network-changed-53647a47-cc0c-42e6-a4c0-c12a1dab3deb. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:46:57 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-9a231c9e-07eb-443d-b50a-2a33feffdd2a req-90b2506f-13b6-478e-94b1-5ef7d3801523 service nova] Acquiring lock "refresh_cache-f4f0b39a-e99b-4bc7-aecc-24d4f754e674" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:46:57 user nova-compute[71229]: DEBUG nova.network.neutron [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:46:57 user nova-compute[71229]: DEBUG nova.network.neutron [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Updating instance_info_cache with network_info: [{"id": "53647a47-cc0c-42e6-a4c0-c12a1dab3deb", "address": "fa:16:3e:06:9b:69", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53647a47-cc", "ovs_interfaceid": "53647a47-cc0c-42e6-a4c0-c12a1dab3deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:46:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Releasing lock "refresh_cache-f4f0b39a-e99b-4bc7-aecc-24d4f754e674" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:46:58 user nova-compute[71229]: DEBUG nova.compute.manager [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Instance network_info: |[{"id": "53647a47-cc0c-42e6-a4c0-c12a1dab3deb", "address": "fa:16:3e:06:9b:69", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53647a47-cc", "ovs_interfaceid": "53647a47-cc0c-42e6-a4c0-c12a1dab3deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 15:46:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-9a231c9e-07eb-443d-b50a-2a33feffdd2a req-90b2506f-13b6-478e-94b1-5ef7d3801523 service nova] Acquired lock "refresh_cache-f4f0b39a-e99b-4bc7-aecc-24d4f754e674" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:46:58 user nova-compute[71229]: DEBUG nova.network.neutron [req-9a231c9e-07eb-443d-b50a-2a33feffdd2a req-90b2506f-13b6-478e-94b1-5ef7d3801523 service nova] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Refreshing network info cache for port 53647a47-cc0c-42e6-a4c0-c12a1dab3deb {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:46:58 user nova-compute[71229]: DEBUG nova.network.neutron [req-9a231c9e-07eb-443d-b50a-2a33feffdd2a req-90b2506f-13b6-478e-94b1-5ef7d3801523 service nova] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Updated VIF entry in instance network info cache for port 53647a47-cc0c-42e6-a4c0-c12a1dab3deb. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:46:58 user nova-compute[71229]: DEBUG nova.network.neutron [req-9a231c9e-07eb-443d-b50a-2a33feffdd2a req-90b2506f-13b6-478e-94b1-5ef7d3801523 service nova] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Updating instance_info_cache with network_info: [{"id": "53647a47-cc0c-42e6-a4c0-c12a1dab3deb", "address": "fa:16:3e:06:9b:69", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53647a47-cc", "ovs_interfaceid": "53647a47-cc0c-42e6-a4c0-c12a1dab3deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:46:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-9a231c9e-07eb-443d-b50a-2a33feffdd2a req-90b2506f-13b6-478e-94b1-5ef7d3801523 service nova] Releasing lock "refresh_cache-f4f0b39a-e99b-4bc7-aecc-24d4f754e674" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:46:58 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:47:01 user nova-compute[71229]: DEBUG os_brick.utils [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:47:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:47:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:47:01 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dab4ff0-bfd7-49c1-8675-780b452629ab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d55e24a97c90\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:47:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:47:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:47:01 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[73413ba9-7796-4de8-aba7-82648abf983e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:47:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:47:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:47:01 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[14764fe0-5631-4717-8276-f96393bfa148]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:47:01 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c88560-4be5-45c6-a915-2ef8b6873a97]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:47:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Running cmd (subprocess): nvme version {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:47:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 'nvme version' failed. Not Retrying. {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:47:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] nvme not present on system {{(pid=71229) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 15:47:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:47:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:47:01 user nova-compute[71229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 15:47:01 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3fbc54-8c07-4977-a81c-84c351b7c871]: (4, '') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:47:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71229) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 15:47:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 15:47:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] LIGHTOS: no hostnqn found. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 15:47:02 user nova-compute[71229]: DEBUG os_brick.utils [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d55e24a97c90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:47:02 user nova-compute[71229]: DEBUG nova.virt.block_device [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Updating existing volume attachment record: 6cb23ca5-4a37-4924-b065-9fa0cd728e13 {{(pid=71229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 15:47:03 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:47:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG nova.compute.manager [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Start spawning the instance on the hypervisor. {{(pid=71229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Creating instance directory {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 15:47:06 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Creating image(s)
Apr 11 15:47:06 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Did not create local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Ensure instance console log exists: /opt/stack/data/nova/instances/f4f0b39a-e99b-4bc7-aecc-24d4f754e674/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Start _get_guest_xml network_info=[{"id": "53647a47-cc0c-42e6-a4c0-c12a1dab3deb", "address": "fa:16:3e:06:9b:69", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53647a47-cc", "ovs_interfaceid": "53647a47-cc0c-42e6-a4c0-c12a1dab3deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-11T15:46:53Z,direct_url=<?>,disk_format='qcow2',id=41f1d5e5-9dc1-414f-8cfe-8273284c0122,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-501785179',owner='312851c65ba1434691eca0cd2a8cd6d2',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-11T15:46:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7316ad70-0d38-45b7-b237-07ed6b1adce0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KvNsqYlc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f4f0b39a-e99b-4bc7-aecc-24d4f754e674', 'attached_at': '', 'detached_at': '', 'volume_id': '7316ad70-0d38-45b7-b237-07ed6b1adce0', 'serial': '7316ad70-0d38-45b7-b237-07ed6b1adce0'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '6cb23ca5-4a37-4924-b065-9fa0cd728e13', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:47:06 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:47:06 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:47:06 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-11T15:46:53Z,direct_url=<?>,disk_format='qcow2',id=41f1d5e5-9dc1-414f-8cfe-8273284c0122,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-501785179',owner='312851c65ba1434691eca0cd2a8cd6d2',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-11T15:46:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7316ad70-0d38-45b7-b237-07ed6b1adce0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KvNsqYlc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:47:06 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:47:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:47:06 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:47:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7316ad70-0d38-45b7-b237-07ed6b1adce0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7316ad70-0d38-45b7-b237-07ed6b1adce0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:47:06 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 15:47:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7316ad70-0d38-45b7-b237-07ed6b1adce0 -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7316ad70-0d38-45b7-b237-07ed6b1adce0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b83835-66ed-48a5-96d8-3064821290c1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 15:47:06 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7316ad70-0d38-45b7-b237-07ed6b1adce0 -p 172.16.0.220:3260 --interface default --op new {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7316ad70-0d38-45b7-b237-07ed6b1adce0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82e85c4-913e-4fec-b189-44b854357ef1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7316ad70-0d38-45b7-b237-07ed6b1adce0] added\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7316ad70-0d38-45b7-b237-07ed6b1adce0] added
Apr 11 15:47:06 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7316ad70-0d38-45b7-b237-07ed6b1adce0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7316ad70-0d38-45b7-b237-07ed6b1adce0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2dfc71-dd60-4a0f-b559-df59d407bcf0]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7316ad70-0d38-45b7-b237-07ed6b1adce0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7316ad70-0d38-45b7-b237-07ed6b1adce0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[897411da-3c59-46b0-8320-408c8efc9845]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7316ad70-0d38-45b7-b237-07ed6b1adce0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KvNsqYlc {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7316ad70-0d38-45b7-b237-07ed6b1adce0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KvNsqYlc" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe55641d-572a-4d27-b91c-c90c069ce9e9]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KvNsqYlc'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7316ad70-0d38-45b7-b237-07ed6b1adce0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7316ad70-0d38-45b7-b237-07ed6b1adce0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[12996f02-cd55-401f-b995-3ff2a4a5aa81]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fe1915-70f4-4e4f-83f5-56a66c3c0fd0]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392 (non-flash)
Apr 11 15:47:06 user nova-compute[71229]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 (non-flash)
Apr 11 15:47:06 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392 (non-flash)
Apr 11 15:47:06 user nova-compute[71229]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 (non-flash)
Apr 11 15:47:06 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7316ad70-0d38-45b7-b237-07ed6b1adce0 -p 172.16.0.220:3260 --login {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7316ad70-0d38-45b7-b237-07ed6b1adce0 -p 172.16.0.220:3260 --login" returned: 0 in 0.112s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a540c8-f2ef-46c1-a523-83d31f36653c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7316ad70-0d38-45b7-b237-07ed6b1adce0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7316ad70-0d38-45b7-b237-07ed6b1adce0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7316ad70-0d38-45b7-b237-07ed6b1adce0, portal: 172.16.0.220,3260]
Apr 11 15:47:06 user nova-compute[71229]: Login to [iface: default, target: iqn.2010-10.org.openstack:7316ad70-0d38-45b7-b237-07ed6b1adce0, portal: 172.16.0.220,3260] successful.
Apr 11 15:47:06 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7316ad70-0d38-45b7-b237-07ed6b1adce0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7316ad70-0d38-45b7-b237-07ed6b1adce0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f9836d-6164-4ea5-826f-f9052d5ea0a0]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d99a7e-c74c-4b7b-8465-eeec24ca9042]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316ad70-0d38-45b7-b237-07ed6b1adce0 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392 (non-flash)
Apr 11 15:47:06 user nova-compute[71229]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 (non-flash)
Apr 11 15:47:06 user nova-compute[71229]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316ad70-0d38-45b7-b237-07ed6b1adce0 (non-flash)
Apr 11 15:47:06 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392 (non-flash)
Apr 11 15:47:06 user nova-compute[71229]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 (non-flash)
Apr 11 15:47:06 user nova-compute[71229]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316ad70-0d38-45b7-b237-07ed6b1adce0 (non-flash)
Apr 11 15:47:06 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7316ad70-0d38-45b7-b237-07ed6b1adce0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] HCTL ('35', '-', '-', 0) found on session 41 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a9c93f-406f-4732-af26-3cb5f2819437]: (4, ('- - 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:47:06 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7316ad70-0d38-45b7-b237-07ed6b1adce0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KvNsqYlc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 15:47:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:47:07 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:47:07 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '23633326137636265', 'path': '/dev/sdd'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:47:07 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633326137636265', 'path': '/dev/sdd'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 15:47:07 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:46:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1777431458',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1777431458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1777431458',id=36,image_ref='41f1d5e5-9dc1-414f-8cfe-8273284c0122',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='312851c65ba1434691eca0cd2a8cd6d2',ramdisk_id='',reservation_id='r-cr2hhhvl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1933582504',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1933582504-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1933582504',owner_user_name='tempest-TestVolumeBootPattern-1933582504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:46:56Z,user_data=None,user_id='c2110b74f38642afa560e1c9790d3f81',uuid=f4f0b39a-e99b-4bc7-aecc-24d4f754e674,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53647a47-cc0c-42e6-a4c0-c12a1dab3deb", "address": "fa:16:3e:06:9b:69", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53647a47-cc", "ovs_interfaceid": "53647a47-cc0c-42e6-a4c0-c12a1dab3deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:47:07 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Converting VIF {"id": "53647a47-cc0c-42e6-a4c0-c12a1dab3deb", "address": "fa:16:3e:06:9b:69", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53647a47-cc", "ovs_interfaceid": "53647a47-cc0c-42e6-a4c0-c12a1dab3deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:47:07 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:9b:69,bridge_name='br-int',has_traffic_filtering=True,id=53647a47-cc0c-42e6-a4c0-c12a1dab3deb,network=Network(8d262ba8-b9c3-44ed-8431-6c295eb9ea24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53647a47-cc') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:47:07 user nova-compute[71229]: DEBUG nova.objects.instance [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lazy-loading 'pci_devices' on Instance uuid f4f0b39a-e99b-4bc7-aecc-24d4f754e674 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:47:07 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:47:07 user nova-compute[71229]:   <uuid>f4f0b39a-e99b-4bc7-aecc-24d4f754e674</uuid>
Apr 11 15:47:07 user nova-compute[71229]:   <name>instance-00000024</name>
Apr 11 15:47:07 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:47:07 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:47:07 user nova-compute[71229]:   <metadata>
Apr 11 15:47:07 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:47:07 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:47:07 user nova-compute[71229]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1777431458</nova:name>
Apr 11 15:47:07 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:47:06</nova:creationTime>
Apr 11 15:47:07 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:47:07 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:47:07 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:47:07 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:47:07 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:47:07 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:47:07 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:47:07 user nova-compute[71229]:       <nova:owner>
Apr 11 15:47:07 user nova-compute[71229]:         <nova:user uuid="c2110b74f38642afa560e1c9790d3f81">tempest-TestVolumeBootPattern-1933582504-project-member</nova:user>
Apr 11 15:47:07 user nova-compute[71229]:         <nova:project uuid="312851c65ba1434691eca0cd2a8cd6d2">tempest-TestVolumeBootPattern-1933582504</nova:project>
Apr 11 15:47:07 user nova-compute[71229]:       </nova:owner>
Apr 11 15:47:07 user nova-compute[71229]:       <nova:root type="image" uuid="41f1d5e5-9dc1-414f-8cfe-8273284c0122"/>
Apr 11 15:47:07 user nova-compute[71229]:       <nova:ports>
Apr 11 15:47:07 user nova-compute[71229]:         <nova:port uuid="53647a47-cc0c-42e6-a4c0-c12a1dab3deb">
Apr 11 15:47:07 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 11 15:47:07 user nova-compute[71229]:         </nova:port>
Apr 11 15:47:07 user nova-compute[71229]:       </nova:ports>
Apr 11 15:47:07 user nova-compute[71229]:     </nova:instance>
Apr 11 15:47:07 user nova-compute[71229]:   </metadata>
Apr 11 15:47:07 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:47:07 user nova-compute[71229]:     <system>
Apr 11 15:47:07 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:47:07 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:47:07 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:47:07 user nova-compute[71229]:       <entry name="serial">f4f0b39a-e99b-4bc7-aecc-24d4f754e674</entry>
Apr 11 15:47:07 user nova-compute[71229]:       <entry name="uuid">f4f0b39a-e99b-4bc7-aecc-24d4f754e674</entry>
Apr 11 15:47:07 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:47:07 user nova-compute[71229]:     </system>
Apr 11 15:47:07 user nova-compute[71229]:   </sysinfo>
Apr 11 15:47:07 user nova-compute[71229]:   <os>
Apr 11 15:47:07 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:47:07 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 15:47:07 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:47:07 user nova-compute[71229]:   </os>
Apr 11 15:47:07 user nova-compute[71229]:   <features>
Apr 11 15:47:07 user nova-compute[71229]:     <acpi/>
Apr 11 15:47:07 user nova-compute[71229]:     <apic/>
Apr 11 15:47:07 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:47:07 user nova-compute[71229]:   </features>
Apr 11 15:47:07 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:47:07 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:47:07 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:47:07 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:47:07 user nova-compute[71229]:   </clock>
Apr 11 15:47:07 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:47:07 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:47:07 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:47:07 user nova-compute[71229]:   </cpu>
Apr 11 15:47:07 user nova-compute[71229]:   <devices>
Apr 11 15:47:07 user nova-compute[71229]:     <disk type="block" device="disk">
Apr 11 15:47:07 user nova-compute[71229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:47:07 user nova-compute[71229]:       <source dev="/dev/sdd"/>
Apr 11 15:47:07 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:47:07 user nova-compute[71229]:       <serial>7316ad70-0d38-45b7-b237-07ed6b1adce0</serial>
Apr 11 15:47:07 user nova-compute[71229]:     </disk>
Apr 11 15:47:07 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:47:07 user nova-compute[71229]:       <mac address="fa:16:3e:06:9b:69"/>
Apr 11 15:47:07 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:47:07 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:47:07 user nova-compute[71229]:       <target dev="tap53647a47-cc"/>
Apr 11 15:47:07 user nova-compute[71229]:     </interface>
Apr 11 15:47:07 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:47:07 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/f4f0b39a-e99b-4bc7-aecc-24d4f754e674/console.log" append="off"/>
Apr 11 15:47:07 user nova-compute[71229]:     </serial>
Apr 11 15:47:07 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:47:07 user nova-compute[71229]:     <video>
Apr 11 15:47:07 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:47:07 user nova-compute[71229]:     </video>
Apr 11 15:47:07 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:47:07 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:47:07 user nova-compute[71229]:     </rng>
Apr 11 15:47:07 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:47:07 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:47:07 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:47:07 user nova-compute[71229]:     </memballoon>
Apr 11 15:47:07 user nova-compute[71229]:   </devices>
Apr 11 15:47:07 user nova-compute[71229]: </domain>
Apr 11 15:47:07 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:47:07 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:46:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1777431458',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1777431458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1777431458',id=36,image_ref='41f1d5e5-9dc1-414f-8cfe-8273284c0122',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='312851c65ba1434691eca0cd2a8cd6d2',ramdisk_id='',reservation_id='r-cr2hhhvl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1933582504',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1933582504-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1933582504',owner_user_name='tempest-TestVolumeBootPattern-1933582504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:46:56Z,user_data=None,user_id='c2110b74f38642afa560e1c9790d3f81',uuid=f4f0b39a-e99b-4bc7-aecc-24d4f754e674,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53647a47-cc0c-42e6-a4c0-c12a1dab3deb", "address": "fa:16:3e:06:9b:69", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53647a47-cc", "ovs_interfaceid": "53647a47-cc0c-42e6-a4c0-c12a1dab3deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:47:07 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Converting VIF {"id": "53647a47-cc0c-42e6-a4c0-c12a1dab3deb", "address": "fa:16:3e:06:9b:69", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53647a47-cc", "ovs_interfaceid": "53647a47-cc0c-42e6-a4c0-c12a1dab3deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:47:07 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:9b:69,bridge_name='br-int',has_traffic_filtering=True,id=53647a47-cc0c-42e6-a4c0-c12a1dab3deb,network=Network(8d262ba8-b9c3-44ed-8431-6c295eb9ea24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53647a47-cc') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:47:07 user nova-compute[71229]: DEBUG os_vif [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:9b:69,bridge_name='br-int',has_traffic_filtering=True,id=53647a47-cc0c-42e6-a4c0-c12a1dab3deb,network=Network(8d262ba8-b9c3-44ed-8431-6c295eb9ea24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53647a47-cc') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:47:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:47:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:47:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:47:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:47:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap53647a47-cc, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:47:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap53647a47-cc, col_values=(('external_ids', {'iface-id': '53647a47-cc0c-42e6-a4c0-c12a1dab3deb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:9b:69', 'vm-uuid': 'f4f0b39a-e99b-4bc7-aecc-24d4f754e674'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:47:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:47:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:47:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:47:07 user nova-compute[71229]: INFO os_vif [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:9b:69,bridge_name='br-int',has_traffic_filtering=True,id=53647a47-cc0c-42e6-a4c0-c12a1dab3deb,network=Network(8d262ba8-b9c3-44ed-8431-6c295eb9ea24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53647a47-cc')
Apr 11 15:47:07 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:47:07 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] No VIF found with MAC fa:16:3e:06:9b:69, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:47:08 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:47:08 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:47:08 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:47:08 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:47:09 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:47:09 user nova-compute[71229]: DEBUG nova.compute.manager [req-2d0654cf-d228-44da-a039-a5d8ee794063 req-2df48766-0d38-47ea-96d1-e450a1f603bc service nova] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Received event network-vif-plugged-53647a47-cc0c-42e6-a4c0-c12a1dab3deb {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:47:09 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2d0654cf-d228-44da-a039-a5d8ee794063 req-2df48766-0d38-47ea-96d1-e450a1f603bc service nova] Acquiring lock "f4f0b39a-e99b-4bc7-aecc-24d4f754e674-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:47:09 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2d0654cf-d228-44da-a039-a5d8ee794063 req-2df48766-0d38-47ea-96d1-e450a1f603bc service nova] Lock "f4f0b39a-e99b-4bc7-aecc-24d4f754e674-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:47:09 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2d0654cf-d228-44da-a039-a5d8ee794063 req-2df48766-0d38-47ea-96d1-e450a1f603bc service nova] Lock "f4f0b39a-e99b-4bc7-aecc-24d4f754e674-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:47:09 user nova-compute[71229]: DEBUG nova.compute.manager [req-2d0654cf-d228-44da-a039-a5d8ee794063 req-2df48766-0d38-47ea-96d1-e450a1f603bc service nova] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] No waiting events found dispatching network-vif-plugged-53647a47-cc0c-42e6-a4c0-c12a1dab3deb {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:47:09 user nova-compute[71229]: WARNING nova.compute.manager [req-2d0654cf-d228-44da-a039-a5d8ee794063 req-2df48766-0d38-47ea-96d1-e450a1f603bc service nova] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Received unexpected event network-vif-plugged-53647a47-cc0c-42e6-a4c0-c12a1dab3deb for instance with vm_state building and task_state spawning.
Apr 11 15:47:09 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:47:09 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 15:47:11 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681228031.0704725, f4f0b39a-e99b-4bc7-aecc-24d4f754e674 => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:47:11 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] VM Resumed (Lifecycle Event)
Apr 11 15:47:11 user nova-compute[71229]: DEBUG nova.compute.manager [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 15:47:11 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Guest created on hypervisor {{(pid=71229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 15:47:11 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Instance spawned successfully.
Apr 11 15:47:11 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 15:47:11 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:47:11 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Found default for hw_input_bus of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:47:11 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Found default for hw_pointer_model of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:47:11 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:47:11 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:47:11 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681228031.0735672, f4f0b39a-e99b-4bc7-aecc-24d4f754e674 => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:47:11 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] VM Started (Lifecycle Event)
Apr 11 15:47:11 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:47:11 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:47:11 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:47:11 user nova-compute[71229]: INFO nova.compute.manager [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Took 5.07 seconds to spawn the instance on the hypervisor.
Apr 11 15:47:11 user nova-compute[71229]: DEBUG nova.compute.manager [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:47:11 user nova-compute[71229]: DEBUG nova.compute.manager [req-b242a85c-a93f-497f-91de-a8aee224ba6e req-73ec61e0-902a-45e1-a6e6-60fe33327ed5 service nova] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Received event network-vif-plugged-53647a47-cc0c-42e6-a4c0-c12a1dab3deb {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:47:11 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-b242a85c-a93f-497f-91de-a8aee224ba6e req-73ec61e0-902a-45e1-a6e6-60fe33327ed5 service nova] Acquiring lock "f4f0b39a-e99b-4bc7-aecc-24d4f754e674-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:47:11 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-b242a85c-a93f-497f-91de-a8aee224ba6e req-73ec61e0-902a-45e1-a6e6-60fe33327ed5 service nova] Lock "f4f0b39a-e99b-4bc7-aecc-24d4f754e674-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:47:11 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-b242a85c-a93f-497f-91de-a8aee224ba6e req-73ec61e0-902a-45e1-a6e6-60fe33327ed5 service nova] Lock "f4f0b39a-e99b-4bc7-aecc-24d4f754e674-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:47:11 user nova-compute[71229]: DEBUG nova.compute.manager [req-b242a85c-a93f-497f-91de-a8aee224ba6e req-73ec61e0-902a-45e1-a6e6-60fe33327ed5 service nova] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] No waiting events found dispatching network-vif-plugged-53647a47-cc0c-42e6-a4c0-c12a1dab3deb {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:47:11 user nova-compute[71229]: WARNING nova.compute.manager [req-b242a85c-a93f-497f-91de-a8aee224ba6e req-73ec61e0-902a-45e1-a6e6-60fe33327ed5 service nova] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Received unexpected event network-vif-plugged-53647a47-cc0c-42e6-a4c0-c12a1dab3deb for instance with vm_state building and task_state spawning.
Apr 11 15:47:11 user nova-compute[71229]: INFO nova.compute.manager [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Took 15.60 seconds to build instance.
Apr 11 15:47:11 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-8b945091-21be-4b9e-9d20-75cf291b7bfd tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "f4f0b39a-e99b-4bc7-aecc-24d4f754e674" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.699s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:47:11 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:47:11 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:47:11 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:47:11 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:47:11 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 15:47:11 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:47:11 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:47:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json" returned: 0 in 0.164s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:47:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:47:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:47:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:47:12 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:47:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:47:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:47:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:47:12 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:47:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/disk.rescue --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:47:12 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:47:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/disk.rescue --force-share --output=json" returned: 0 in 0.155s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:47:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/disk.rescue --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:47:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:47:12 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /opt/stack/data/nova/instances/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/disk (vdb) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:47:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:47:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:47:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:47:13 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:47:13 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:47:13 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:47:13 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:47:13 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:47:13 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:47:13 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:47:13 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8337MB free_disk=25.980682373046875GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 15:47:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:47:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:47:13 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 6f6ae64a-c760-4ba3-8a50-d380835d9913 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:47:13 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 058df5ba-07ab-4bdd-9a47-907e7b0e0e59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:47:13 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:47:13 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:47:13 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance f0fc18ff-897c-4f97-95b6-9f25d11dba88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:47:14 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance f4f0b39a-e99b-4bc7-aecc-24d4f754e674 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:47:14 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 15:47:14 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=1280MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 15:47:14 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:47:14 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:47:14 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 15:47:14 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.325s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:47:14 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:47:14 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 15:47:14 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Didn't find any instances for network info cache update. {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 15:47:14 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:47:14 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:47:15 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:47:16 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:47:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:47:17 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:47:17 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:47:18 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:47:19 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:47:19 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71229) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 15:47:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:47:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:47:27 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:47:27 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:47:30 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:47:31 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:47:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:47:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:47:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:47:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:47:41 user nova-compute[71229]: DEBUG nova.compute.manager [req-f23047c6-923e-452d-ab87-b969c7f32ae8 req-231b019f-eb26-40d5-ae1b-dad7aa09f512 service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Received event network-changed-cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:47:41 user nova-compute[71229]: DEBUG nova.compute.manager [req-f23047c6-923e-452d-ab87-b969c7f32ae8 req-231b019f-eb26-40d5-ae1b-dad7aa09f512 service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Refreshing instance network info cache due to event network-changed-cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:47:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-f23047c6-923e-452d-ab87-b969c7f32ae8 req-231b019f-eb26-40d5-ae1b-dad7aa09f512 service nova] Acquiring lock "refresh_cache-f0fc18ff-897c-4f97-95b6-9f25d11dba88" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:47:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-f23047c6-923e-452d-ab87-b969c7f32ae8 req-231b019f-eb26-40d5-ae1b-dad7aa09f512 service nova] Acquired lock "refresh_cache-f0fc18ff-897c-4f97-95b6-9f25d11dba88" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:47:41 user nova-compute[71229]: DEBUG nova.network.neutron [req-f23047c6-923e-452d-ab87-b969c7f32ae8 req-231b019f-eb26-40d5-ae1b-dad7aa09f512 service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Refreshing network info cache for port cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:47:41 user nova-compute[71229]: DEBUG nova.network.neutron [req-f23047c6-923e-452d-ab87-b969c7f32ae8 req-231b019f-eb26-40d5-ae1b-dad7aa09f512 service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Updated VIF entry in instance network info cache for port cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:47:41 user nova-compute[71229]: DEBUG nova.network.neutron [req-f23047c6-923e-452d-ab87-b969c7f32ae8 req-231b019f-eb26-40d5-ae1b-dad7aa09f512 service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Updating instance_info_cache with network_info: [{"id": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01", "address": "fa:16:3e:39:51:c6", "network": {"id": "81031696-fd25-42a1-8c36-43a6eacbab12", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1627850915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c9dbdbc7b641f096dc292ea7bf7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf0cc1bf-40", "ovs_interfaceid": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:47:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-f23047c6-923e-452d-ab87-b969c7f32ae8 req-231b019f-eb26-40d5-ae1b-dad7aa09f512 service nova] Releasing lock "refresh_cache-f0fc18ff-897c-4f97-95b6-9f25d11dba88" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:47:41 user nova-compute[71229]: DEBUG nova.compute.manager [None req-1abd0a2c-d306-4750-8f10-bffe85ae3ce2 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:47:41 user nova-compute[71229]: INFO nova.compute.manager [None req-1abd0a2c-d306-4750-8f10-bffe85ae3ce2 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] instance snapshotting
Apr 11 15:47:42 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-1abd0a2c-d306-4750-8f10-bffe85ae3ce2 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Beginning live snapshot process
Apr 11 15:47:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-1abd0a2c-d306-4750-8f10-bffe85ae3ce2 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk --force-share --output=json -f qcow2 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:47:42 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:47:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-1abd0a2c-d306-4750-8f10-bffe85ae3ce2 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk --force-share --output=json -f qcow2" returned: 0 in 0.152s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:47:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-1abd0a2c-d306-4750-8f10-bffe85ae3ce2 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk --force-share --output=json -f qcow2 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:47:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-1abd0a2c-d306-4750-8f10-bffe85ae3ce2 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk --force-share --output=json -f qcow2" returned: 0 in 0.136s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:47:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-1abd0a2c-d306-4750-8f10-bffe85ae3ce2 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:47:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-1abd0a2c-d306-4750-8f10-bffe85ae3ce2 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.136s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:47:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-1abd0a2c-d306-4750-8f10-bffe85ae3ce2 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpjy_t8dup/1c22a1a14d5c4cbe8601c799d3adeddf.delta 1073741824 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:47:42 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:47:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-1abd0a2c-d306-4750-8f10-bffe85ae3ce2 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpjy_t8dup/1c22a1a14d5c4cbe8601c799d3adeddf.delta 1073741824" returned: 0 in 0.050s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:47:42 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-1abd0a2c-d306-4750-8f10-bffe85ae3ce2 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 11 15:47:43 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-1abd0a2c-d306-4750-8f10-bffe85ae3ce2 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71229) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 15:47:43 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-1abd0a2c-d306-4750-8f10-bffe85ae3ce2 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71229) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 15:47:43 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-1abd0a2c-d306-4750-8f10-bffe85ae3ce2 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 11 15:47:43 user nova-compute[71229]: DEBUG nova.privsep.utils [None req-1abd0a2c-d306-4750-8f10-bffe85ae3ce2 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71229) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 15:47:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-1abd0a2c-d306-4750-8f10-bffe85ae3ce2 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpjy_t8dup/1c22a1a14d5c4cbe8601c799d3adeddf.delta /opt/stack/data/nova/instances/snapshots/tmpjy_t8dup/1c22a1a14d5c4cbe8601c799d3adeddf {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:47:44 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-1abd0a2c-d306-4750-8f10-bffe85ae3ce2 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpjy_t8dup/1c22a1a14d5c4cbe8601c799d3adeddf.delta /opt/stack/data/nova/instances/snapshots/tmpjy_t8dup/1c22a1a14d5c4cbe8601c799d3adeddf" returned: 0 in 0.475s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:47:44 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-1abd0a2c-d306-4750-8f10-bffe85ae3ce2 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Snapshot extracted, beginning image upload
Apr 11 15:47:46 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-1abd0a2c-d306-4750-8f10-bffe85ae3ce2 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Snapshot image upload complete
Apr 11 15:47:46 user nova-compute[71229]: INFO nova.compute.manager [None req-1abd0a2c-d306-4750-8f10-bffe85ae3ce2 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Took 4.80 seconds to snapshot the instance on the hypervisor.
Apr 11 15:47:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:47:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:47:52 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:47:52 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:47:57 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:47:57 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:48:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:48:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:48:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 15:48:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 15:48:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 15:48:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:48:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:48:09 user nova-compute[71229]: INFO nova.compute.manager [None req-83baa33a-08fa-4e72-a54f-7bf7cf21ebeb tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Unrescuing
Apr 11 15:48:09 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-83baa33a-08fa-4e72-a54f-7bf7cf21ebeb tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "refresh_cache-c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:48:09 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-83baa33a-08fa-4e72-a54f-7bf7cf21ebeb tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquired lock "refresh_cache-c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:48:09 user nova-compute[71229]: DEBUG nova.network.neutron [None req-83baa33a-08fa-4e72-a54f-7bf7cf21ebeb tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:48:09 user nova-compute[71229]: DEBUG nova.network.neutron [None req-83baa33a-08fa-4e72-a54f-7bf7cf21ebeb tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Updating instance_info_cache with network_info: [{"id": "35ac8f6f-2998-4274-ab63-df7086194703", "address": "fa:16:3e:47:3b:c6", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ac8f6f-29", "ovs_interfaceid": "35ac8f6f-2998-4274-ab63-df7086194703", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:48:09 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-83baa33a-08fa-4e72-a54f-7bf7cf21ebeb tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Releasing lock "refresh_cache-c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:48:09 user nova-compute[71229]: DEBUG nova.objects.instance [None req-83baa33a-08fa-4e72-a54f-7bf7cf21ebeb tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lazy-loading 'flavor' on Instance uuid c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:48:10 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:48:10 user nova-compute[71229]: DEBUG nova.compute.manager [req-a9e765ac-1589-4fd2-957f-ecd2fe68e823 req-50d66337-a338-4a1d-a409-c052cecde4d8 service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Received event network-vif-unplugged-35ac8f6f-2998-4274-ab63-df7086194703 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:48:10 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a9e765ac-1589-4fd2-957f-ecd2fe68e823 req-50d66337-a338-4a1d-a409-c052cecde4d8 service nova] Acquiring lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:48:10 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a9e765ac-1589-4fd2-957f-ecd2fe68e823 req-50d66337-a338-4a1d-a409-c052cecde4d8 service nova] Lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:48:10 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a9e765ac-1589-4fd2-957f-ecd2fe68e823 req-50d66337-a338-4a1d-a409-c052cecde4d8 service nova] Lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:48:10 user nova-compute[71229]: DEBUG nova.compute.manager [req-a9e765ac-1589-4fd2-957f-ecd2fe68e823 req-50d66337-a338-4a1d-a409-c052cecde4d8 service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] No waiting events found dispatching network-vif-unplugged-35ac8f6f-2998-4274-ab63-df7086194703 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:48:10 user nova-compute[71229]: WARNING nova.compute.manager [req-a9e765ac-1589-4fd2-957f-ecd2fe68e823 req-50d66337-a338-4a1d-a409-c052cecde4d8 service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Received unexpected event network-vif-unplugged-35ac8f6f-2998-4274-ab63-df7086194703 for instance with vm_state rescued and task_state unrescuing.
Apr 11 15:48:10 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:48:10 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:48:10 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:48:10 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Instance destroyed successfully.
Apr 11 15:48:10 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:48:10 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 15:48:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:48:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:48:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:48:12 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:48:12 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:48:12 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:48:12 user nova-compute[71229]: DEBUG nova.compute.manager [req-3fb1f628-d8bb-4e9d-8c4e-d9c3ff4958b5 req-a503a3c3-f8d3-4bb3-b263-41bdf0652272 service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Received event network-vif-plugged-35ac8f6f-2998-4274-ab63-df7086194703 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:48:12 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3fb1f628-d8bb-4e9d-8c4e-d9c3ff4958b5 req-a503a3c3-f8d3-4bb3-b263-41bdf0652272 service nova] Acquiring lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:48:12 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3fb1f628-d8bb-4e9d-8c4e-d9c3ff4958b5 req-a503a3c3-f8d3-4bb3-b263-41bdf0652272 service nova] Lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:48:12 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3fb1f628-d8bb-4e9d-8c4e-d9c3ff4958b5 req-a503a3c3-f8d3-4bb3-b263-41bdf0652272 service nova] Lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:48:12 user nova-compute[71229]: DEBUG nova.compute.manager [req-3fb1f628-d8bb-4e9d-8c4e-d9c3ff4958b5 req-a503a3c3-f8d3-4bb3-b263-41bdf0652272 service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] No waiting events found dispatching network-vif-plugged-35ac8f6f-2998-4274-ab63-df7086194703 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:48:12 user nova-compute[71229]: WARNING nova.compute.manager [req-3fb1f628-d8bb-4e9d-8c4e-d9c3ff4958b5 req-a503a3c3-f8d3-4bb3-b263-41bdf0652272 service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Received unexpected event network-vif-plugged-35ac8f6f-2998-4274-ab63-df7086194703 for instance with vm_state rescued and task_state unrescuing.
Apr 11 15:48:12 user nova-compute[71229]: DEBUG nova.compute.manager [req-3fb1f628-d8bb-4e9d-8c4e-d9c3ff4958b5 req-a503a3c3-f8d3-4bb3-b263-41bdf0652272 service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Received event network-vif-plugged-35ac8f6f-2998-4274-ab63-df7086194703 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:48:12 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3fb1f628-d8bb-4e9d-8c4e-d9c3ff4958b5 req-a503a3c3-f8d3-4bb3-b263-41bdf0652272 service nova] Acquiring lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:48:12 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3fb1f628-d8bb-4e9d-8c4e-d9c3ff4958b5 req-a503a3c3-f8d3-4bb3-b263-41bdf0652272 service nova] Lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:48:12 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3fb1f628-d8bb-4e9d-8c4e-d9c3ff4958b5 req-a503a3c3-f8d3-4bb3-b263-41bdf0652272 service nova] Lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:48:12 user nova-compute[71229]: DEBUG nova.compute.manager [req-3fb1f628-d8bb-4e9d-8c4e-d9c3ff4958b5 req-a503a3c3-f8d3-4bb3-b263-41bdf0652272 service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] No waiting events found dispatching network-vif-plugged-35ac8f6f-2998-4274-ab63-df7086194703 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:48:12 user nova-compute[71229]: WARNING nova.compute.manager [req-3fb1f628-d8bb-4e9d-8c4e-d9c3ff4958b5 req-a503a3c3-f8d3-4bb3-b263-41bdf0652272 service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Received unexpected event network-vif-plugged-35ac8f6f-2998-4274-ab63-df7086194703 for instance with vm_state rescued and task_state unrescuing.
Apr 11 15:48:12 user nova-compute[71229]: DEBUG nova.compute.manager [req-3fb1f628-d8bb-4e9d-8c4e-d9c3ff4958b5 req-a503a3c3-f8d3-4bb3-b263-41bdf0652272 service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Received event network-vif-plugged-35ac8f6f-2998-4274-ab63-df7086194703 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:48:12 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3fb1f628-d8bb-4e9d-8c4e-d9c3ff4958b5 req-a503a3c3-f8d3-4bb3-b263-41bdf0652272 service nova] Acquiring lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:48:12 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3fb1f628-d8bb-4e9d-8c4e-d9c3ff4958b5 req-a503a3c3-f8d3-4bb3-b263-41bdf0652272 service nova] Lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:48:12 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3fb1f628-d8bb-4e9d-8c4e-d9c3ff4958b5 req-a503a3c3-f8d3-4bb3-b263-41bdf0652272 service nova] Lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:48:12 user nova-compute[71229]: DEBUG nova.compute.manager [req-3fb1f628-d8bb-4e9d-8c4e-d9c3ff4958b5 req-a503a3c3-f8d3-4bb3-b263-41bdf0652272 service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] No waiting events found dispatching network-vif-plugged-35ac8f6f-2998-4274-ab63-df7086194703 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:48:12 user nova-compute[71229]: WARNING nova.compute.manager [req-3fb1f628-d8bb-4e9d-8c4e-d9c3ff4958b5 req-a503a3c3-f8d3-4bb3-b263-41bdf0652272 service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Received unexpected event network-vif-plugged-35ac8f6f-2998-4274-ab63-df7086194703 for instance with vm_state rescued and task_state unrescuing.
Apr 11 15:48:12 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:48:12 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:48:12 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Triggering sync for uuid 6f6ae64a-c760-4ba3-8a50-d380835d9913 {{(pid=71229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 15:48:12 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Triggering sync for uuid 058df5ba-07ab-4bdd-9a47-907e7b0e0e59 {{(pid=71229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 15:48:12 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Triggering sync for uuid c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a {{(pid=71229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 15:48:12 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Triggering sync for uuid 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d {{(pid=71229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 15:48:12 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Triggering sync for uuid f0fc18ff-897c-4f97-95b6-9f25d11dba88 {{(pid=71229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 15:48:12 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Triggering sync for uuid f4f0b39a-e99b-4bc7-aecc-24d4f754e674 {{(pid=71229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 15:48:12 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "6f6ae64a-c760-4ba3-8a50-d380835d9913" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:48:12 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "6f6ae64a-c760-4ba3-8a50-d380835d9913" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:48:12 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "058df5ba-07ab-4bdd-9a47-907e7b0e0e59" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:48:12 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "058df5ba-07ab-4bdd-9a47-907e7b0e0e59" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:48:12 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:48:12 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:48:12 user nova-compute[71229]: INFO nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 11 15:48:12 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:48:12 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:48:12 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:48:12 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:48:12 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:48:12 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "f4f0b39a-e99b-4bc7-aecc-24d4f754e674" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:48:12 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "f4f0b39a-e99b-4bc7-aecc-24d4f754e674" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:48:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:48:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:48:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "058df5ba-07ab-4bdd-9a47-907e7b0e0e59" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:48:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "f4f0b39a-e99b-4bc7-aecc-24d4f754e674" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:48:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "6f6ae64a-c760-4ba3-8a50-d380835d9913" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:48:13 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:48:13 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 15:48:13 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Rebuilding the list of instances to heal {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 15:48:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "refresh_cache-6f6ae64a-c760-4ba3-8a50-d380835d9913" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:48:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquired lock "refresh_cache-6f6ae64a-c760-4ba3-8a50-d380835d9913" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:48:13 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Forcefully refreshing network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 15:48:13 user nova-compute[71229]: DEBUG nova.objects.instance [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lazy-loading 'info_cache' on Instance uuid 6f6ae64a-c760-4ba3-8a50-d380835d9913 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:48:14 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Removed pending event for c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a due to event {{(pid=71229) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 15:48:14 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681228094.0457265, c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:48:14 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] VM Resumed (Lifecycle Event)
Apr 11 15:48:14 user nova-compute[71229]: DEBUG nova.compute.manager [None req-83baa33a-08fa-4e72-a54f-7bf7cf21ebeb tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:48:14 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:48:14 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:48:14 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 11 15:48:14 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681228094.0460987, c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:48:14 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] VM Started (Lifecycle Event)
Apr 11 15:48:14 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:48:14 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:48:14 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Updating instance_info_cache with network_info: [{"id": "2b891eeb-973f-492a-9059-55961bb956bf", "address": "fa:16:3e:97:b1:ae", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b891eeb-97", "ovs_interfaceid": "2b891eeb-973f-492a-9059-55961bb956bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:48:14 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Releasing lock "refresh_cache-6f6ae64a-c760-4ba3-8a50-d380835d9913" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:48:14 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Updated the network info_cache for instance {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 15:48:14 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:48:14 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:48:14 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:48:14 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:48:14 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 15:48:14 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:48:14 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:48:14 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:48:14 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:48:14 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:48:14 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:48:14 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:48:14 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:48:14 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:48:15 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:48:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:48:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:48:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:48:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:48:15 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:48:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:48:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:48:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:48:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:48:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:48:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:48:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:48:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:48:16 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:48:16 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:48:16 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8394MB free_disk=25.953269958496094GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 15:48:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:48:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:48:16 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 6f6ae64a-c760-4ba3-8a50-d380835d9913 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:48:16 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 058df5ba-07ab-4bdd-9a47-907e7b0e0e59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:48:16 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:48:16 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:48:16 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance f0fc18ff-897c-4f97-95b6-9f25d11dba88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:48:16 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance f4f0b39a-e99b-4bc7-aecc-24d4f754e674 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:48:16 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 15:48:16 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=1280MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 15:48:16 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Refreshing inventories for resource provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 15:48:16 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Updating ProviderTree inventory for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 15:48:16 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Updating inventory in ProviderTree for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 15:48:16 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Refreshing aggregate associations for resource provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de, aggregates: None {{(pid=71229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 15:48:16 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Refreshing trait associations for resource provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de, traits: COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=71229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 15:48:16 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:48:16 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:48:16 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 15:48:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.612s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:48:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:48:17 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:48:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:48:17 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:48:17 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:48:18 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:48:19 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:48:20 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:48:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:48:27 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:48:27 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:48:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:48:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:48:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:48:42 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:48:42 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:48:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "f4f0b39a-e99b-4bc7-aecc-24d4f754e674" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:48:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "f4f0b39a-e99b-4bc7-aecc-24d4f754e674" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:48:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "f4f0b39a-e99b-4bc7-aecc-24d4f754e674-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:48:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "f4f0b39a-e99b-4bc7-aecc-24d4f754e674-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:48:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "f4f0b39a-e99b-4bc7-aecc-24d4f754e674-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:48:46 user nova-compute[71229]: INFO nova.compute.manager [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Terminating instance
Apr 11 15:48:46 user nova-compute[71229]: DEBUG nova.compute.manager [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Start destroying the instance on the hypervisor. {{(pid=71229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 15:48:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:48:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:48:46 user nova-compute[71229]: DEBUG nova.compute.manager [req-4674821c-b41b-4f3b-9e27-f393c75bbf28 req-723680c6-c3e7-4e2d-a310-3c67b447c176 service nova] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Received event network-vif-unplugged-53647a47-cc0c-42e6-a4c0-c12a1dab3deb {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:48:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4674821c-b41b-4f3b-9e27-f393c75bbf28 req-723680c6-c3e7-4e2d-a310-3c67b447c176 service nova] Acquiring lock "f4f0b39a-e99b-4bc7-aecc-24d4f754e674-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:48:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4674821c-b41b-4f3b-9e27-f393c75bbf28 req-723680c6-c3e7-4e2d-a310-3c67b447c176 service nova] Lock "f4f0b39a-e99b-4bc7-aecc-24d4f754e674-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:48:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4674821c-b41b-4f3b-9e27-f393c75bbf28 req-723680c6-c3e7-4e2d-a310-3c67b447c176 service nova] Lock "f4f0b39a-e99b-4bc7-aecc-24d4f754e674-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:48:46 user nova-compute[71229]: DEBUG nova.compute.manager [req-4674821c-b41b-4f3b-9e27-f393c75bbf28 req-723680c6-c3e7-4e2d-a310-3c67b447c176 service nova] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] No waiting events found dispatching network-vif-unplugged-53647a47-cc0c-42e6-a4c0-c12a1dab3deb {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:48:46 user nova-compute[71229]: DEBUG nova.compute.manager [req-4674821c-b41b-4f3b-9e27-f393c75bbf28 req-723680c6-c3e7-4e2d-a310-3c67b447c176 service nova] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Received event network-vif-unplugged-53647a47-cc0c-42e6-a4c0-c12a1dab3deb for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 15:48:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:48:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:48:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:48:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:48:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:48:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:48:46 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Instance destroyed successfully.
Apr 11 15:48:46 user nova-compute[71229]: DEBUG nova.objects.instance [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lazy-loading 'resources' on Instance uuid f4f0b39a-e99b-4bc7-aecc-24d4f754e674 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:48:46 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:46:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1777431458',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1777431458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1777431458',id=36,image_ref='41f1d5e5-9dc1-414f-8cfe-8273284c0122',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:47:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='312851c65ba1434691eca0cd2a8cd6d2',ramdisk_id='',reservation_id='r-cr2hhhvl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1933582504',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1933582504-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1933582504',owner_user_name='tempest-TestVolumeBootPattern-1933582504-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:47:11Z,user_data=None,user_id='c2110b74f38642afa560e1c9790d3f81',uuid=f4f0b39a-e99b-4bc7-aecc-24d4f754e674,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53647a47-cc0c-42e6-a4c0-c12a1dab3deb", "address": "fa:16:3e:06:9b:69", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53647a47-cc", "ovs_interfaceid": "53647a47-cc0c-42e6-a4c0-c12a1dab3deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:48:46 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Converting VIF {"id": "53647a47-cc0c-42e6-a4c0-c12a1dab3deb", "address": "fa:16:3e:06:9b:69", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53647a47-cc", "ovs_interfaceid": "53647a47-cc0c-42e6-a4c0-c12a1dab3deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:48:46 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:9b:69,bridge_name='br-int',has_traffic_filtering=True,id=53647a47-cc0c-42e6-a4c0-c12a1dab3deb,network=Network(8d262ba8-b9c3-44ed-8431-6c295eb9ea24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53647a47-cc') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:48:46 user nova-compute[71229]: DEBUG os_vif [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:9b:69,bridge_name='br-int',has_traffic_filtering=True,id=53647a47-cc0c-42e6-a4c0-c12a1dab3deb,network=Network(8d262ba8-b9c3-44ed-8431-6c295eb9ea24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53647a47-cc') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:48:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:48:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53647a47-cc, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:48:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:48:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:48:46 user nova-compute[71229]: INFO os_vif [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:9b:69,bridge_name='br-int',has_traffic_filtering=True,id=53647a47-cc0c-42e6-a4c0-c12a1dab3deb,network=Network(8d262ba8-b9c3-44ed-8431-6c295eb9ea24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53647a47-cc')
Apr 11 15:48:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:7316ad70-0d38-45b7-b237-07ed6b1adce0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KvNsqYlc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:48:47 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:48:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ecc916-a64d-4d0e-8c25-4ec4eec83d25]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7316ad70-0d38-45b7-b237-07ed6b1adce0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 15:48:47 user nova-compute[71229]: No targets found.
Apr 11 15:48:47 user nova-compute[71229]: iSNS:
Apr 11 15:48:47 user nova-compute[71229]: No targets found.
Apr 11 15:48:47 user nova-compute[71229]: STATIC:
Apr 11 15:48:47 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3
Apr 11 15:48:47 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:48:47 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:48:47 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392
Apr 11 15:48:47 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:48:47 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:48:47 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:7316ad70-0d38-45b7-b237-07ed6b1adce0
Apr 11 15:48:47 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:48:47 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:48:47 user nova-compute[71229]: FIRMWARE:
Apr 11 15:48:47 user nova-compute[71229]: No targets found.
Apr 11 15:48:47 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 15:48:47 user nova-compute[71229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 15:48:47 user nova-compute[71229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71229) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7316ad70-0d38-45b7-b237-07ed6b1adce0', 0)] {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6371b75-a493-456b-9a7f-728ea98147fb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7316ad70-0d38-45b7-b237-07ed6b1adce0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb2f6db-94f5-48a7-8aa5-8116d1e413bd]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316ad70-0d38-45b7-b237-07ed6b1adce0 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392 (non-flash)
Apr 11 15:48:47 user nova-compute[71229]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 (non-flash)
Apr 11 15:48:47 user nova-compute[71229]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316ad70-0d38-45b7-b237-07ed6b1adce0 (non-flash)
Apr 11 15:48:47 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392 (non-flash)
Apr 11 15:48:47 user nova-compute[71229]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 (non-flash)
Apr 11 15:48:47 user nova-compute[71229]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7316ad70-0d38-45b7-b237-07ed6b1adce0 (non-flash)
Apr 11 15:48:47 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb67a14b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7316ad70-0d38-45b7-b237-07ed6b1adce0'): ({'sdd'}, set())}) {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Removing single pathed devices sdd {{(pid=71229) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8a7dfa-9d61-489a-9c4e-310879941c80]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[645ce172-8696-4fad-8b14-d79e00aeb106]: (4, ('ok\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Flushing IO for device /dev/sdd {{(pid=71229) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f852524e-8950-47d9-af79-6cca26f3b887]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71229) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b2fa7a-e224-455d-91cd-d15be9941cfb]: (4, ('1', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] SCSI volumes sdd have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23633326137636265', '/dev/disk/by-id/scsi-1SCST_BIO870bcb39-632a7cbed2616c70', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_870bcb39') {{(pid=81310) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[17dd98b0-9af2-43aa-945a-b7851a75f2d5]: (4, None) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7316ad70-0d38-45b7-b237-07ed6b1adce0')] {{(pid=71229) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7316ad70-0d38-45b7-b237-07ed6b1adce0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7316ad70-0d38-45b7-b237-07ed6b1adce0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[02bf435e-cccf-4b1c-a580-c941a96eb87b]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7316ad70-0d38-45b7-b237-07ed6b1adce0 -p 172.16.0.220:3260 --logout {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7316ad70-0d38-45b7-b237-07ed6b1adce0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[064dc8fe-b0cc-4da6-a1c6-4867366f809a]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:7316ad70-0d38-45b7-b237-07ed6b1adce0, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:7316ad70-0d38-45b7-b237-07ed6b1adce0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:7316ad70-0d38-45b7-b237-07ed6b1adce0, portal: 172.16.0.220,3260]
Apr 11 15:48:47 user nova-compute[71229]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:7316ad70-0d38-45b7-b237-07ed6b1adce0, portal: 172.16.0.220,3260] successful.
Apr 11 15:48:47 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7316ad70-0d38-45b7-b237-07ed6b1adce0 -p 172.16.0.220:3260 --op delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7316ad70-0d38-45b7-b237-07ed6b1adce0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[831e035d-051e-47ee-982f-b3881d61d229]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] <== disconnect_volume: return (343ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 15:48:47 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Deleting instance files /opt/stack/data/nova/instances/f4f0b39a-e99b-4bc7-aecc-24d4f754e674_del
Apr 11 15:48:47 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Deletion of /opt/stack/data/nova/instances/f4f0b39a-e99b-4bc7-aecc-24d4f754e674_del complete
Apr 11 15:48:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:48:47 user nova-compute[71229]: INFO nova.compute.manager [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Took 1.22 seconds to destroy the instance on the hypervisor.
Apr 11 15:48:47 user nova-compute[71229]: DEBUG oslo.service.loopingcall [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71229) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG nova.compute.manager [-] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Deallocating network for instance {{(pid=71229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] deallocate_for_instance() {{(pid=71229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:48:47 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:48:47 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Took 0.49 seconds to deallocate network for instance.
Apr 11 15:48:48 user nova-compute[71229]: DEBUG nova.compute.manager [req-103f61a7-cc96-48d2-a96f-d0e1ec750485 req-907cbbe6-c036-4e17-ba89-3f0d4f148152 service nova] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Received event network-vif-deleted-53647a47-cc0c-42e6-a4c0-c12a1dab3deb {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:48:48 user nova-compute[71229]: DEBUG nova.compute.manager [req-9e71424a-0db1-4189-b1a1-f233d3b7362c req-770bf12a-fd7f-48ac-9756-332655209997 service nova] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Received event network-vif-plugged-53647a47-cc0c-42e6-a4c0-c12a1dab3deb {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:48:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-9e71424a-0db1-4189-b1a1-f233d3b7362c req-770bf12a-fd7f-48ac-9756-332655209997 service nova] Acquiring lock "f4f0b39a-e99b-4bc7-aecc-24d4f754e674-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:48:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-9e71424a-0db1-4189-b1a1-f233d3b7362c req-770bf12a-fd7f-48ac-9756-332655209997 service nova] Lock "f4f0b39a-e99b-4bc7-aecc-24d4f754e674-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:48:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-9e71424a-0db1-4189-b1a1-f233d3b7362c req-770bf12a-fd7f-48ac-9756-332655209997 service nova] Lock "f4f0b39a-e99b-4bc7-aecc-24d4f754e674-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:48:48 user nova-compute[71229]: DEBUG nova.compute.manager [req-9e71424a-0db1-4189-b1a1-f233d3b7362c req-770bf12a-fd7f-48ac-9756-332655209997 service nova] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] No waiting events found dispatching network-vif-plugged-53647a47-cc0c-42e6-a4c0-c12a1dab3deb {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:48:48 user nova-compute[71229]: WARNING nova.compute.manager [req-9e71424a-0db1-4189-b1a1-f233d3b7362c req-770bf12a-fd7f-48ac-9756-332655209997 service nova] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Received unexpected event network-vif-plugged-53647a47-cc0c-42e6-a4c0-c12a1dab3deb for instance with vm_state active and task_state deleting.
Apr 11 15:48:48 user nova-compute[71229]: DEBUG nova.compute.manager [req-9e71424a-0db1-4189-b1a1-f233d3b7362c req-770bf12a-fd7f-48ac-9756-332655209997 service nova] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Received event network-vif-plugged-53647a47-cc0c-42e6-a4c0-c12a1dab3deb {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:48:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-9e71424a-0db1-4189-b1a1-f233d3b7362c req-770bf12a-fd7f-48ac-9756-332655209997 service nova] Acquiring lock "f4f0b39a-e99b-4bc7-aecc-24d4f754e674-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:48:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-9e71424a-0db1-4189-b1a1-f233d3b7362c req-770bf12a-fd7f-48ac-9756-332655209997 service nova] Lock "f4f0b39a-e99b-4bc7-aecc-24d4f754e674-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:48:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-9e71424a-0db1-4189-b1a1-f233d3b7362c req-770bf12a-fd7f-48ac-9756-332655209997 service nova] Lock "f4f0b39a-e99b-4bc7-aecc-24d4f754e674-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:48:48 user nova-compute[71229]: DEBUG nova.compute.manager [req-9e71424a-0db1-4189-b1a1-f233d3b7362c req-770bf12a-fd7f-48ac-9756-332655209997 service nova] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] No waiting events found dispatching network-vif-plugged-53647a47-cc0c-42e6-a4c0-c12a1dab3deb {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:48:48 user nova-compute[71229]: WARNING nova.compute.manager [req-9e71424a-0db1-4189-b1a1-f233d3b7362c req-770bf12a-fd7f-48ac-9756-332655209997 service nova] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Received unexpected event network-vif-plugged-53647a47-cc0c-42e6-a4c0-c12a1dab3deb for instance with vm_state active and task_state deleting.
Apr 11 15:48:48 user nova-compute[71229]: DEBUG nova.compute.manager [req-9e71424a-0db1-4189-b1a1-f233d3b7362c req-770bf12a-fd7f-48ac-9756-332655209997 service nova] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Received event network-vif-plugged-53647a47-cc0c-42e6-a4c0-c12a1dab3deb {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:48:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-9e71424a-0db1-4189-b1a1-f233d3b7362c req-770bf12a-fd7f-48ac-9756-332655209997 service nova] Acquiring lock "f4f0b39a-e99b-4bc7-aecc-24d4f754e674-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:48:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-9e71424a-0db1-4189-b1a1-f233d3b7362c req-770bf12a-fd7f-48ac-9756-332655209997 service nova] Lock "f4f0b39a-e99b-4bc7-aecc-24d4f754e674-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:48:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-9e71424a-0db1-4189-b1a1-f233d3b7362c req-770bf12a-fd7f-48ac-9756-332655209997 service nova] Lock "f4f0b39a-e99b-4bc7-aecc-24d4f754e674-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:48:48 user nova-compute[71229]: DEBUG nova.compute.manager [req-9e71424a-0db1-4189-b1a1-f233d3b7362c req-770bf12a-fd7f-48ac-9756-332655209997 service nova] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] No waiting events found dispatching network-vif-plugged-53647a47-cc0c-42e6-a4c0-c12a1dab3deb {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:48:48 user nova-compute[71229]: WARNING nova.compute.manager [req-9e71424a-0db1-4189-b1a1-f233d3b7362c req-770bf12a-fd7f-48ac-9756-332655209997 service nova] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Received unexpected event network-vif-plugged-53647a47-cc0c-42e6-a4c0-c12a1dab3deb for instance with vm_state active and task_state deleting.
Apr 11 15:48:48 user nova-compute[71229]: DEBUG nova.compute.manager [req-9e71424a-0db1-4189-b1a1-f233d3b7362c req-770bf12a-fd7f-48ac-9756-332655209997 service nova] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Received event network-vif-unplugged-53647a47-cc0c-42e6-a4c0-c12a1dab3deb {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:48:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-9e71424a-0db1-4189-b1a1-f233d3b7362c req-770bf12a-fd7f-48ac-9756-332655209997 service nova] Acquiring lock "f4f0b39a-e99b-4bc7-aecc-24d4f754e674-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:48:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-9e71424a-0db1-4189-b1a1-f233d3b7362c req-770bf12a-fd7f-48ac-9756-332655209997 service nova] Lock "f4f0b39a-e99b-4bc7-aecc-24d4f754e674-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:48:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-9e71424a-0db1-4189-b1a1-f233d3b7362c req-770bf12a-fd7f-48ac-9756-332655209997 service nova] Lock "f4f0b39a-e99b-4bc7-aecc-24d4f754e674-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:48:48 user nova-compute[71229]: DEBUG nova.compute.manager [req-9e71424a-0db1-4189-b1a1-f233d3b7362c req-770bf12a-fd7f-48ac-9756-332655209997 service nova] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] No waiting events found dispatching network-vif-unplugged-53647a47-cc0c-42e6-a4c0-c12a1dab3deb {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:48:48 user nova-compute[71229]: DEBUG nova.compute.manager [req-9e71424a-0db1-4189-b1a1-f233d3b7362c req-770bf12a-fd7f-48ac-9756-332655209997 service nova] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Received event network-vif-unplugged-53647a47-cc0c-42e6-a4c0-c12a1dab3deb for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 15:48:48 user nova-compute[71229]: DEBUG nova.compute.manager [req-9e71424a-0db1-4189-b1a1-f233d3b7362c req-770bf12a-fd7f-48ac-9756-332655209997 service nova] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Received event network-vif-plugged-53647a47-cc0c-42e6-a4c0-c12a1dab3deb {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:48:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-9e71424a-0db1-4189-b1a1-f233d3b7362c req-770bf12a-fd7f-48ac-9756-332655209997 service nova] Acquiring lock "f4f0b39a-e99b-4bc7-aecc-24d4f754e674-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:48:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-9e71424a-0db1-4189-b1a1-f233d3b7362c req-770bf12a-fd7f-48ac-9756-332655209997 service nova] Lock "f4f0b39a-e99b-4bc7-aecc-24d4f754e674-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:48:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-9e71424a-0db1-4189-b1a1-f233d3b7362c req-770bf12a-fd7f-48ac-9756-332655209997 service nova] Lock "f4f0b39a-e99b-4bc7-aecc-24d4f754e674-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:48:48 user nova-compute[71229]: DEBUG nova.compute.manager [req-9e71424a-0db1-4189-b1a1-f233d3b7362c req-770bf12a-fd7f-48ac-9756-332655209997 service nova] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] No waiting events found dispatching network-vif-plugged-53647a47-cc0c-42e6-a4c0-c12a1dab3deb {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:48:48 user nova-compute[71229]: WARNING nova.compute.manager [req-9e71424a-0db1-4189-b1a1-f233d3b7362c req-770bf12a-fd7f-48ac-9756-332655209997 service nova] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Received unexpected event network-vif-plugged-53647a47-cc0c-42e6-a4c0-c12a1dab3deb for instance with vm_state active and task_state deleting.
Apr 11 15:48:48 user nova-compute[71229]: INFO nova.compute.manager [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Took 0.83 seconds to detach 1 volumes for instance.
Apr 11 15:48:48 user nova-compute[71229]: DEBUG nova.compute.manager [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Deleting volume: 7316ad70-0d38-45b7-b237-07ed6b1adce0 {{(pid=71229) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 11 15:48:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:48:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:48:49 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:48:49 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:48:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.247s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:48:49 user nova-compute[71229]: INFO nova.scheduler.client.report [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Deleted allocations for instance f4f0b39a-e99b-4bc7-aecc-24d4f754e674
Apr 11 15:48:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-bc148ff3-e15b-4bce-8c2b-4be6ce5ed443 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "f4f0b39a-e99b-4bc7-aecc-24d4f754e674" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.070s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:48:52 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:48:57 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:48:57 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:49:01 user nova-compute[71229]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681228126.9470232, f4f0b39a-e99b-4bc7-aecc-24d4f754e674 => Stopped> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:49:01 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] VM Stopped (Lifecycle Event)
Apr 11 15:49:01 user nova-compute[71229]: DEBUG nova.compute.manager [None req-01fded73-abc9-401f-ae9e-dcce553fa912 None None] [instance: f4f0b39a-e99b-4bc7-aecc-24d4f754e674] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:49:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:49:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:49:12 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:49:12 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:49:12 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 15:49:13 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:49:13 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 15:49:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "refresh_cache-058df5ba-07ab-4bdd-9a47-907e7b0e0e59" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:49:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquired lock "refresh_cache-058df5ba-07ab-4bdd-9a47-907e7b0e0e59" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:49:13 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Forcefully refreshing network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 15:49:14 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Updating instance_info_cache with network_info: [{"id": "cdfec3e6-f5dc-42e6-98a8-651f46bd37f4", "address": "fa:16:3e:47:d3:74", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdfec3e6-f5", "ovs_interfaceid": "cdfec3e6-f5dc-42e6-98a8-651f46bd37f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:49:14 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Releasing lock "refresh_cache-058df5ba-07ab-4bdd-9a47-907e7b0e0e59" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:49:14 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Updated the network info_cache for instance {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 15:49:14 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:49:14 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:49:14 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:49:14 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:49:14 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 15:49:14 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:49:14 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:49:14 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:49:14 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:49:14 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:49:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:49:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:49:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:49:15 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:49:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:49:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:49:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:49:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:49:15 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:49:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:49:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:49:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:49:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:49:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:49:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:49:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:49:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:49:16 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:49:16 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:49:16 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8445MB free_disk=25.952037811279297GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 15:49:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:49:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:49:16 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 6f6ae64a-c760-4ba3-8a50-d380835d9913 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:49:16 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 058df5ba-07ab-4bdd-9a47-907e7b0e0e59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:49:16 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:49:16 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:49:16 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance f0fc18ff-897c-4f97-95b6-9f25d11dba88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:49:16 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 15:49:16 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=1152MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 15:49:16 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:49:16 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:49:16 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 15:49:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.333s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:49:17 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:49:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:49:19 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:49:19 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:49:19 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:49:20 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:49:20 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:49:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:49:27 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:49:30 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:49:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:49:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:49:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 15:49:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 15:49:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 15:49:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:49:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:49:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:49:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:49:34 user nova-compute[71229]: DEBUG nova.objects.instance [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lazy-loading 'flavor' on Instance uuid f0fc18ff-897c-4f97-95b6-9f25d11dba88 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:49:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.091s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:49:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:49:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:49:34 user nova-compute[71229]: INFO nova.compute.manager [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Attaching volume 5da66830-cebd-441e-8573-1480f8fe8e15 to /dev/vdb
Apr 11 15:49:34 user nova-compute[71229]: DEBUG os_brick.utils [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:49:34 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:49:34 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:49:34 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc26485d-629a-40b6-8f66-e71e5f5a488e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d55e24a97c90\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:49:34 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:49:34 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:49:34 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b0c6f5-6109-4dba-b676-22bd73e0d164]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:49:34 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:49:34 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:49:34 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d294c0e0-29ec-43e0-91f3-de27ab62f4f5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:49:34 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d21290-ae8a-4ca1-9707-2f9390260dc1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:49:34 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Running cmd (subprocess): nvme version {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:49:34 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] 'nvme version' failed. Not Retrying. {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:49:34 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] nvme not present on system {{(pid=71229) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 15:49:34 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:49:34 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:49:34 user nova-compute[71229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 15:49:34 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[760627b0-9433-49fd-af2f-838aa14c52a4]: (4, '') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:49:34 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71229) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 15:49:34 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 15:49:34 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] LIGHTOS: no hostnqn found. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 15:49:34 user nova-compute[71229]: DEBUG os_brick.utils [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d55e24a97c90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:49:34 user nova-compute[71229]: DEBUG nova.virt.block_device [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Updating existing volume attachment record: e00169f8-f01e-4b3a-bb5b-10f16ecc2357 {{(pid=71229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 15:49:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:49:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:49:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:49:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:49:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:49:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:49:37 user nova-compute[71229]: INFO nova.compute.manager [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Terminating instance
Apr 11 15:49:37 user nova-compute[71229]: DEBUG nova.compute.manager [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Start destroying the instance on the hypervisor. {{(pid=71229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 15:49:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:49:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:49:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG nova.compute.manager [req-e5b032b9-06d9-4929-b3cd-1ffec2bdc572 req-19a804eb-757d-4c7d-8d5a-cf4de2a98a45 service nova] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Received event network-vif-unplugged-8eaf93f6-bd22-4804-8044-4cd18b84370a {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e5b032b9-06d9-4929-b3cd-1ffec2bdc572 req-19a804eb-757d-4c7d-8d5a-cf4de2a98a45 service nova] Acquiring lock "07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e5b032b9-06d9-4929-b3cd-1ffec2bdc572 req-19a804eb-757d-4c7d-8d5a-cf4de2a98a45 service nova] Lock "07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e5b032b9-06d9-4929-b3cd-1ffec2bdc572 req-19a804eb-757d-4c7d-8d5a-cf4de2a98a45 service nova] Lock "07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG nova.compute.manager [req-e5b032b9-06d9-4929-b3cd-1ffec2bdc572 req-19a804eb-757d-4c7d-8d5a-cf4de2a98a45 service nova] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] No waiting events found dispatching network-vif-unplugged-8eaf93f6-bd22-4804-8044-4cd18b84370a {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG nova.compute.manager [req-e5b032b9-06d9-4929-b3cd-1ffec2bdc572 req-19a804eb-757d-4c7d-8d5a-cf4de2a98a45 service nova] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Received event network-vif-unplugged-8eaf93f6-bd22-4804-8044-4cd18b84370a for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:49:38 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Instance destroyed successfully.
Apr 11 15:49:38 user nova-compute[71229]: DEBUG nova.objects.instance [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lazy-loading 'resources' on Instance uuid 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:45:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1177972057',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1177972057',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1177972057',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:45:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='312851c65ba1434691eca0cd2a8cd6d2',ramdisk_id='',reservation_id='r-x09jj22u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1933582504',owner_user_name='tempest-TestVolumeBootPattern-1933582504-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:45:12Z,user_data=None,user_id='c2110b74f38642afa560e1c9790d3f81',uuid=07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8eaf93f6-bd22-4804-8044-4cd18b84370a", "address": "fa:16:3e:e9:db:03", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eaf93f6-bd", "ovs_interfaceid": "8eaf93f6-bd22-4804-8044-4cd18b84370a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Converting VIF {"id": "8eaf93f6-bd22-4804-8044-4cd18b84370a", "address": "fa:16:3e:e9:db:03", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eaf93f6-bd", "ovs_interfaceid": "8eaf93f6-bd22-4804-8044-4cd18b84370a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:db:03,bridge_name='br-int',has_traffic_filtering=True,id=8eaf93f6-bd22-4804-8044-4cd18b84370a,network=Network(8d262ba8-b9c3-44ed-8431-6c295eb9ea24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eaf93f6-bd') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG os_vif [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:db:03,bridge_name='br-int',has_traffic_filtering=True,id=8eaf93f6-bd22-4804-8044-4cd18b84370a,network=Network(8d262ba8-b9c3-44ed-8431-6c295eb9ea24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eaf93f6-bd') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8eaf93f6-bd, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:49:38 user nova-compute[71229]: INFO os_vif [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:db:03,bridge_name='br-int',has_traffic_filtering=True,id=8eaf93f6-bd22-4804-8044-4cd18b84370a,network=Network(8d262ba8-b9c3-44ed-8431-6c295eb9ea24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eaf93f6-bd')
Apr 11 15:49:38 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'obEmVaHN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:49:38 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:49:38 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9299a0-be34-4c2e-bc54-39e3408e8b64]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 15:49:38 user nova-compute[71229]: No targets found.
Apr 11 15:49:38 user nova-compute[71229]: iSNS:
Apr 11 15:49:38 user nova-compute[71229]: No targets found.
Apr 11 15:49:38 user nova-compute[71229]: STATIC:
Apr 11 15:49:38 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3
Apr 11 15:49:38 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:49:38 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:49:38 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392
Apr 11 15:49:38 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:49:38 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:49:38 user nova-compute[71229]: FIRMWARE:
Apr 11 15:49:38 user nova-compute[71229]: No targets found.
Apr 11 15:49:38 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 15:49:38 user nova-compute[71229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 15:49:38 user nova-compute[71229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71229) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392', 0)] {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f4de00-fb98-401f-aaf8-91075de18fdb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d305fbec-f981-4153-904b-833171174962]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392 (non-flash)
Apr 11 15:49:38 user nova-compute[71229]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 (non-flash)
Apr 11 15:49:38 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392 (non-flash)
Apr 11 15:49:38 user nova-compute[71229]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 (non-flash)
Apr 11 15:49:38 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb5c23b2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392'): ({'sdb'}, set())}) {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Removing single pathed devices sdb {{(pid=71229) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c185ca-817d-4c4c-9306-9f882037df50]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a184676f-3eb8-4e76-b400-5d415fc75024]: (4, ('ok\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Flushing IO for device /dev/sdb {{(pid=71229) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d63fdec-2b76-4ab3-af1b-4b2f5aa2b8b9]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71229) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fd583e-d9e2-4d15-86ca-07fc18729dba]: (4, ('1', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] SCSI volumes sdb have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23436656561656266', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f1674350', '/dev/disk/by-id/scsi-1SCST_BIOf1674350-46eeaebfc57d863a') {{(pid=81310) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5acffcaa-89ba-4bbe-b0ad-9324171d46fd]: (4, None) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392')] {{(pid=71229) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9ae93b-9432-4e7c-8e5c-ce7e6231909b]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392 -p 172.16.0.220:3260 --logout {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6c277e-c3d6-422a-91d3-e4fb9152f45a]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392, portal: 172.16.0.220,3260]
Apr 11 15:49:38 user nova-compute[71229]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392, portal: 172.16.0.220,3260] successful.
Apr 11 15:49:38 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392 -p 172.16.0.220:3260 --op delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 15:49:38 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DmJIsVlB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:49:38 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:49:38 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60e0670e-2a18-47f6-921a-c69a3f375392 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[02dfbaf8-3bcd-475f-b021-6b15460fb93d]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] <== disconnect_volume: return (323ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 15:49:39 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Deleting instance files /opt/stack/data/nova/instances/07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d_del
Apr 11 15:49:39 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Deletion of /opt/stack/data/nova/instances/07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d_del complete
Apr 11 15:49:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.020s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:49:39 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:49:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:49:39 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 15:49:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15 -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db83a55-0b76-4209-b215-3b89f0521192]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 15:49:39 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15 -p 172.16.0.220:3260 --interface default --op new {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea9539b-bcb8-48b6-830f-802bccfe2110]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15] added\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15] added
Apr 11 15:49:39 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:49:39 user nova-compute[71229]: INFO nova.compute.manager [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Took 1.19 seconds to destroy the instance on the hypervisor.
Apr 11 15:49:39 user nova-compute[71229]: DEBUG oslo.service.loopingcall [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71229) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG nova.compute.manager [-] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Deallocating network for instance {{(pid=71229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] deallocate_for_instance() {{(pid=71229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a1c613-d90e-443f-9dff-ef7755c61164]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a96bb3f-a1f1-43da-9e46-c5fc936aaa24]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DmJIsVlB {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DmJIsVlB" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e40f86-442b-4b3a-8bcb-37d46e523a07]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DmJIsVlB'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[471362aa-952b-44a9-b1f6-d7fd0491d4fc]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9f13ae-8a47-47c1-87bd-7b011e62f113]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 (non-flash)
Apr 11 15:49:39 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 (non-flash)
Apr 11 15:49:39 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15 -p 172.16.0.220:3260 --login {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dcc19c2-b99e-4189-9b00-be6179c0ef79]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15, portal: 172.16.0.220,3260]
Apr 11 15:49:39 user nova-compute[71229]: Login to [iface: default, target: iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15, portal: 172.16.0.220,3260] successful.
Apr 11 15:49:39 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7031b4-40b7-4f78-abbf-d4c410a9fd4c]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab5d477-ab10-4165-a707-09d43131cf72]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 (non-flash)
Apr 11 15:49:39 user nova-compute[71229]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15 (non-flash)
Apr 11 15:49:39 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 (non-flash)
Apr 11 15:49:39 user nova-compute[71229]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15 (non-flash)
Apr 11 15:49:39 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e6e0eb-169f-4087-81a3-6d5ff5bacbb3]: (4, ('- - 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DmJIsVlB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:49:39 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Took 0.48 seconds to deallocate network for instance.
Apr 11 15:49:39 user nova-compute[71229]: DEBUG nova.compute.manager [req-ac932e59-d139-483f-b180-554f7dad4ae2 req-b9bf91af-e641-4a23-900b-0e0ded9690bb service nova] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Received event network-vif-deleted-8eaf93f6-bd22-4804-8044-4cd18b84370a {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:49:39 user nova-compute[71229]: INFO nova.compute.manager [req-ac932e59-d139-483f-b180-554f7dad4ae2 req-b9bf91af-e641-4a23-900b-0e0ded9690bb service nova] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Neutron deleted interface 8eaf93f6-bd22-4804-8044-4cd18b84370a; detaching it from the instance and deleting it from the info cache
Apr 11 15:49:39 user nova-compute[71229]: DEBUG nova.network.neutron [req-ac932e59-d139-483f-b180-554f7dad4ae2 req-b9bf91af-e641-4a23-900b-0e0ded9690bb service nova] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:49:39 user nova-compute[71229]: DEBUG nova.compute.manager [req-ac932e59-d139-483f-b180-554f7dad4ae2 req-b9bf91af-e641-4a23-900b-0e0ded9690bb service nova] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Detach interface failed, port_id=8eaf93f6-bd22-4804-8044-4cd18b84370a, reason: Instance 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d could not be found. {{(pid=71229) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 15:49:40 user nova-compute[71229]: DEBUG nova.compute.manager [req-03c0bc00-0fc2-4697-8d5d-f7b6a864628d req-28fc6019-4ec7-433f-8205-9acd767e90a7 service nova] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Received event network-vif-plugged-8eaf93f6-bd22-4804-8044-4cd18b84370a {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:49:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-03c0bc00-0fc2-4697-8d5d-f7b6a864628d req-28fc6019-4ec7-433f-8205-9acd767e90a7 service nova] Acquiring lock "07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:49:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-03c0bc00-0fc2-4697-8d5d-f7b6a864628d req-28fc6019-4ec7-433f-8205-9acd767e90a7 service nova] Lock "07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:49:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-03c0bc00-0fc2-4697-8d5d-f7b6a864628d req-28fc6019-4ec7-433f-8205-9acd767e90a7 service nova] Lock "07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:49:40 user nova-compute[71229]: DEBUG nova.compute.manager [req-03c0bc00-0fc2-4697-8d5d-f7b6a864628d req-28fc6019-4ec7-433f-8205-9acd767e90a7 service nova] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] No waiting events found dispatching network-vif-plugged-8eaf93f6-bd22-4804-8044-4cd18b84370a {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:49:40 user nova-compute[71229]: WARNING nova.compute.manager [req-03c0bc00-0fc2-4697-8d5d-f7b6a864628d req-28fc6019-4ec7-433f-8205-9acd767e90a7 service nova] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Received unexpected event network-vif-plugged-8eaf93f6-bd22-4804-8044-4cd18b84370a for instance with vm_state active and task_state deleting.
Apr 11 15:49:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:49:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23666613665363463', 'path': '/dev/sdb'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:49:40 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666613665363463', 'path': '/dev/sdb'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 15:49:40 user nova-compute[71229]: DEBUG nova.objects.instance [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lazy-loading 'flavor' on Instance uuid f0fc18ff-897c-4f97-95b6-9f25d11dba88 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:49:40 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 15:49:40 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:49:40 user nova-compute[71229]:   <source dev="/dev/sdb"/>
Apr 11 15:49:40 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 15:49:40 user nova-compute[71229]:   <serial>5da66830-cebd-441e-8573-1480f8fe8e15</serial>
Apr 11 15:49:40 user nova-compute[71229]: </disk>
Apr 11 15:49:40 user nova-compute[71229]:  {{(pid=71229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 15:49:40 user nova-compute[71229]: INFO nova.compute.manager [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Took 0.84 seconds to detach 1 volumes for instance.
Apr 11 15:49:40 user nova-compute[71229]: DEBUG nova.compute.manager [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Deleting volume: 60e0670e-2a18-47f6-921a-c69a3f375392 {{(pid=71229) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 11 15:49:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:49:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:49:40 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:49:40 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:49:40 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:49:40 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:49:40 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] No VIF found with MAC fa:16:3e:39:51:c6, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:49:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.225s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:49:40 user nova-compute[71229]: INFO nova.scheduler.client.report [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Deleted allocations for instance 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d
Apr 11 15:49:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4f244e31-9e9c-482a-a706-1f477f097255 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.034s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:49:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d6fe31bd-b1f4-4e1c-a80f-3075f7482871 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.313s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:49:41 user nova-compute[71229]: INFO nova.compute.manager [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Rescuing
Apr 11 15:49:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "refresh_cache-f0fc18ff-897c-4f97-95b6-9f25d11dba88" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:49:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquired lock "refresh_cache-f0fc18ff-897c-4f97-95b6-9f25d11dba88" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:49:41 user nova-compute[71229]: DEBUG nova.network.neutron [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:49:41 user nova-compute[71229]: DEBUG nova.network.neutron [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Updating instance_info_cache with network_info: [{"id": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01", "address": "fa:16:3e:39:51:c6", "network": {"id": "81031696-fd25-42a1-8c36-43a6eacbab12", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1627850915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c9dbdbc7b641f096dc292ea7bf7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf0cc1bf-40", "ovs_interfaceid": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:49:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Releasing lock "refresh_cache-f0fc18ff-897c-4f97-95b6-9f25d11dba88" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:49:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:49:42 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:49:42 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:49:42 user nova-compute[71229]: DEBUG nova.compute.manager [req-94b6a292-f3c6-48a3-94c9-8f1ba5c4be40 req-60ba9d0c-bce0-4c9d-ac1b-41a8700cb6c7 service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Received event network-vif-unplugged-cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:49:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-94b6a292-f3c6-48a3-94c9-8f1ba5c4be40 req-60ba9d0c-bce0-4c9d-ac1b-41a8700cb6c7 service nova] Acquiring lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:49:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-94b6a292-f3c6-48a3-94c9-8f1ba5c4be40 req-60ba9d0c-bce0-4c9d-ac1b-41a8700cb6c7 service nova] Lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:49:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-94b6a292-f3c6-48a3-94c9-8f1ba5c4be40 req-60ba9d0c-bce0-4c9d-ac1b-41a8700cb6c7 service nova] Lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:49:42 user nova-compute[71229]: DEBUG nova.compute.manager [req-94b6a292-f3c6-48a3-94c9-8f1ba5c4be40 req-60ba9d0c-bce0-4c9d-ac1b-41a8700cb6c7 service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] No waiting events found dispatching network-vif-unplugged-cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:49:42 user nova-compute[71229]: WARNING nova.compute.manager [req-94b6a292-f3c6-48a3-94c9-8f1ba5c4be40 req-60ba9d0c-bce0-4c9d-ac1b-41a8700cb6c7 service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Received unexpected event network-vif-unplugged-cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 for instance with vm_state active and task_state rescuing.
Apr 11 15:49:42 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Instance destroyed successfully.
Apr 11 15:49:42 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Attempting a stable device rescue
Apr 11 15:49:42 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=71229) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 11 15:49:42 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Instance directory exists: not creating {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 15:49:42 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Creating image(s)
Apr 11 15:49:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "/opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:49:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "/opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:49:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "/opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:49:42 user nova-compute[71229]: DEBUG nova.objects.instance [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lazy-loading 'trusted_certs' on Instance uuid f0fc18ff-897c-4f97-95b6-9f25d11dba88 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:49:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "ad75252f204c5a5da63dc2b1c040fdefe8eb0101" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:49:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ad75252f204c5a5da63dc2b1c040fdefe8eb0101" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:49:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad75252f204c5a5da63dc2b1c040fdefe8eb0101.part --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:49:43 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:49:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad75252f204c5a5da63dc2b1c040fdefe8eb0101.part --force-share --output=json" returned: 0 in 0.134s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:49:43 user nova-compute[71229]: DEBUG nova.virt.images [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] 914ad610-2e93-41cc-9c53-514927e371f8 was qcow2, converting to raw {{(pid=71229) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 15:49:43 user nova-compute[71229]: DEBUG nova.privsep.utils [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71229) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 15:49:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ad75252f204c5a5da63dc2b1c040fdefe8eb0101.part /opt/stack/data/nova/instances/_base/ad75252f204c5a5da63dc2b1c040fdefe8eb0101.converted {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ad75252f204c5a5da63dc2b1c040fdefe8eb0101.part /opt/stack/data/nova/instances/_base/ad75252f204c5a5da63dc2b1c040fdefe8eb0101.converted" returned: 0 in 0.220s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad75252f204c5a5da63dc2b1c040fdefe8eb0101.converted --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad75252f204c5a5da63dc2b1c040fdefe8eb0101.converted --force-share --output=json" returned: 0 in 0.133s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ad75252f204c5a5da63dc2b1c040fdefe8eb0101" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.424s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "ad75252f204c5a5da63dc2b1c040fdefe8eb0101" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ad75252f204c5a5da63dc2b1c040fdefe8eb0101" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad75252f204c5a5da63dc2b1c040fdefe8eb0101 --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG nova.compute.manager [req-842193a1-a083-4ccb-982c-cd6685252b9f req-beebd2e7-bab9-45a5-b500-39e168fcee46 service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Received event network-vif-plugged-cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-842193a1-a083-4ccb-982c-cd6685252b9f req-beebd2e7-bab9-45a5-b500-39e168fcee46 service nova] Acquiring lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-842193a1-a083-4ccb-982c-cd6685252b9f req-beebd2e7-bab9-45a5-b500-39e168fcee46 service nova] Lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-842193a1-a083-4ccb-982c-cd6685252b9f req-beebd2e7-bab9-45a5-b500-39e168fcee46 service nova] Lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG nova.compute.manager [req-842193a1-a083-4ccb-982c-cd6685252b9f req-beebd2e7-bab9-45a5-b500-39e168fcee46 service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] No waiting events found dispatching network-vif-plugged-cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:49:44 user nova-compute[71229]: WARNING nova.compute.manager [req-842193a1-a083-4ccb-982c-cd6685252b9f req-beebd2e7-bab9-45a5-b500-39e168fcee46 service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Received unexpected event network-vif-plugged-cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 for instance with vm_state active and task_state rescuing.
Apr 11 15:49:44 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad75252f204c5a5da63dc2b1c040fdefe8eb0101 --force-share --output=json" returned: 0 in 0.141s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad75252f204c5a5da63dc2b1c040fdefe8eb0101,backing_fmt=raw /opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk.rescue {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad75252f204c5a5da63dc2b1c040fdefe8eb0101,backing_fmt=raw /opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk.rescue" returned: 0 in 0.050s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "ad75252f204c5a5da63dc2b1c040fdefe8eb0101" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG nova.objects.instance [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lazy-loading 'migration_context' on Instance uuid f0fc18ff-897c-4f97-95b6-9f25d11dba88 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Created local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Start _get_guest_xml network_info=[{"id": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01", "address": "fa:16:3e:39:51:c6", "network": {"id": "81031696-fd25-42a1-8c36-43a6eacbab12", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1627850915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1627850915-network", "vif_mac": "fa:16:3e:39:51:c6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c9dbdbc7b641f096dc292ea7bf7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf0cc1bf-40", "ovs_interfaceid": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '914ad610-2e93-41cc-9c53-514927e371f8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '52fe638c-5ada-47d5-b376-233bfa808a37'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DmJIsVlB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'f0fc18ff-897c-4f97-95b6-9f25d11dba88', 'attached_at': '', 'detached_at': '', 'volume_id': '5da66830-cebd-441e-8573-1480f8fe8e15', 'serial': '5da66830-cebd-441e-8573-1480f8fe8e15'}, 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'e00169f8-f01e-4b3a-bb5b-10f16ecc2357', 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG nova.objects.instance [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lazy-loading 'resources' on Instance uuid f0fc18ff-897c-4f97-95b6-9f25d11dba88 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG nova.objects.instance [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lazy-loading 'numa_topology' on Instance uuid f0fc18ff-897c-4f97-95b6-9f25d11dba88 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:49:44 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:49:44 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:49:44 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG nova.objects.instance [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lazy-loading 'vcpu_model' on Instance uuid f0fc18ff-897c-4f97-95b6-9f25d11dba88 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DmJIsVlB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:49:44 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:49:44 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:49:44 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:49:44 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:49:44 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 15:49:44 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15 -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f938088-dd4e-46ae-beeb-44b1179606df]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = DmJIsVlB\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 11 15:49:44 user nova-compute[71229]: node.name = iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15
Apr 11 15:49:44 user nova-compute[71229]: node.tpgt = -1
Apr 11 15:49:44 user nova-compute[71229]: node.startup = automatic
Apr 11 15:49:44 user nova-compute[71229]: node.leading_login = No
Apr 11 15:49:44 user nova-compute[71229]: iface.iscsi_ifacename = default
Apr 11 15:49:44 user nova-compute[71229]: iface.net_ifacename = <empty>
Apr 11 15:49:44 user nova-compute[71229]: iface.ipaddress = <empty>
Apr 11 15:49:44 user nova-compute[71229]: iface.prefix_len = 0
Apr 11 15:49:44 user nova-compute[71229]: iface.hwaddress = <empty>
Apr 11 15:49:44 user nova-compute[71229]: iface.transport_name = tcp
Apr 11 15:49:44 user nova-compute[71229]: iface.initiatorname = <empty>
Apr 11 15:49:44 user nova-compute[71229]: iface.state = <empty>
Apr 11 15:49:44 user nova-compute[71229]: iface.vlan_id = 0
Apr 11 15:49:44 user nova-compute[71229]: iface.vlan_priority = 0
Apr 11 15:49:44 user nova-compute[71229]: iface.vlan_state = <empty>
Apr 11 15:49:44 user nova-compute[71229]: iface.iface_num = 0
Apr 11 15:49:44 user nova-compute[71229]: iface.mtu = 0
Apr 11 15:49:44 user nova-compute[71229]: iface.port = 0
Apr 11 15:49:44 user nova-compute[71229]: iface.bootproto = <empty>
Apr 11 15:49:44 user nova-compute[71229]: iface.subnet_mask = <empty>
Apr 11 15:49:44 user nova-compute[71229]: iface.gateway = <empty>
Apr 11 15:49:44 user nova-compute[71229]: iface.dhcp_alt_client_id_state = <empty>
Apr 11 15:49:44 user nova-compute[71229]: iface.dhcp_alt_client_id = <empty>
Apr 11 15:49:44 user nova-compute[71229]: iface.dhcp_dns = <empty>
Apr 11 15:49:44 user nova-compute[71229]: iface.dhcp_learn_iqn = <empty>
Apr 11 15:49:44 user nova-compute[71229]: iface.dhcp_req_vendor_id_state = <empty>
Apr 11 15:49:44 user nova-compute[71229]: iface.dhcp_vendor_id_state = <empty>
Apr 11 15:49:44 user nova-compute[71229]: iface.dhcp_vendor_id = <empty>
Apr 11 15:49:44 user nova-compute[71229]: iface.dhcp_slp_da = <empty>
Apr 11 15:49:44 user nova-compute[71229]: iface.fragmentation = <empty>
Apr 11 15:49:44 user nova-compute[71229]: iface.gratuitous_arp = <empty>
Apr 11 15:49:44 user nova-compute[71229]: iface.incoming_forwarding = <empty>
Apr 11 15:49:44 user nova-compute[71229]: iface.tos_state = <empty>
Apr 11 15:49:44 user nova-compute[71229]: iface.tos = 0
Apr 11 15:49:44 user nova-compute[71229]: iface.ttl = 0
Apr 11 15:49:44 user nova-compute[71229]: iface.delayed_ack = <empty>
Apr 11 15:49:44 user nova-compute[71229]: iface.tcp_nagle = <empty>
Apr 11 15:49:44 user nova-compute[71229]: iface.tcp_wsf_state = <empty>
Apr 11 15:49:44 user nova-compute[71229]: iface.tcp_wsf = 0
Apr 11 15:49:44 user nova-compute[71229]: iface.tcp_timer_scale = 0
Apr 11 15:49:44 user nova-compute[71229]: iface.tcp_timestamp = <empty>
Apr 11 15:49:44 user nova-compute[71229]: iface.redirect = <empty>
Apr 11 15:49:44 user nova-compute[71229]: iface.def_task_mgmt_timeout = 0
Apr 11 15:49:44 user nova-compute[71229]: iface.header_digest = <empty>
Apr 11 15:49:44 user nova-compute[71229]: iface.data_digest = <empty>
Apr 11 15:49:44 user nova-compute[71229]: iface.immediate_data = <empty>
Apr 11 15:49:44 user nova-compute[71229]: iface.initial_r2t = <empty>
Apr 11 15:49:44 user nova-compute[71229]: iface.data_seq_inorder = <empty>
Apr 11 15:49:44 user nova-compute[71229]: iface.data_pdu_inorder = <empty>
Apr 11 15:49:44 user nova-compute[71229]: iface.erl = 0
Apr 11 15:49:44 user nova-compute[71229]: iface.max_receive_data_len = 0
Apr 11 15:49:44 user nova-compute[71229]: iface.first_burst_len = 0
Apr 11 15:49:44 user nova-compute[71229]: iface.max_outstanding_r2t = 0
Apr 11 15:49:44 user nova-compute[71229]: iface.max_burst_len = 0
Apr 11 15:49:44 user nova-compute[71229]: iface.chap_auth = <empty>
Apr 11 15:49:44 user nova-compute[71229]: iface.bidi_chap = <empty>
Apr 11 15:49:44 user nova-compute[71229]: iface.strict_login_compliance = <empty>
Apr 11 15:49:44 user nova-compute[71229]: iface.discovery_auth = <empty>
Apr 11 15:49:44 user nova-compute[71229]: iface.discovery_logout = <empty>
Apr 11 15:49:44 user nova-compute[71229]: node.discovery_address = <empty>
Apr 11 15:49:44 user nova-compute[71229]: node.discovery_port = 0
Apr 11 15:49:44 user nova-compute[71229]: node.discovery_type = static
Apr 11 15:49:44 user nova-compute[71229]: node.session.initial_cmdsn = 0
Apr 11 15:49:44 user nova-compute[71229]: node.session.initial_login_retry_max = 8
Apr 11 15:49:44 user nova-compute[71229]: node.session.xmit_thread_priority = -20
Apr 11 15:49:44 user nova-compute[71229]: node.session.cmds_max = 128
Apr 11 15:49:44 user nova-compute[71229]: node.session.queue_depth = 32
Apr 11 15:49:44 user nova-compute[71229]: node.session.nr_sessions = 1
Apr 11 15:49:44 user nova-compute[71229]: node.session.auth.authmethod = CHAP
Apr 11 15:49:44 user nova-compute[71229]: node.session.auth.username = DmJIsVlB
Apr 11 15:49:44 user nova-compute[71229]: node.session.auth.password = ***
Apr 11 15:49:44 user nova-compute[71229]: node.session.auth.username_in = <empty>
Apr 11 15:49:44 user nova-compute[71229]: node.session.auth.password_in = <empty>
Apr 11 15:49:44 user nova-compute[71229]: node.session.auth.chap_algs = MD5
Apr 11 15:49:44 user nova-compute[71229]: node.session.timeo.replacement_timeout = 120
Apr 11 15:49:44 user nova-compute[71229]: node.session.err_timeo.abort_timeout = 15
Apr 11 15:49:44 user nova-compute[71229]: node.session.err_timeo.lu_reset_timeout = 30
Apr 11 15:49:44 user nova-compute[71229]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 11 15:49:44 user nova-compute[71229]: node.session.err_timeo.host_reset_timeout = 60
Apr 11 15:49:44 user nova-compute[71229]: node.session.iscsi.FastAbort = Yes
Apr 11 15:49:44 user nova-compute[71229]: node.session.iscsi.InitialR2T = No
Apr 11 15:49:44 user nova-compute[71229]: node.session.iscsi.ImmediateData = Yes
Apr 11 15:49:44 user nova-compute[71229]: node.session.iscsi.FirstBurstLength = 262144
Apr 11 15:49:44 user nova-compute[71229]: node.session.iscsi.MaxBurstLength = 16776192
Apr 11 15:49:44 user nova-compute[71229]: node.session.iscsi.DefaultTime2Retain = 0
Apr 11 15:49:44 user nova-compute[71229]: node.session.iscsi.DefaultTime2Wait = 2
Apr 11 15:49:44 user nova-compute[71229]: node.session.iscsi.MaxConnections = 1
Apr 11 15:49:44 user nova-compute[71229]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 11 15:49:44 user nova-compute[71229]: node.session.iscsi.ERL = 0
Apr 11 15:49:44 user nova-compute[71229]: node.session.scan = manual
Apr 11 15:49:44 user nova-compute[71229]: node.session.reopen_max = 0
Apr 11 15:49:44 user nova-compute[71229]: node.conn[0].address = 172.16.0.220
Apr 11 15:49:44 user nova-compute[71229]: node.conn[0].port = 3260
Apr 11 15:49:44 user nova-compute[71229]: node.conn[0].startup = manual
Apr 11 15:49:44 user nova-compute[71229]: node.conn[0].tcp.window_size = 524288
Apr 11 15:49:44 user nova-compute[71229]: node.conn[0].tcp.type_of_service = 0
Apr 11 15:49:44 user nova-compute[71229]: node.conn[0].timeo.logout_timeout = 15
Apr 11 15:49:44 user nova-compute[71229]: node.conn[0].timeo.login_timeout = 15
Apr 11 15:49:44 user nova-compute[71229]: node.conn[0].timeo.auth_timeout = 45
Apr 11 15:49:44 user nova-compute[71229]: node.conn[0].timeo.noop_out_interval = 5
Apr 11 15:49:44 user nova-compute[71229]: node.conn[0].timeo.noop_out_timeout = 5
Apr 11 15:49:44 user nova-compute[71229]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 11 15:49:44 user nova-compute[71229]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 11 15:49:44 user nova-compute[71229]: node.conn[0].iscsi.HeaderDigest = None
Apr 11 15:49:44 user nova-compute[71229]: node.conn[0].iscsi.DataDigest = None
Apr 11 15:49:44 user nova-compute[71229]: node.conn[0].iscsi.IFMarker = No
Apr 11 15:49:44 user nova-compute[71229]: node.conn[0].iscsi.OFMarker = No
Apr 11 15:49:44 user nova-compute[71229]: # END RECORD
Apr 11 15:49:44 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a77d9f-01f8-4042-8b08-7d9829be3e67]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfeb551a-be99-4292-aaa7-2d05d230cf72]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DmJIsVlB {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DmJIsVlB" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[71316bc2-b635-4044-ac5b-4d528edc08ac]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DmJIsVlB'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc139fb-717b-4832-af96-d222eef71adc]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[53218d04-41d4-4731-a4d4-79daaaddfeeb]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 (non-flash)
Apr 11 15:49:44 user nova-compute[71229]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15 (non-flash)
Apr 11 15:49:44 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 (non-flash)
Apr 11 15:49:44 user nova-compute[71229]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15 (non-flash)
Apr 11 15:49:44 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.140s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] HCTL ('33', '0', '0', 0) found on session 42 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4942c57-4ab2-4e34-b40e-e6fcb8494d9f]: (4, ('0 0 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Searching for a device in session 42 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DmJIsVlB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.164s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] <== connect_volume: return (165ms) {'type': 'block', 'scsi_wwn': '23666613665363463', 'path': '/dev/sdb'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666613665363463', 'path': '/dev/sdb'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:45:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-264655155',display_name='tempest-ServerStableDeviceRescueTest-server-264655155',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-264655155',id=35,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESSrnhmezC7HQi+h0OdTtButyUJkAu5n8hHJP9eUrxeUgZ1v8+l+B++ncR6In95oR0ORBJlzSH/RoWq4EEt/BxSJF7IPv0bb8yRJgYBk+JaLJ0rhNGgPTIehYPdLc82UA==',key_name='tempest-keypair-363003976',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:45:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='85c9dbdbc7b641f096dc292ea7bf7cd4',ramdisk_id='',reservation_id='r-o21y4kmv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1990539250',owner_user_name='tempest-ServerStableDeviceRescueTest-1990539250-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:47:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b244004380d43699c5a06e817224b3e',uuid=f0fc18ff-897c-4f97-95b6-9f25d11dba88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01", "address": "fa:16:3e:39:51:c6", "network": {"id": "81031696-fd25-42a1-8c36-43a6eacbab12", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1627850915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1627850915-network", "vif_mac": "fa:16:3e:39:51:c6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c9dbdbc7b641f096dc292ea7bf7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf0cc1bf-40", "ovs_interfaceid": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Converting VIF {"id": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01", "address": "fa:16:3e:39:51:c6", "network": {"id": "81031696-fd25-42a1-8c36-43a6eacbab12", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1627850915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1627850915-network", "vif_mac": "fa:16:3e:39:51:c6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c9dbdbc7b641f096dc292ea7bf7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf0cc1bf-40", "ovs_interfaceid": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:51:c6,bridge_name='br-int',has_traffic_filtering=True,id=cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01,network=Network(81031696-fd25-42a1-8c36-43a6eacbab12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf0cc1bf-40') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG nova.objects.instance [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lazy-loading 'pci_devices' on Instance uuid f0fc18ff-897c-4f97-95b6-9f25d11dba88 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:49:44 user nova-compute[71229]:   <uuid>f0fc18ff-897c-4f97-95b6-9f25d11dba88</uuid>
Apr 11 15:49:44 user nova-compute[71229]:   <name>instance-00000023</name>
Apr 11 15:49:44 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:49:44 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:49:44 user nova-compute[71229]:   <metadata>
Apr 11 15:49:44 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:49:44 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:49:44 user nova-compute[71229]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-264655155</nova:name>
Apr 11 15:49:44 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:49:44</nova:creationTime>
Apr 11 15:49:44 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:49:44 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:49:44 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:49:44 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:49:44 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:49:44 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:49:44 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:49:44 user nova-compute[71229]:       <nova:owner>
Apr 11 15:49:44 user nova-compute[71229]:         <nova:user uuid="0b244004380d43699c5a06e817224b3e">tempest-ServerStableDeviceRescueTest-1990539250-project-member</nova:user>
Apr 11 15:49:44 user nova-compute[71229]:         <nova:project uuid="85c9dbdbc7b641f096dc292ea7bf7cd4">tempest-ServerStableDeviceRescueTest-1990539250</nova:project>
Apr 11 15:49:44 user nova-compute[71229]:       </nova:owner>
Apr 11 15:49:44 user nova-compute[71229]:       <nova:root type="image" uuid="52fe638c-5ada-47d5-b376-233bfa808a37"/>
Apr 11 15:49:44 user nova-compute[71229]:       <nova:ports>
Apr 11 15:49:44 user nova-compute[71229]:         <nova:port uuid="cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01">
Apr 11 15:49:44 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 11 15:49:44 user nova-compute[71229]:         </nova:port>
Apr 11 15:49:44 user nova-compute[71229]:       </nova:ports>
Apr 11 15:49:44 user nova-compute[71229]:     </nova:instance>
Apr 11 15:49:44 user nova-compute[71229]:   </metadata>
Apr 11 15:49:44 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:49:44 user nova-compute[71229]:     <system>
Apr 11 15:49:44 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:49:44 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:49:44 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:49:44 user nova-compute[71229]:       <entry name="serial">f0fc18ff-897c-4f97-95b6-9f25d11dba88</entry>
Apr 11 15:49:44 user nova-compute[71229]:       <entry name="uuid">f0fc18ff-897c-4f97-95b6-9f25d11dba88</entry>
Apr 11 15:49:44 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:49:44 user nova-compute[71229]:     </system>
Apr 11 15:49:44 user nova-compute[71229]:   </sysinfo>
Apr 11 15:49:44 user nova-compute[71229]:   <os>
Apr 11 15:49:44 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:49:44 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:49:44 user nova-compute[71229]:   </os>
Apr 11 15:49:44 user nova-compute[71229]:   <features>
Apr 11 15:49:44 user nova-compute[71229]:     <acpi/>
Apr 11 15:49:44 user nova-compute[71229]:     <apic/>
Apr 11 15:49:44 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:49:44 user nova-compute[71229]:   </features>
Apr 11 15:49:44 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:49:44 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:49:44 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:49:44 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:49:44 user nova-compute[71229]:   </clock>
Apr 11 15:49:44 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:49:44 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:49:44 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:49:44 user nova-compute[71229]:   </cpu>
Apr 11 15:49:44 user nova-compute[71229]:   <devices>
Apr 11 15:49:44 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 15:49:44 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 15:49:44 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk"/>
Apr 11 15:49:44 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:49:44 user nova-compute[71229]:     </disk>
Apr 11 15:49:44 user nova-compute[71229]:     <disk type="block" device="disk">
Apr 11 15:49:44 user nova-compute[71229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:49:44 user nova-compute[71229]:       <source dev="/dev/sdb"/>
Apr 11 15:49:44 user nova-compute[71229]:       <target dev="vdb" bus="virtio"/>
Apr 11 15:49:44 user nova-compute[71229]:       <serial>5da66830-cebd-441e-8573-1480f8fe8e15</serial>
Apr 11 15:49:44 user nova-compute[71229]:     </disk>
Apr 11 15:49:44 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 15:49:44 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 15:49:44 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk.rescue"/>
Apr 11 15:49:44 user nova-compute[71229]:       <target dev="vdc" bus="virtio"/>
Apr 11 15:49:44 user nova-compute[71229]:       <boot order="1"/>
Apr 11 15:49:44 user nova-compute[71229]:     </disk>
Apr 11 15:49:44 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:49:44 user nova-compute[71229]:       <mac address="fa:16:3e:39:51:c6"/>
Apr 11 15:49:44 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:49:44 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:49:44 user nova-compute[71229]:       <target dev="tapcf0cc1bf-40"/>
Apr 11 15:49:44 user nova-compute[71229]:     </interface>
Apr 11 15:49:44 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:49:44 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/console.log" append="off"/>
Apr 11 15:49:44 user nova-compute[71229]:     </serial>
Apr 11 15:49:44 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:49:44 user nova-compute[71229]:     <video>
Apr 11 15:49:44 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:49:44 user nova-compute[71229]:     </video>
Apr 11 15:49:44 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:49:44 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:49:44 user nova-compute[71229]:     </rng>
Apr 11 15:49:44 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:49:44 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:49:44 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:49:44 user nova-compute[71229]:     </memballoon>
Apr 11 15:49:44 user nova-compute[71229]:   </devices>
Apr 11 15:49:44 user nova-compute[71229]: </domain>
Apr 11 15:49:44 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:49:44 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Instance destroyed successfully.
Apr 11 15:49:44 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:49:44 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] No VIF found with MAC fa:16:3e:39:51:c6, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:49:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:49:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:49:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:49:46 user nova-compute[71229]: DEBUG nova.compute.manager [req-1cc89406-ce10-4e47-a3de-c0f4082baec8 req-c0285d1d-71ce-4cc1-8e80-035d0cca232f service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Received event network-vif-plugged-cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:49:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-1cc89406-ce10-4e47-a3de-c0f4082baec8 req-c0285d1d-71ce-4cc1-8e80-035d0cca232f service nova] Acquiring lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:49:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-1cc89406-ce10-4e47-a3de-c0f4082baec8 req-c0285d1d-71ce-4cc1-8e80-035d0cca232f service nova] Lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:49:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-1cc89406-ce10-4e47-a3de-c0f4082baec8 req-c0285d1d-71ce-4cc1-8e80-035d0cca232f service nova] Lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:49:46 user nova-compute[71229]: DEBUG nova.compute.manager [req-1cc89406-ce10-4e47-a3de-c0f4082baec8 req-c0285d1d-71ce-4cc1-8e80-035d0cca232f service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] No waiting events found dispatching network-vif-plugged-cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:49:46 user nova-compute[71229]: WARNING nova.compute.manager [req-1cc89406-ce10-4e47-a3de-c0f4082baec8 req-c0285d1d-71ce-4cc1-8e80-035d0cca232f service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Received unexpected event network-vif-plugged-cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 for instance with vm_state active and task_state rescuing.
Apr 11 15:49:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:49:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:49:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:49:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:49:48 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Removed pending event for f0fc18ff-897c-4f97-95b6-9f25d11dba88 due to event {{(pid=71229) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 15:49:48 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681228188.326255, f0fc18ff-897c-4f97-95b6-9f25d11dba88 => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:49:48 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] VM Resumed (Lifecycle Event)
Apr 11 15:49:48 user nova-compute[71229]: DEBUG nova.compute.manager [None req-f45319d7-4773-4c18-8da6-4a16548b1678 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:49:48 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:49:48 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:49:48 user nova-compute[71229]: DEBUG nova.compute.manager [req-ed3d13eb-496a-4149-b04d-62db0b68d20e req-98f741cd-e992-4838-ae9c-099789a719e0 service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Received event network-vif-plugged-cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:49:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-ed3d13eb-496a-4149-b04d-62db0b68d20e req-98f741cd-e992-4838-ae9c-099789a719e0 service nova] Acquiring lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:49:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-ed3d13eb-496a-4149-b04d-62db0b68d20e req-98f741cd-e992-4838-ae9c-099789a719e0 service nova] Lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:49:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-ed3d13eb-496a-4149-b04d-62db0b68d20e req-98f741cd-e992-4838-ae9c-099789a719e0 service nova] Lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:49:48 user nova-compute[71229]: DEBUG nova.compute.manager [req-ed3d13eb-496a-4149-b04d-62db0b68d20e req-98f741cd-e992-4838-ae9c-099789a719e0 service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] No waiting events found dispatching network-vif-plugged-cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:49:48 user nova-compute[71229]: WARNING nova.compute.manager [req-ed3d13eb-496a-4149-b04d-62db0b68d20e req-98f741cd-e992-4838-ae9c-099789a719e0 service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Received unexpected event network-vif-plugged-cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 for instance with vm_state active and task_state rescuing.
Apr 11 15:49:48 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 11 15:49:48 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681228188.327877, f0fc18ff-897c-4f97-95b6-9f25d11dba88 => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:49:48 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] VM Started (Lifecycle Event)
Apr 11 15:49:48 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:49:48 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:49:48 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:49:52 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:49:53 user nova-compute[71229]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681228178.6325538, 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d => Stopped> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:49:53 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] VM Stopped (Lifecycle Event)
Apr 11 15:49:53 user nova-compute[71229]: DEBUG nova.compute.manager [None req-3fc2116a-4ca5-4ac9-a13e-e68d7c2307da None None] [instance: 07b7a704-6e4b-4b4d-a355-f2d2dd8d1f7d] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:49:53 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:49:58 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:50:01 user nova-compute[71229]: DEBUG nova.compute.manager [req-30306ff6-d4c4-4fb0-a168-32eba509868d req-5443cc14-b4bd-4925-b3cb-6dae97bdc734 service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Received event network-changed-35ac8f6f-2998-4274-ab63-df7086194703 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:50:01 user nova-compute[71229]: DEBUG nova.compute.manager [req-30306ff6-d4c4-4fb0-a168-32eba509868d req-5443cc14-b4bd-4925-b3cb-6dae97bdc734 service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Refreshing instance network info cache due to event network-changed-35ac8f6f-2998-4274-ab63-df7086194703. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:50:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-30306ff6-d4c4-4fb0-a168-32eba509868d req-5443cc14-b4bd-4925-b3cb-6dae97bdc734 service nova] Acquiring lock "refresh_cache-c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:50:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-30306ff6-d4c4-4fb0-a168-32eba509868d req-5443cc14-b4bd-4925-b3cb-6dae97bdc734 service nova] Acquired lock "refresh_cache-c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:50:01 user nova-compute[71229]: DEBUG nova.network.neutron [req-30306ff6-d4c4-4fb0-a168-32eba509868d req-5443cc14-b4bd-4925-b3cb-6dae97bdc734 service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Refreshing network info cache for port 35ac8f6f-2998-4274-ab63-df7086194703 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:50:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f5722d24-a958-4075-9d3a-08a19d3dbb22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:50:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f5722d24-a958-4075-9d3a-08a19d3dbb22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:50:01 user nova-compute[71229]: INFO nova.compute.manager [None req-f5722d24-a958-4075-9d3a-08a19d3dbb22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Detaching volume a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3
Apr 11 15:50:01 user nova-compute[71229]: INFO nova.virt.block_device [None req-f5722d24-a958-4075-9d3a-08a19d3dbb22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Attempting to driver detach volume a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 from mountpoint /dev/vdb
Apr 11 15:50:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f5722d24-a958-4075-9d3a-08a19d3dbb22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Attempting to detach device vdb from instance c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a from the persistent domain config. {{(pid=71229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 15:50:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-f5722d24-a958-4075-9d3a-08a19d3dbb22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 15:50:01 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:50:01 user nova-compute[71229]:   <source dev="/dev/sdc"/>
Apr 11 15:50:01 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 15:50:01 user nova-compute[71229]:   <serial>a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3</serial>
Apr 11 15:50:01 user nova-compute[71229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 15:50:01 user nova-compute[71229]: </disk>
Apr 11 15:50:01 user nova-compute[71229]:  {{(pid=71229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 15:50:01 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-f5722d24-a958-4075-9d3a-08a19d3dbb22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Successfully detached device vdb from instance c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a from the persistent domain config.
Apr 11 15:50:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f5722d24-a958-4075-9d3a-08a19d3dbb22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a from the live domain config. {{(pid=71229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 15:50:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-f5722d24-a958-4075-9d3a-08a19d3dbb22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 15:50:01 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:50:01 user nova-compute[71229]:   <source dev="/dev/sdc"/>
Apr 11 15:50:01 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 15:50:01 user nova-compute[71229]:   <serial>a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3</serial>
Apr 11 15:50:01 user nova-compute[71229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 15:50:01 user nova-compute[71229]: </disk>
Apr 11 15:50:01 user nova-compute[71229]:  {{(pid=71229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 15:50:01 user nova-compute[71229]: DEBUG nova.network.neutron [req-30306ff6-d4c4-4fb0-a168-32eba509868d req-5443cc14-b4bd-4925-b3cb-6dae97bdc734 service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Updated VIF entry in instance network info cache for port 35ac8f6f-2998-4274-ab63-df7086194703. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:50:01 user nova-compute[71229]: DEBUG nova.network.neutron [req-30306ff6-d4c4-4fb0-a168-32eba509868d req-5443cc14-b4bd-4925-b3cb-6dae97bdc734 service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Updating instance_info_cache with network_info: [{"id": "35ac8f6f-2998-4274-ab63-df7086194703", "address": "fa:16:3e:47:3b:c6", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ac8f6f-29", "ovs_interfaceid": "35ac8f6f-2998-4274-ab63-df7086194703", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:50:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-30306ff6-d4c4-4fb0-a168-32eba509868d req-5443cc14-b4bd-4925-b3cb-6dae97bdc734 service nova] Releasing lock "refresh_cache-c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:50:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Received event <DeviceRemovedEvent: 1681228201.915303, c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71229) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 15:50:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f5722d24-a958-4075-9d3a-08a19d3dbb22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a {{(pid=71229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 15:50:01 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-f5722d24-a958-4075-9d3a-08a19d3dbb22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Successfully detached device vdb from instance c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a from the live domain config.
Apr 11 15:50:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5722d24-a958-4075-9d3a-08a19d3dbb22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 15:50:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5722d24-a958-4075-9d3a-08a19d3dbb22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bDuJPMck', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:50:01 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-f5722d24-a958-4075-9d3a-08a19d3dbb22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:50:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-f5722d24-a958-4075-9d3a-08a19d3dbb22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:50:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-f5722d24-a958-4075-9d3a-08a19d3dbb22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:50:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:50:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:50:01 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4070e95b-99c5-4ea7-8b86-e4dec36bef49]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:50:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5722d24-a958-4075-9d3a-08a19d3dbb22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 15:50:01 user nova-compute[71229]: No targets found.
Apr 11 15:50:01 user nova-compute[71229]: iSNS:
Apr 11 15:50:01 user nova-compute[71229]: No targets found.
Apr 11 15:50:01 user nova-compute[71229]: STATIC:
Apr 11 15:50:01 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3
Apr 11 15:50:01 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:50:01 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:50:01 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15
Apr 11 15:50:01 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:50:01 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:50:01 user nova-compute[71229]: FIRMWARE:
Apr 11 15:50:01 user nova-compute[71229]: No targets found.
Apr 11 15:50:01 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:50:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5722d24-a958-4075-9d3a-08a19d3dbb22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 15:50:01 user nova-compute[71229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 15:50:01 user nova-compute[71229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71229) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 15:50:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5722d24-a958-4075-9d3a-08a19d3dbb22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3', 0)] {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 15:50:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:50:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:50:01 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a98049-8a27-49fc-a4cd-801e16a91b4c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:50:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:50:01 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:50:01 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84a1a85-d337-42d8-b65b-499de7d16175]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:50:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5722d24-a958-4075-9d3a-08a19d3dbb22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 (non-flash)
Apr 11 15:50:01 user nova-compute[71229]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15 (non-flash)
Apr 11 15:50:01 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:50:01 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5722d24-a958-4075-9d3a-08a19d3dbb22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 (non-flash)
Apr 11 15:50:01 user nova-compute[71229]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15 (non-flash)
Apr 11 15:50:01 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:50:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5722d24-a958-4075-9d3a-08a19d3dbb22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb5c1440d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3'): ({'sdc'}, set())}) {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 15:50:02 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-f5722d24-a958-4075-9d3a-08a19d3dbb22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Removing single pathed devices sdc {{(pid=71229) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 15:50:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:50:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:50:02 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[959f37f3-84cd-406c-b5da-6d14eb53c1b5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:50:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:50:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:50:02 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a82a5d-8f9f-496e-8be3-d00b0c828ddb]: (4, ('ok\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:50:02 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-f5722d24-a958-4075-9d3a-08a19d3dbb22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Flushing IO for device /dev/sdc {{(pid=71229) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 15:50:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:50:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:50:02 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2d0f1d-f311-42c7-ac4a-9d4d75774c55]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:50:02 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-f5722d24-a958-4075-9d3a-08a19d3dbb22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71229) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 15:50:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:50:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.030s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:50:02 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2ef6fb-f5ab-4f59-a865-230242715f64]: (4, ('1', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:50:02 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-f5722d24-a958-4075-9d3a-08a19d3dbb22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 15:50:02 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-f5722d24-a958-4075-9d3a-08a19d3dbb22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] SCSI volumes sdc have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 15:50:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5722d24-a958-4075-9d3a-08a19d3dbb22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3')] {{(pid=71229) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 15:50:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:50:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:50:02 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[636809f9-7f25-4156-a799-6ba58f62ee3c]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:50:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5722d24-a958-4075-9d3a-08a19d3dbb22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:50:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 -p 172.16.0.220:3260 --logout {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:50:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:50:02 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3adbcbcd-505b-4107-b624-66aec5f9a742]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:50:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5722d24-a958-4075-9d3a-08a19d3dbb22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3, portal: 172.16.0.220,3260]
Apr 11 15:50:02 user nova-compute[71229]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3, portal: 172.16.0.220,3260] successful.
Apr 11 15:50:02 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:50:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 -p 172.16.0.220:3260 --op delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:50:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8ea32f0-5d92-45c4-b5e9-a79b9f76b7a3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:50:02 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e742c872-26e0-43b1-b7a1-7203f6474647]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:50:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5722d24-a958-4075-9d3a-08a19d3dbb22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:50:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-f5722d24-a958-4075-9d3a-08a19d3dbb22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:50:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5722d24-a958-4075-9d3a-08a19d3dbb22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] <== disconnect_volume: return (281ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:50:02 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5722d24-a958-4075-9d3a-08a19d3dbb22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 15:50:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:50:02 user nova-compute[71229]: DEBUG nova.objects.instance [None req-f5722d24-a958-4075-9d3a-08a19d3dbb22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lazy-loading 'flavor' on Instance uuid c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:50:02 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f5722d24-a958-4075-9d3a-08a19d3dbb22 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.628s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:50:03 user nova-compute[71229]: DEBUG nova.compute.manager [req-da131050-24c7-455a-b5d2-0d60a3f62d8d req-51cb630e-9857-4686-a046-c79414d91f69 service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Received event network-changed-35ac8f6f-2998-4274-ab63-df7086194703 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:50:03 user nova-compute[71229]: DEBUG nova.compute.manager [req-da131050-24c7-455a-b5d2-0d60a3f62d8d req-51cb630e-9857-4686-a046-c79414d91f69 service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Refreshing instance network info cache due to event network-changed-35ac8f6f-2998-4274-ab63-df7086194703. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:50:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-da131050-24c7-455a-b5d2-0d60a3f62d8d req-51cb630e-9857-4686-a046-c79414d91f69 service nova] Acquiring lock "refresh_cache-c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:50:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-da131050-24c7-455a-b5d2-0d60a3f62d8d req-51cb630e-9857-4686-a046-c79414d91f69 service nova] Acquired lock "refresh_cache-c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:50:03 user nova-compute[71229]: DEBUG nova.network.neutron [req-da131050-24c7-455a-b5d2-0d60a3f62d8d req-51cb630e-9857-4686-a046-c79414d91f69 service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Refreshing network info cache for port 35ac8f6f-2998-4274-ab63-df7086194703 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:50:03 user nova-compute[71229]: DEBUG nova.network.neutron [req-da131050-24c7-455a-b5d2-0d60a3f62d8d req-51cb630e-9857-4686-a046-c79414d91f69 service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Updated VIF entry in instance network info cache for port 35ac8f6f-2998-4274-ab63-df7086194703. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:50:03 user nova-compute[71229]: DEBUG nova.network.neutron [req-da131050-24c7-455a-b5d2-0d60a3f62d8d req-51cb630e-9857-4686-a046-c79414d91f69 service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Updating instance_info_cache with network_info: [{"id": "35ac8f6f-2998-4274-ab63-df7086194703", "address": "fa:16:3e:47:3b:c6", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ac8f6f-29", "ovs_interfaceid": "35ac8f6f-2998-4274-ab63-df7086194703", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:50:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-da131050-24c7-455a-b5d2-0d60a3f62d8d req-51cb630e-9857-4686-a046-c79414d91f69 service nova] Releasing lock "refresh_cache-c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:50:03 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:50:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:50:08 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:50:13 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:50:14 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:50:14 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 15:50:14 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "refresh_cache-c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:50:14 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquired lock "refresh_cache-c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:50:14 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Forcefully refreshing network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 15:50:15 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Updating instance_info_cache with network_info: [{"id": "35ac8f6f-2998-4274-ab63-df7086194703", "address": "fa:16:3e:47:3b:c6", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ac8f6f-29", "ovs_interfaceid": "35ac8f6f-2998-4274-ab63-df7086194703", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:50:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Releasing lock "refresh_cache-c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:50:15 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Updated the network info_cache for instance {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 15:50:15 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:50:15 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 15:50:15 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:50:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:50:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:50:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:50:15 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 15:50:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:50:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:50:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:50:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:50:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:50:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:50:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:50:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:50:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:50:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:50:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:50:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:50:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:50:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:50:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:50:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:50:17 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:50:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk.rescue --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:50:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:50:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk.rescue --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:50:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:50:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:50:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:50:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:50:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:50:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:50:18 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:50:18 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:50:18 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8491MB free_disk=25.880718231201172GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 15:50:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:50:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:50:18 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 6f6ae64a-c760-4ba3-8a50-d380835d9913 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:50:18 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 058df5ba-07ab-4bdd-9a47-907e7b0e0e59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:50:18 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:50:18 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance f0fc18ff-897c-4f97-95b6-9f25d11dba88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:50:18 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 15:50:18 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 15:50:18 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:50:18 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:50:18 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 15:50:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.294s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:50:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:50:19 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:50:19 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:50:20 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:50:21 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:50:21 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:50:21 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:50:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:50:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:50:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:50:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:50:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "507b2cc1-0a6c-4ae2-a254-3a991f495fe3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:50:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "507b2cc1-0a6c-4ae2-a254-3a991f495fe3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:50:32 user nova-compute[71229]: DEBUG nova.compute.manager [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Starting instance... {{(pid=71229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 15:50:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:50:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:50:33 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 15:50:33 user nova-compute[71229]: INFO nova.compute.claims [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Claim successful on node user
Apr 11 15:50:33 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:50:33 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:50:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.262s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:50:33 user nova-compute[71229]: DEBUG nova.compute.manager [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Start building networks asynchronously for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 15:50:33 user nova-compute[71229]: DEBUG nova.compute.manager [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Allocating IP information in the background. {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 15:50:33 user nova-compute[71229]: DEBUG nova.network.neutron [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] allocate_for_instance() {{(pid=71229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 15:50:33 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 15:50:33 user nova-compute[71229]: DEBUG nova.compute.manager [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Start building block device mappings for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 15:50:33 user nova-compute[71229]: INFO nova.virt.block_device [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Booting with volume 8e80be1f-47e3-4658-bdfe-610ca8e958a0 at /dev/vda
Apr 11 15:50:33 user nova-compute[71229]: DEBUG nova.policy [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c2110b74f38642afa560e1c9790d3f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312851c65ba1434691eca0cd2a8cd6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71229) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 15:50:33 user nova-compute[71229]: DEBUG os_brick.utils [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:50:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:50:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:50:33 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1362ab02-c477-4e4d-818e-a12df19d0fd6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d55e24a97c90\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:50:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:50:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:50:33 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1882eab5-0aad-42fd-8b6e-fe2d2ce2ca35]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:50:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:50:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:50:33 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe8a934-d656-4222-aac8-3910ab0d41fc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:50:33 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cbfe6d-1235-43be-9904-9ee55bcf1ac1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:50:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Running cmd (subprocess): nvme version {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:50:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 'nvme version' failed. Not Retrying. {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:50:33 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] nvme not present on system {{(pid=71229) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 15:50:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:50:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:50:33 user nova-compute[71229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 15:50:33 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf7adae-0f79-4777-97a3-83b9e5e9fbce]: (4, '') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:50:33 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71229) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 15:50:33 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 15:50:33 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] LIGHTOS: no hostnqn found. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 15:50:33 user nova-compute[71229]: DEBUG os_brick.utils [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d55e24a97c90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:50:33 user nova-compute[71229]: DEBUG nova.virt.block_device [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Updating existing volume attachment record: 145c1ff9-0cc7-436e-b5d8-b1dc3df84849 {{(pid=71229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 15:50:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:50:34 user nova-compute[71229]: DEBUG nova.network.neutron [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Successfully created port: ffa45d48-79f2-4055-bb7c-33172e34fb8b {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 15:50:34 user nova-compute[71229]: DEBUG nova.network.neutron [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Successfully updated port: ffa45d48-79f2-4055-bb7c-33172e34fb8b {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:50:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "refresh_cache-507b2cc1-0a6c-4ae2-a254-3a991f495fe3" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:50:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquired lock "refresh_cache-507b2cc1-0a6c-4ae2-a254-3a991f495fe3" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:50:34 user nova-compute[71229]: DEBUG nova.network.neutron [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:50:34 user nova-compute[71229]: DEBUG nova.compute.manager [req-3be2c4b1-e809-478b-8049-cf26e2fe1488 req-9d10919d-7739-4581-962a-c163df8e415e service nova] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Received event network-changed-ffa45d48-79f2-4055-bb7c-33172e34fb8b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:50:34 user nova-compute[71229]: DEBUG nova.compute.manager [req-3be2c4b1-e809-478b-8049-cf26e2fe1488 req-9d10919d-7739-4581-962a-c163df8e415e service nova] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Refreshing instance network info cache due to event network-changed-ffa45d48-79f2-4055-bb7c-33172e34fb8b. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:50:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3be2c4b1-e809-478b-8049-cf26e2fe1488 req-9d10919d-7739-4581-962a-c163df8e415e service nova] Acquiring lock "refresh_cache-507b2cc1-0a6c-4ae2-a254-3a991f495fe3" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:50:34 user nova-compute[71229]: DEBUG nova.network.neutron [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:50:35 user nova-compute[71229]: DEBUG nova.network.neutron [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Updating instance_info_cache with network_info: [{"id": "ffa45d48-79f2-4055-bb7c-33172e34fb8b", "address": "fa:16:3e:9a:29:b2", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa45d48-79", "ovs_interfaceid": "ffa45d48-79f2-4055-bb7c-33172e34fb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:50:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Releasing lock "refresh_cache-507b2cc1-0a6c-4ae2-a254-3a991f495fe3" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:50:35 user nova-compute[71229]: DEBUG nova.compute.manager [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Instance network_info: |[{"id": "ffa45d48-79f2-4055-bb7c-33172e34fb8b", "address": "fa:16:3e:9a:29:b2", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa45d48-79", "ovs_interfaceid": "ffa45d48-79f2-4055-bb7c-33172e34fb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 15:50:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3be2c4b1-e809-478b-8049-cf26e2fe1488 req-9d10919d-7739-4581-962a-c163df8e415e service nova] Acquired lock "refresh_cache-507b2cc1-0a6c-4ae2-a254-3a991f495fe3" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:50:35 user nova-compute[71229]: DEBUG nova.network.neutron [req-3be2c4b1-e809-478b-8049-cf26e2fe1488 req-9d10919d-7739-4581-962a-c163df8e415e service nova] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Refreshing network info cache for port ffa45d48-79f2-4055-bb7c-33172e34fb8b {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:50:35 user nova-compute[71229]: DEBUG nova.network.neutron [req-3be2c4b1-e809-478b-8049-cf26e2fe1488 req-9d10919d-7739-4581-962a-c163df8e415e service nova] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Updated VIF entry in instance network info cache for port ffa45d48-79f2-4055-bb7c-33172e34fb8b. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:50:35 user nova-compute[71229]: DEBUG nova.network.neutron [req-3be2c4b1-e809-478b-8049-cf26e2fe1488 req-9d10919d-7739-4581-962a-c163df8e415e service nova] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Updating instance_info_cache with network_info: [{"id": "ffa45d48-79f2-4055-bb7c-33172e34fb8b", "address": "fa:16:3e:9a:29:b2", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa45d48-79", "ovs_interfaceid": "ffa45d48-79f2-4055-bb7c-33172e34fb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:50:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3be2c4b1-e809-478b-8049-cf26e2fe1488 req-9d10919d-7739-4581-962a-c163df8e415e service nova] Releasing lock "refresh_cache-507b2cc1-0a6c-4ae2-a254-3a991f495fe3" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:50:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:50:37 user nova-compute[71229]: DEBUG nova.compute.manager [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Start spawning the instance on the hypervisor. {{(pid=71229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 15:50:37 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Creating instance directory {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 15:50:37 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Creating image(s)
Apr 11 15:50:37 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Did not create local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 15:50:37 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Ensure instance console log exists: /opt/stack/data/nova/instances/507b2cc1-0a6c-4ae2-a254-3a991f495fe3/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 15:50:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:50:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:50:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:50:37 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Start _get_guest_xml network_info=[{"id": "ffa45d48-79f2-4055-bb7c-33172e34fb8b", "address": "fa:16:3e:9a:29:b2", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa45d48-79", "ovs_interfaceid": "ffa45d48-79f2-4055-bb7c-33172e34fb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bYXCcZln', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '507b2cc1-0a6c-4ae2-a254-3a991f495fe3', 'attached_at': '', 'detached_at': '', 'volume_id': '8e80be1f-47e3-4658-bdfe-610ca8e958a0', 'serial': '8e80be1f-47e3-4658-bdfe-610ca8e958a0'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '145c1ff9-0cc7-436e-b5d8-b1dc3df84849', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:50:37 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:50:37 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:50:37 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:50:37 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:50:37 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:50:37 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:50:37 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:50:37 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:50:37 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:50:37 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:50:37 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:50:37 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:50:37 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:50:37 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:50:37 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 15:50:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bYXCcZln', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:50:37 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:50:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:50:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:50:37 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:50:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:50:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:50:37 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 15:50:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:50:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:50:37 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb500ea-737c-4008-a345-e87f23c6538b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:50:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 15:50:37 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:50:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:50:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:50:37 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be0626b-9674-4434-a407-1b0e97761eb2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0] added\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:50:37 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0] added
Apr 11 15:50:37 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:50:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:50:38 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:50:38 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c27c5b-12b0-48af-ab29-8b9fc5f81fa8]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:50:38 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:50:38 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:50:38 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:50:38 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d875ce64-3d28-4834-9e77-bd999afd3172]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:50:38 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:50:38 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bYXCcZln {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:50:38 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bYXCcZln" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:50:38 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be1db1e-a930-4615-926d-8293b72ee6b4]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:50:38 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bYXCcZln'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:50:38 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:50:38 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:50:38 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca104533-93a3-41de-bc4c-f1d7be15b990]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:50:38 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:50:38 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:50:38 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:50:38 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5306c886-c258-4dfb-a087-ce076e4b0280]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:50:38 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15 (non-flash)
Apr 11 15:50:38 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:50:38 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15 (non-flash)
Apr 11 15:50:38 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:50:38 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 -p 172.16.0.220:3260 --login {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:50:38 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:50:38 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d60378-2ee3-484e-8a87-e751608ced76]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:50:38 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0, portal: 172.16.0.220,3260]
Apr 11 15:50:38 user nova-compute[71229]: Login to [iface: default, target: iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0, portal: 172.16.0.220,3260] successful.
Apr 11 15:50:38 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:50:38 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:50:38 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:50:38 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[480a78b8-93e6-4253-b561-a8048ddad75f]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:50:38 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:50:38 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:50:38 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:50:38 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29cbfc7-ec7e-4e28-933f-8dff87aa0793]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:50:38 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15 (non-flash)
Apr 11 15:50:38 user nova-compute[71229]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 (non-flash)
Apr 11 15:50:38 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:50:38 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15 (non-flash)
Apr 11 15:50:38 user nova-compute[71229]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 (non-flash)
Apr 11 15:50:38 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:50:38 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:50:38 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 15:50:38 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 15:50:38 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 15:50:38 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:50:38 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:50:38 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8773a3-ddfa-42f4-a588-c496aeabed94]: (4, ('- - 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:50:38 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: None {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:50:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:50:39 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:50:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bYXCcZln', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 15:50:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:50:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '26361366139316636', 'path': '/dev/sdc'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:50:39 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361366139316636', 'path': '/dev/sdc'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 15:50:39 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:50:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1640081057',display_name='tempest-TestVolumeBootPattern-server-1640081057',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1640081057',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHFmBexXT+1iiEvWvrTBCCfLTFSZaBECTRUjU2HFOZ99DTdS224XqNm6W0NLu+fhNbtUG4d3cptal0K2Oy5ZbjfRTK7G/g++ylfyvf1YI+eSa1yX5tyMrdSO5dom9On9A==',key_name='tempest-TestVolumeBootPattern-1289860889',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='312851c65ba1434691eca0cd2a8cd6d2',ramdisk_id='',reservation_id='r-1n5tdizc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1933582504',owner_user_name='tempest-TestVolumeBootPattern-1933582504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:50:33Z,user_data=None,user_id='c2110b74f38642afa560e1c9790d3f81',uuid=507b2cc1-0a6c-4ae2-a254-3a991f495fe3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ffa45d48-79f2-4055-bb7c-33172e34fb8b", "address": "fa:16:3e:9a:29:b2", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa45d48-79", "ovs_interfaceid": "ffa45d48-79f2-4055-bb7c-33172e34fb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:50:39 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Converting VIF {"id": "ffa45d48-79f2-4055-bb7c-33172e34fb8b", "address": "fa:16:3e:9a:29:b2", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa45d48-79", "ovs_interfaceid": "ffa45d48-79f2-4055-bb7c-33172e34fb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:50:39 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:29:b2,bridge_name='br-int',has_traffic_filtering=True,id=ffa45d48-79f2-4055-bb7c-33172e34fb8b,network=Network(8d262ba8-b9c3-44ed-8431-6c295eb9ea24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffa45d48-79') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:50:39 user nova-compute[71229]: DEBUG nova.objects.instance [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lazy-loading 'pci_devices' on Instance uuid 507b2cc1-0a6c-4ae2-a254-3a991f495fe3 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:50:39 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:50:39 user nova-compute[71229]:   <uuid>507b2cc1-0a6c-4ae2-a254-3a991f495fe3</uuid>
Apr 11 15:50:39 user nova-compute[71229]:   <name>instance-00000025</name>
Apr 11 15:50:39 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:50:39 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:50:39 user nova-compute[71229]:   <metadata>
Apr 11 15:50:39 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:50:39 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:50:39 user nova-compute[71229]:       <nova:name>tempest-TestVolumeBootPattern-server-1640081057</nova:name>
Apr 11 15:50:39 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:50:37</nova:creationTime>
Apr 11 15:50:39 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:50:39 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:50:39 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:50:39 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:50:39 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:50:39 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:50:39 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:50:39 user nova-compute[71229]:       <nova:owner>
Apr 11 15:50:39 user nova-compute[71229]:         <nova:user uuid="c2110b74f38642afa560e1c9790d3f81">tempest-TestVolumeBootPattern-1933582504-project-member</nova:user>
Apr 11 15:50:39 user nova-compute[71229]:         <nova:project uuid="312851c65ba1434691eca0cd2a8cd6d2">tempest-TestVolumeBootPattern-1933582504</nova:project>
Apr 11 15:50:39 user nova-compute[71229]:       </nova:owner>
Apr 11 15:50:39 user nova-compute[71229]:       <nova:ports>
Apr 11 15:50:39 user nova-compute[71229]:         <nova:port uuid="ffa45d48-79f2-4055-bb7c-33172e34fb8b">
Apr 11 15:50:39 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 11 15:50:39 user nova-compute[71229]:         </nova:port>
Apr 11 15:50:39 user nova-compute[71229]:       </nova:ports>
Apr 11 15:50:39 user nova-compute[71229]:     </nova:instance>
Apr 11 15:50:39 user nova-compute[71229]:   </metadata>
Apr 11 15:50:39 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:50:39 user nova-compute[71229]:     <system>
Apr 11 15:50:39 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:50:39 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:50:39 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:50:39 user nova-compute[71229]:       <entry name="serial">507b2cc1-0a6c-4ae2-a254-3a991f495fe3</entry>
Apr 11 15:50:39 user nova-compute[71229]:       <entry name="uuid">507b2cc1-0a6c-4ae2-a254-3a991f495fe3</entry>
Apr 11 15:50:39 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:50:39 user nova-compute[71229]:     </system>
Apr 11 15:50:39 user nova-compute[71229]:   </sysinfo>
Apr 11 15:50:39 user nova-compute[71229]:   <os>
Apr 11 15:50:39 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:50:39 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 15:50:39 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:50:39 user nova-compute[71229]:   </os>
Apr 11 15:50:39 user nova-compute[71229]:   <features>
Apr 11 15:50:39 user nova-compute[71229]:     <acpi/>
Apr 11 15:50:39 user nova-compute[71229]:     <apic/>
Apr 11 15:50:39 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:50:39 user nova-compute[71229]:   </features>
Apr 11 15:50:39 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:50:39 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:50:39 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:50:39 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:50:39 user nova-compute[71229]:   </clock>
Apr 11 15:50:39 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:50:39 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:50:39 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:50:39 user nova-compute[71229]:   </cpu>
Apr 11 15:50:39 user nova-compute[71229]:   <devices>
Apr 11 15:50:39 user nova-compute[71229]:     <disk type="block" device="disk">
Apr 11 15:50:39 user nova-compute[71229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:50:39 user nova-compute[71229]:       <source dev="/dev/sdc"/>
Apr 11 15:50:39 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:50:39 user nova-compute[71229]:       <serial>8e80be1f-47e3-4658-bdfe-610ca8e958a0</serial>
Apr 11 15:50:39 user nova-compute[71229]:     </disk>
Apr 11 15:50:39 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:50:39 user nova-compute[71229]:       <mac address="fa:16:3e:9a:29:b2"/>
Apr 11 15:50:39 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:50:39 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:50:39 user nova-compute[71229]:       <target dev="tapffa45d48-79"/>
Apr 11 15:50:39 user nova-compute[71229]:     </interface>
Apr 11 15:50:39 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:50:39 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/507b2cc1-0a6c-4ae2-a254-3a991f495fe3/console.log" append="off"/>
Apr 11 15:50:39 user nova-compute[71229]:     </serial>
Apr 11 15:50:39 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:50:39 user nova-compute[71229]:     <video>
Apr 11 15:50:39 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:50:39 user nova-compute[71229]:     </video>
Apr 11 15:50:39 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:50:39 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:50:39 user nova-compute[71229]:     </rng>
Apr 11 15:50:39 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:50:39 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:50:39 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:50:39 user nova-compute[71229]:     </memballoon>
Apr 11 15:50:39 user nova-compute[71229]:   </devices>
Apr 11 15:50:39 user nova-compute[71229]: </domain>
Apr 11 15:50:39 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:50:39 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:50:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1640081057',display_name='tempest-TestVolumeBootPattern-server-1640081057',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1640081057',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHFmBexXT+1iiEvWvrTBCCfLTFSZaBECTRUjU2HFOZ99DTdS224XqNm6W0NLu+fhNbtUG4d3cptal0K2Oy5ZbjfRTK7G/g++ylfyvf1YI+eSa1yX5tyMrdSO5dom9On9A==',key_name='tempest-TestVolumeBootPattern-1289860889',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='312851c65ba1434691eca0cd2a8cd6d2',ramdisk_id='',reservation_id='r-1n5tdizc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1933582504',owner_user_name='tempest-TestVolumeBootPattern-1933582504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:50:33Z,user_data=None,user_id='c2110b74f38642afa560e1c9790d3f81',uuid=507b2cc1-0a6c-4ae2-a254-3a991f495fe3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ffa45d48-79f2-4055-bb7c-33172e34fb8b", "address": "fa:16:3e:9a:29:b2", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa45d48-79", "ovs_interfaceid": "ffa45d48-79f2-4055-bb7c-33172e34fb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:50:39 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Converting VIF {"id": "ffa45d48-79f2-4055-bb7c-33172e34fb8b", "address": "fa:16:3e:9a:29:b2", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa45d48-79", "ovs_interfaceid": "ffa45d48-79f2-4055-bb7c-33172e34fb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:50:39 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:29:b2,bridge_name='br-int',has_traffic_filtering=True,id=ffa45d48-79f2-4055-bb7c-33172e34fb8b,network=Network(8d262ba8-b9c3-44ed-8431-6c295eb9ea24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffa45d48-79') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:50:39 user nova-compute[71229]: DEBUG os_vif [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:29:b2,bridge_name='br-int',has_traffic_filtering=True,id=ffa45d48-79f2-4055-bb7c-33172e34fb8b,network=Network(8d262ba8-b9c3-44ed-8431-6c295eb9ea24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffa45d48-79') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:50:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:50:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:50:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:50:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:50:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapffa45d48-79, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:50:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapffa45d48-79, col_values=(('external_ids', {'iface-id': 'ffa45d48-79f2-4055-bb7c-33172e34fb8b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:29:b2', 'vm-uuid': '507b2cc1-0a6c-4ae2-a254-3a991f495fe3'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:50:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:50:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:50:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:50:39 user nova-compute[71229]: INFO os_vif [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:29:b2,bridge_name='br-int',has_traffic_filtering=True,id=ffa45d48-79f2-4055-bb7c-33172e34fb8b,network=Network(8d262ba8-b9c3-44ed-8431-6c295eb9ea24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffa45d48-79')
Apr 11 15:50:39 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:50:39 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] No VIF found with MAC fa:16:3e:9a:29:b2, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:50:40 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:50:40 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:50:40 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:50:40 user nova-compute[71229]: DEBUG nova.compute.manager [req-bfb5d7db-9dda-4c29-bcad-1e3fcc064146 req-da3868cb-e107-4083-90c1-4b225d85d9f6 service nova] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Received event network-vif-plugged-ffa45d48-79f2-4055-bb7c-33172e34fb8b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:50:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-bfb5d7db-9dda-4c29-bcad-1e3fcc064146 req-da3868cb-e107-4083-90c1-4b225d85d9f6 service nova] Acquiring lock "507b2cc1-0a6c-4ae2-a254-3a991f495fe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:50:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-bfb5d7db-9dda-4c29-bcad-1e3fcc064146 req-da3868cb-e107-4083-90c1-4b225d85d9f6 service nova] Lock "507b2cc1-0a6c-4ae2-a254-3a991f495fe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:50:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-bfb5d7db-9dda-4c29-bcad-1e3fcc064146 req-da3868cb-e107-4083-90c1-4b225d85d9f6 service nova] Lock "507b2cc1-0a6c-4ae2-a254-3a991f495fe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:50:40 user nova-compute[71229]: DEBUG nova.compute.manager [req-bfb5d7db-9dda-4c29-bcad-1e3fcc064146 req-da3868cb-e107-4083-90c1-4b225d85d9f6 service nova] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] No waiting events found dispatching network-vif-plugged-ffa45d48-79f2-4055-bb7c-33172e34fb8b {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:50:40 user nova-compute[71229]: WARNING nova.compute.manager [req-bfb5d7db-9dda-4c29-bcad-1e3fcc064146 req-da3868cb-e107-4083-90c1-4b225d85d9f6 service nova] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Received unexpected event network-vif-plugged-ffa45d48-79f2-4055-bb7c-33172e34fb8b for instance with vm_state building and task_state spawning.
Apr 11 15:50:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:50:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:50:42 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:50:42 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681228242.6675932, 507b2cc1-0a6c-4ae2-a254-3a991f495fe3 => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:50:42 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] VM Resumed (Lifecycle Event)
Apr 11 15:50:42 user nova-compute[71229]: DEBUG nova.compute.manager [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 15:50:42 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Guest created on hypervisor {{(pid=71229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 15:50:42 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Instance spawned successfully.
Apr 11 15:50:42 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 15:50:42 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:50:42 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:50:42 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Found default for hw_cdrom_bus of ide {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:50:42 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Found default for hw_disk_bus of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:50:42 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Found default for hw_input_bus of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:50:42 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Found default for hw_pointer_model of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:50:42 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Found default for hw_video_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:50:42 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Found default for hw_vif_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:50:42 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:50:42 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681228242.672088, 507b2cc1-0a6c-4ae2-a254-3a991f495fe3 => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:50:42 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] VM Started (Lifecycle Event)
Apr 11 15:50:42 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:50:42 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:50:42 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:50:42 user nova-compute[71229]: INFO nova.compute.manager [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Took 4.88 seconds to spawn the instance on the hypervisor.
Apr 11 15:50:42 user nova-compute[71229]: DEBUG nova.compute.manager [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:50:42 user nova-compute[71229]: INFO nova.compute.manager [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Took 9.87 seconds to build instance.
Apr 11 15:50:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-87c6eeb4-a739-4caa-a849-b713cbcab53e tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "507b2cc1-0a6c-4ae2-a254-3a991f495fe3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.967s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:50:42 user nova-compute[71229]: DEBUG nova.compute.manager [req-2a2540d1-f95f-4726-8978-85e2f130dc07 req-ffa57237-5a2a-44f5-899b-86048f1c5c89 service nova] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Received event network-vif-plugged-ffa45d48-79f2-4055-bb7c-33172e34fb8b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:50:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2a2540d1-f95f-4726-8978-85e2f130dc07 req-ffa57237-5a2a-44f5-899b-86048f1c5c89 service nova] Acquiring lock "507b2cc1-0a6c-4ae2-a254-3a991f495fe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:50:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2a2540d1-f95f-4726-8978-85e2f130dc07 req-ffa57237-5a2a-44f5-899b-86048f1c5c89 service nova] Lock "507b2cc1-0a6c-4ae2-a254-3a991f495fe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:50:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2a2540d1-f95f-4726-8978-85e2f130dc07 req-ffa57237-5a2a-44f5-899b-86048f1c5c89 service nova] Lock "507b2cc1-0a6c-4ae2-a254-3a991f495fe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:50:42 user nova-compute[71229]: DEBUG nova.compute.manager [req-2a2540d1-f95f-4726-8978-85e2f130dc07 req-ffa57237-5a2a-44f5-899b-86048f1c5c89 service nova] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] No waiting events found dispatching network-vif-plugged-ffa45d48-79f2-4055-bb7c-33172e34fb8b {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:50:42 user nova-compute[71229]: WARNING nova.compute.manager [req-2a2540d1-f95f-4726-8978-85e2f130dc07 req-ffa57237-5a2a-44f5-899b-86048f1c5c89 service nova] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Received unexpected event network-vif-plugged-ffa45d48-79f2-4055-bb7c-33172e34fb8b for instance with vm_state active and task_state None.
Apr 11 15:50:44 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:50:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:50:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:50:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f8d70d11-989f-4b06-a14e-144e9bbad632 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:50:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f8d70d11-989f-4b06-a14e-144e9bbad632 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:50:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f8d70d11-989f-4b06-a14e-144e9bbad632 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:50:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f8d70d11-989f-4b06-a14e-144e9bbad632 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:50:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f8d70d11-989f-4b06-a14e-144e9bbad632 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:50:51 user nova-compute[71229]: INFO nova.compute.manager [None req-f8d70d11-989f-4b06-a14e-144e9bbad632 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Terminating instance
Apr 11 15:50:51 user nova-compute[71229]: DEBUG nova.compute.manager [None req-f8d70d11-989f-4b06-a14e-144e9bbad632 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Start destroying the instance on the hypervisor. {{(pid=71229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 15:50:51 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:50:51 user nova-compute[71229]: DEBUG nova.compute.manager [req-f5c7e041-f514-4113-9d81-584f763353e6 req-2ee842d1-3293-434d-abe3-ec14fba1c10e service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Received event network-vif-unplugged-35ac8f6f-2998-4274-ab63-df7086194703 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:50:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-f5c7e041-f514-4113-9d81-584f763353e6 req-2ee842d1-3293-434d-abe3-ec14fba1c10e service nova] Acquiring lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:50:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-f5c7e041-f514-4113-9d81-584f763353e6 req-2ee842d1-3293-434d-abe3-ec14fba1c10e service nova] Lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:50:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-f5c7e041-f514-4113-9d81-584f763353e6 req-2ee842d1-3293-434d-abe3-ec14fba1c10e service nova] Lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:50:51 user nova-compute[71229]: DEBUG nova.compute.manager [req-f5c7e041-f514-4113-9d81-584f763353e6 req-2ee842d1-3293-434d-abe3-ec14fba1c10e service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] No waiting events found dispatching network-vif-unplugged-35ac8f6f-2998-4274-ab63-df7086194703 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:50:51 user nova-compute[71229]: DEBUG nova.compute.manager [req-f5c7e041-f514-4113-9d81-584f763353e6 req-2ee842d1-3293-434d-abe3-ec14fba1c10e service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Received event network-vif-unplugged-35ac8f6f-2998-4274-ab63-df7086194703 for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 15:50:52 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:50:52 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:50:52 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Instance destroyed successfully.
Apr 11 15:50:52 user nova-compute[71229]: DEBUG nova.objects.instance [None req-f8d70d11-989f-4b06-a14e-144e9bbad632 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lazy-loading 'resources' on Instance uuid c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:50:52 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-f8d70d11-989f-4b06-a14e-144e9bbad632 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:44:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1921913590',display_name='tempest-ServerRescueNegativeTestJSON-server-1921913590',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1921913590',id=33,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPYdVbZDtC1igDufA6PhMZJpvm+SfaXlWlDTwlgCYAsIhgsTCFIatXSmQzAx4qEEtvrM9m6Ml8tgUz/SNa6YjJmdUHImSQvQGbvvCZehYMuZMwW6pbpX8JfbeU5smcaBw==',key_name='tempest-keypair-1367691795',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:46:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d700a53aa25849e0afd562b05881d09a',ramdisk_id='',reservation_id='r-kvyblfid',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1491000769',owner_user_name='tempest-ServerRescueNegativeTestJSON-1491000769-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:48:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c8492f96e5d4f54aaae3679c82b6759',uuid=c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35ac8f6f-2998-4274-ab63-df7086194703", "address": "fa:16:3e:47:3b:c6", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ac8f6f-29", "ovs_interfaceid": "35ac8f6f-2998-4274-ab63-df7086194703", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:50:52 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-f8d70d11-989f-4b06-a14e-144e9bbad632 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Converting VIF {"id": "35ac8f6f-2998-4274-ab63-df7086194703", "address": "fa:16:3e:47:3b:c6", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ac8f6f-29", "ovs_interfaceid": "35ac8f6f-2998-4274-ab63-df7086194703", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:50:52 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-f8d70d11-989f-4b06-a14e-144e9bbad632 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:3b:c6,bridge_name='br-int',has_traffic_filtering=True,id=35ac8f6f-2998-4274-ab63-df7086194703,network=Network(7ba20249-9c62-46d7-810c-8144c1a1f17e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35ac8f6f-29') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:50:52 user nova-compute[71229]: DEBUG os_vif [None req-f8d70d11-989f-4b06-a14e-144e9bbad632 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:3b:c6,bridge_name='br-int',has_traffic_filtering=True,id=35ac8f6f-2998-4274-ab63-df7086194703,network=Network(7ba20249-9c62-46d7-810c-8144c1a1f17e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35ac8f6f-29') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:50:52 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:50:52 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap35ac8f6f-29, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:50:52 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:50:52 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:50:52 user nova-compute[71229]: INFO os_vif [None req-f8d70d11-989f-4b06-a14e-144e9bbad632 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:3b:c6,bridge_name='br-int',has_traffic_filtering=True,id=35ac8f6f-2998-4274-ab63-df7086194703,network=Network(7ba20249-9c62-46d7-810c-8144c1a1f17e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35ac8f6f-29')
Apr 11 15:50:52 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-f8d70d11-989f-4b06-a14e-144e9bbad632 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Deleting instance files /opt/stack/data/nova/instances/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a_del
Apr 11 15:50:52 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-f8d70d11-989f-4b06-a14e-144e9bbad632 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Deletion of /opt/stack/data/nova/instances/c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a_del complete
Apr 11 15:50:52 user nova-compute[71229]: INFO nova.compute.manager [None req-f8d70d11-989f-4b06-a14e-144e9bbad632 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Took 0.84 seconds to destroy the instance on the hypervisor.
Apr 11 15:50:52 user nova-compute[71229]: DEBUG oslo.service.loopingcall [None req-f8d70d11-989f-4b06-a14e-144e9bbad632 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71229) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 15:50:52 user nova-compute[71229]: DEBUG nova.compute.manager [-] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Deallocating network for instance {{(pid=71229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 15:50:52 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] deallocate_for_instance() {{(pid=71229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 15:50:53 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:50:53 user nova-compute[71229]: DEBUG nova.compute.manager [req-8e77c1c1-65bb-4146-a203-6f603a58d060 req-60e1a26c-5339-4c83-8fa8-0d90e93d92a4 service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Received event network-vif-deleted-35ac8f6f-2998-4274-ab63-df7086194703 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:50:53 user nova-compute[71229]: INFO nova.compute.manager [req-8e77c1c1-65bb-4146-a203-6f603a58d060 req-60e1a26c-5339-4c83-8fa8-0d90e93d92a4 service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Neutron deleted interface 35ac8f6f-2998-4274-ab63-df7086194703; detaching it from the instance and deleting it from the info cache
Apr 11 15:50:53 user nova-compute[71229]: DEBUG nova.network.neutron [req-8e77c1c1-65bb-4146-a203-6f603a58d060 req-60e1a26c-5339-4c83-8fa8-0d90e93d92a4 service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:50:53 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Took 0.98 seconds to deallocate network for instance.
Apr 11 15:50:53 user nova-compute[71229]: DEBUG nova.compute.manager [req-8e77c1c1-65bb-4146-a203-6f603a58d060 req-60e1a26c-5339-4c83-8fa8-0d90e93d92a4 service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Detach interface failed, port_id=35ac8f6f-2998-4274-ab63-df7086194703, reason: Instance c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a could not be found. {{(pid=71229) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 15:50:53 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f8d70d11-989f-4b06-a14e-144e9bbad632 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:50:53 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f8d70d11-989f-4b06-a14e-144e9bbad632 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:50:53 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-f8d70d11-989f-4b06-a14e-144e9bbad632 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:50:53 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-f8d70d11-989f-4b06-a14e-144e9bbad632 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:50:53 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f8d70d11-989f-4b06-a14e-144e9bbad632 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.217s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:50:53 user nova-compute[71229]: INFO nova.scheduler.client.report [None req-f8d70d11-989f-4b06-a14e-144e9bbad632 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Deleted allocations for instance c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a
Apr 11 15:50:53 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f8d70d11-989f-4b06-a14e-144e9bbad632 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.225s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:50:54 user nova-compute[71229]: DEBUG nova.compute.manager [req-8bd98c50-71b5-4c86-b781-28a87b719cf9 req-f72905a2-2027-4a2d-86c7-5fd31446607a service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Received event network-vif-plugged-35ac8f6f-2998-4274-ab63-df7086194703 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:50:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-8bd98c50-71b5-4c86-b781-28a87b719cf9 req-f72905a2-2027-4a2d-86c7-5fd31446607a service nova] Acquiring lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:50:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-8bd98c50-71b5-4c86-b781-28a87b719cf9 req-f72905a2-2027-4a2d-86c7-5fd31446607a service nova] Lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:50:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-8bd98c50-71b5-4c86-b781-28a87b719cf9 req-f72905a2-2027-4a2d-86c7-5fd31446607a service nova] Lock "c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:50:54 user nova-compute[71229]: DEBUG nova.compute.manager [req-8bd98c50-71b5-4c86-b781-28a87b719cf9 req-f72905a2-2027-4a2d-86c7-5fd31446607a service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] No waiting events found dispatching network-vif-plugged-35ac8f6f-2998-4274-ab63-df7086194703 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:50:54 user nova-compute[71229]: WARNING nova.compute.manager [req-8bd98c50-71b5-4c86-b781-28a87b719cf9 req-f72905a2-2027-4a2d-86c7-5fd31446607a service nova] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Received unexpected event network-vif-plugged-35ac8f6f-2998-4274-ab63-df7086194703 for instance with vm_state deleted and task_state None.
Apr 11 15:50:57 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:50:57 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:51:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:51:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:51:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:51:07 user nova-compute[71229]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681228252.4782252, c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a => Stopped> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:51:07 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] VM Stopped (Lifecycle Event)
Apr 11 15:51:07 user nova-compute[71229]: DEBUG nova.compute.manager [None req-3094ea48-1918-4e14-a2c4-fd3d7c9af7a2 None None] [instance: c3c9c831-aae8-4af7-9bfd-cfddcd9ef88a] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:51:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:51:12 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:51:12 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:51:15 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:51:15 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 15:51:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "refresh_cache-f0fc18ff-897c-4f97-95b6-9f25d11dba88" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:51:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquired lock "refresh_cache-f0fc18ff-897c-4f97-95b6-9f25d11dba88" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:51:15 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Forcefully refreshing network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 15:51:16 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Updating instance_info_cache with network_info: [{"id": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01", "address": "fa:16:3e:39:51:c6", "network": {"id": "81031696-fd25-42a1-8c36-43a6eacbab12", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1627850915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c9dbdbc7b641f096dc292ea7bf7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf0cc1bf-40", "ovs_interfaceid": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:51:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Releasing lock "refresh_cache-f0fc18ff-897c-4f97-95b6-9f25d11dba88" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:51:16 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Updated the network info_cache for instance {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 15:51:16 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:51:16 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 15:51:16 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:51:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:51:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:51:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:51:16 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 15:51:16 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:51:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:51:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:51:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:51:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk.rescue --force-share --output=json" returned: 0 in 0.162s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:51:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:51:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:51:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:51:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:51:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:51:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:51:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:51:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:51:17 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:51:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk.rescue --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:51:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:51:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk.rescue --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:51:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:51:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:51:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:51:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:51:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:51:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:51:18 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:51:18 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:51:18 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8529MB free_disk=25.898204803466797GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 15:51:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:51:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:51:18 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 6f6ae64a-c760-4ba3-8a50-d380835d9913 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:51:18 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 058df5ba-07ab-4bdd-9a47-907e7b0e0e59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:51:18 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance f0fc18ff-897c-4f97-95b6-9f25d11dba88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:51:18 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 507b2cc1-0a6c-4ae2-a254-3a991f495fe3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:51:18 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 15:51:18 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 15:51:18 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:51:18 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:51:18 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 15:51:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.504s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:51:20 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:51:20 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:51:21 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:51:21 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:51:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:51:23 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:51:23 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:51:27 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:51:27 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:51:31 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:51:32 user nova-compute[71229]: INFO nova.compute.manager [None req-46312f2f-47b1-4c61-91d4-6b109b93b558 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Unrescuing
Apr 11 15:51:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-46312f2f-47b1-4c61-91d4-6b109b93b558 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "refresh_cache-f0fc18ff-897c-4f97-95b6-9f25d11dba88" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:51:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-46312f2f-47b1-4c61-91d4-6b109b93b558 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquired lock "refresh_cache-f0fc18ff-897c-4f97-95b6-9f25d11dba88" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:51:32 user nova-compute[71229]: DEBUG nova.network.neutron [None req-46312f2f-47b1-4c61-91d4-6b109b93b558 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:51:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:51:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:51:33 user nova-compute[71229]: DEBUG nova.network.neutron [None req-46312f2f-47b1-4c61-91d4-6b109b93b558 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Updating instance_info_cache with network_info: [{"id": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01", "address": "fa:16:3e:39:51:c6", "network": {"id": "81031696-fd25-42a1-8c36-43a6eacbab12", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1627850915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c9dbdbc7b641f096dc292ea7bf7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf0cc1bf-40", "ovs_interfaceid": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:51:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-46312f2f-47b1-4c61-91d4-6b109b93b558 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Releasing lock "refresh_cache-f0fc18ff-897c-4f97-95b6-9f25d11dba88" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:51:33 user nova-compute[71229]: DEBUG nova.objects.instance [None req-46312f2f-47b1-4c61-91d4-6b109b93b558 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lazy-loading 'flavor' on Instance uuid f0fc18ff-897c-4f97-95b6-9f25d11dba88 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:51:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:51:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:51:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:51:33 user nova-compute[71229]: DEBUG nova.compute.manager [req-634133a4-e715-418a-8e00-b7b7e8b179ba req-baeca020-196e-4306-8fbb-a12dcbf1e8e0 service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Received event network-changed-cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:51:33 user nova-compute[71229]: DEBUG nova.compute.manager [req-634133a4-e715-418a-8e00-b7b7e8b179ba req-baeca020-196e-4306-8fbb-a12dcbf1e8e0 service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Refreshing instance network info cache due to event network-changed-cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:51:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-634133a4-e715-418a-8e00-b7b7e8b179ba req-baeca020-196e-4306-8fbb-a12dcbf1e8e0 service nova] Acquiring lock "refresh_cache-f0fc18ff-897c-4f97-95b6-9f25d11dba88" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:51:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-634133a4-e715-418a-8e00-b7b7e8b179ba req-baeca020-196e-4306-8fbb-a12dcbf1e8e0 service nova] Acquired lock "refresh_cache-f0fc18ff-897c-4f97-95b6-9f25d11dba88" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:51:33 user nova-compute[71229]: DEBUG nova.network.neutron [req-634133a4-e715-418a-8e00-b7b7e8b179ba req-baeca020-196e-4306-8fbb-a12dcbf1e8e0 service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Refreshing network info cache for port cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:51:33 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Instance destroyed successfully.
Apr 11 15:51:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:51:34 user nova-compute[71229]: DEBUG nova.network.neutron [req-634133a4-e715-418a-8e00-b7b7e8b179ba req-baeca020-196e-4306-8fbb-a12dcbf1e8e0 service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Updated VIF entry in instance network info cache for port cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:51:34 user nova-compute[71229]: DEBUG nova.network.neutron [req-634133a4-e715-418a-8e00-b7b7e8b179ba req-baeca020-196e-4306-8fbb-a12dcbf1e8e0 service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Updating instance_info_cache with network_info: [{"id": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01", "address": "fa:16:3e:39:51:c6", "network": {"id": "81031696-fd25-42a1-8c36-43a6eacbab12", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1627850915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c9dbdbc7b641f096dc292ea7bf7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf0cc1bf-40", "ovs_interfaceid": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:51:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-634133a4-e715-418a-8e00-b7b7e8b179ba req-baeca020-196e-4306-8fbb-a12dcbf1e8e0 service nova] Releasing lock "refresh_cache-f0fc18ff-897c-4f97-95b6-9f25d11dba88" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:51:34 user nova-compute[71229]: DEBUG nova.compute.manager [req-634133a4-e715-418a-8e00-b7b7e8b179ba req-baeca020-196e-4306-8fbb-a12dcbf1e8e0 service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Received event network-vif-unplugged-cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:51:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-634133a4-e715-418a-8e00-b7b7e8b179ba req-baeca020-196e-4306-8fbb-a12dcbf1e8e0 service nova] Acquiring lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:51:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-634133a4-e715-418a-8e00-b7b7e8b179ba req-baeca020-196e-4306-8fbb-a12dcbf1e8e0 service nova] Lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:51:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-634133a4-e715-418a-8e00-b7b7e8b179ba req-baeca020-196e-4306-8fbb-a12dcbf1e8e0 service nova] Lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:51:34 user nova-compute[71229]: DEBUG nova.compute.manager [req-634133a4-e715-418a-8e00-b7b7e8b179ba req-baeca020-196e-4306-8fbb-a12dcbf1e8e0 service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] No waiting events found dispatching network-vif-unplugged-cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:51:34 user nova-compute[71229]: WARNING nova.compute.manager [req-634133a4-e715-418a-8e00-b7b7e8b179ba req-baeca020-196e-4306-8fbb-a12dcbf1e8e0 service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Received unexpected event network-vif-unplugged-cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 for instance with vm_state rescued and task_state unrescuing.
Apr 11 15:51:35 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:51:35 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:51:35 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:51:35 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:51:35 user nova-compute[71229]: DEBUG nova.compute.manager [req-75c038ee-21ef-4cc7-92bf-69d32d1d2562 req-b2b23dee-6eff-4a8b-87fc-fc3d76682b78 service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Received event network-changed-cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:51:35 user nova-compute[71229]: DEBUG nova.compute.manager [req-75c038ee-21ef-4cc7-92bf-69d32d1d2562 req-b2b23dee-6eff-4a8b-87fc-fc3d76682b78 service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Refreshing instance network info cache due to event network-changed-cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:51:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-75c038ee-21ef-4cc7-92bf-69d32d1d2562 req-b2b23dee-6eff-4a8b-87fc-fc3d76682b78 service nova] Acquiring lock "refresh_cache-f0fc18ff-897c-4f97-95b6-9f25d11dba88" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:51:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-75c038ee-21ef-4cc7-92bf-69d32d1d2562 req-b2b23dee-6eff-4a8b-87fc-fc3d76682b78 service nova] Acquired lock "refresh_cache-f0fc18ff-897c-4f97-95b6-9f25d11dba88" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:51:35 user nova-compute[71229]: DEBUG nova.network.neutron [req-75c038ee-21ef-4cc7-92bf-69d32d1d2562 req-b2b23dee-6eff-4a8b-87fc-fc3d76682b78 service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Refreshing network info cache for port cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:51:35 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:51:35 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:51:35 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:51:35 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:51:35 user nova-compute[71229]: DEBUG nova.network.neutron [req-75c038ee-21ef-4cc7-92bf-69d32d1d2562 req-b2b23dee-6eff-4a8b-87fc-fc3d76682b78 service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Updated VIF entry in instance network info cache for port cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:51:35 user nova-compute[71229]: DEBUG nova.network.neutron [req-75c038ee-21ef-4cc7-92bf-69d32d1d2562 req-b2b23dee-6eff-4a8b-87fc-fc3d76682b78 service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Updating instance_info_cache with network_info: [{"id": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01", "address": "fa:16:3e:39:51:c6", "network": {"id": "81031696-fd25-42a1-8c36-43a6eacbab12", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1627850915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c9dbdbc7b641f096dc292ea7bf7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf0cc1bf-40", "ovs_interfaceid": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:51:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-75c038ee-21ef-4cc7-92bf-69d32d1d2562 req-b2b23dee-6eff-4a8b-87fc-fc3d76682b78 service nova] Releasing lock "refresh_cache-f0fc18ff-897c-4f97-95b6-9f25d11dba88" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:51:36 user nova-compute[71229]: DEBUG nova.compute.manager [req-75c038ee-21ef-4cc7-92bf-69d32d1d2562 req-b2b23dee-6eff-4a8b-87fc-fc3d76682b78 service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Received event network-vif-plugged-cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:51:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-75c038ee-21ef-4cc7-92bf-69d32d1d2562 req-b2b23dee-6eff-4a8b-87fc-fc3d76682b78 service nova] Acquiring lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:51:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-75c038ee-21ef-4cc7-92bf-69d32d1d2562 req-b2b23dee-6eff-4a8b-87fc-fc3d76682b78 service nova] Lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:51:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-75c038ee-21ef-4cc7-92bf-69d32d1d2562 req-b2b23dee-6eff-4a8b-87fc-fc3d76682b78 service nova] Lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:51:36 user nova-compute[71229]: DEBUG nova.compute.manager [req-75c038ee-21ef-4cc7-92bf-69d32d1d2562 req-b2b23dee-6eff-4a8b-87fc-fc3d76682b78 service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] No waiting events found dispatching network-vif-plugged-cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:51:36 user nova-compute[71229]: WARNING nova.compute.manager [req-75c038ee-21ef-4cc7-92bf-69d32d1d2562 req-b2b23dee-6eff-4a8b-87fc-fc3d76682b78 service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Received unexpected event network-vif-plugged-cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 for instance with vm_state rescued and task_state unrescuing.
Apr 11 15:51:36 user nova-compute[71229]: DEBUG nova.compute.manager [req-75c038ee-21ef-4cc7-92bf-69d32d1d2562 req-b2b23dee-6eff-4a8b-87fc-fc3d76682b78 service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Received event network-vif-plugged-cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:51:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-75c038ee-21ef-4cc7-92bf-69d32d1d2562 req-b2b23dee-6eff-4a8b-87fc-fc3d76682b78 service nova] Acquiring lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:51:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-75c038ee-21ef-4cc7-92bf-69d32d1d2562 req-b2b23dee-6eff-4a8b-87fc-fc3d76682b78 service nova] Lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:51:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-75c038ee-21ef-4cc7-92bf-69d32d1d2562 req-b2b23dee-6eff-4a8b-87fc-fc3d76682b78 service nova] Lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:51:36 user nova-compute[71229]: DEBUG nova.compute.manager [req-75c038ee-21ef-4cc7-92bf-69d32d1d2562 req-b2b23dee-6eff-4a8b-87fc-fc3d76682b78 service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] No waiting events found dispatching network-vif-plugged-cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:51:36 user nova-compute[71229]: WARNING nova.compute.manager [req-75c038ee-21ef-4cc7-92bf-69d32d1d2562 req-b2b23dee-6eff-4a8b-87fc-fc3d76682b78 service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Received unexpected event network-vif-plugged-cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 for instance with vm_state rescued and task_state unrescuing.
Apr 11 15:51:37 user nova-compute[71229]: DEBUG nova.virt.libvirt.host [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Removed pending event for f0fc18ff-897c-4f97-95b6-9f25d11dba88 due to event {{(pid=71229) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 15:51:37 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681228297.263395, f0fc18ff-897c-4f97-95b6-9f25d11dba88 => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:51:37 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] VM Resumed (Lifecycle Event)
Apr 11 15:51:37 user nova-compute[71229]: DEBUG nova.compute.manager [None req-46312f2f-47b1-4c61-91d4-6b109b93b558 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:51:37 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:51:37 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:51:37 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 11 15:51:37 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681228297.264896, f0fc18ff-897c-4f97-95b6-9f25d11dba88 => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:51:37 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] VM Started (Lifecycle Event)
Apr 11 15:51:37 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:51:37 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:51:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:51:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:51:37 user nova-compute[71229]: DEBUG nova.compute.manager [req-4084a7c2-ac52-49c9-b7f8-f14edcb3d321 req-d62ef2e9-e2a0-4ce8-af28-65633e48939b service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Received event network-vif-plugged-cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:51:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4084a7c2-ac52-49c9-b7f8-f14edcb3d321 req-d62ef2e9-e2a0-4ce8-af28-65633e48939b service nova] Acquiring lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:51:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4084a7c2-ac52-49c9-b7f8-f14edcb3d321 req-d62ef2e9-e2a0-4ce8-af28-65633e48939b service nova] Lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:51:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4084a7c2-ac52-49c9-b7f8-f14edcb3d321 req-d62ef2e9-e2a0-4ce8-af28-65633e48939b service nova] Lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:51:37 user nova-compute[71229]: DEBUG nova.compute.manager [req-4084a7c2-ac52-49c9-b7f8-f14edcb3d321 req-d62ef2e9-e2a0-4ce8-af28-65633e48939b service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] No waiting events found dispatching network-vif-plugged-cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:51:37 user nova-compute[71229]: WARNING nova.compute.manager [req-4084a7c2-ac52-49c9-b7f8-f14edcb3d321 req-d62ef2e9-e2a0-4ce8-af28-65633e48939b service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Received unexpected event network-vif-plugged-cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 for instance with vm_state active and task_state None.
Apr 11 15:51:42 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:51:42 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:51:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c6ab9afa-cf5c-4af4-ab1a-a4cd123c54c2 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "058df5ba-07ab-4bdd-9a47-907e7b0e0e59" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:51:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c6ab9afa-cf5c-4af4-ab1a-a4cd123c54c2 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "058df5ba-07ab-4bdd-9a47-907e7b0e0e59" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:51:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c6ab9afa-cf5c-4af4-ab1a-a4cd123c54c2 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "058df5ba-07ab-4bdd-9a47-907e7b0e0e59-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:51:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c6ab9afa-cf5c-4af4-ab1a-a4cd123c54c2 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "058df5ba-07ab-4bdd-9a47-907e7b0e0e59-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:51:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c6ab9afa-cf5c-4af4-ab1a-a4cd123c54c2 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "058df5ba-07ab-4bdd-9a47-907e7b0e0e59-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:51:46 user nova-compute[71229]: INFO nova.compute.manager [None req-c6ab9afa-cf5c-4af4-ab1a-a4cd123c54c2 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Terminating instance
Apr 11 15:51:46 user nova-compute[71229]: DEBUG nova.compute.manager [None req-c6ab9afa-cf5c-4af4-ab1a-a4cd123c54c2 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Start destroying the instance on the hypervisor. {{(pid=71229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 15:51:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:51:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:51:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:51:46 user nova-compute[71229]: DEBUG nova.compute.manager [req-254683e8-7586-4a70-8940-203a34c3c38f req-45af040e-8576-4d91-8695-e648529e1ad2 service nova] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Received event network-vif-unplugged-cdfec3e6-f5dc-42e6-98a8-651f46bd37f4 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:51:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-254683e8-7586-4a70-8940-203a34c3c38f req-45af040e-8576-4d91-8695-e648529e1ad2 service nova] Acquiring lock "058df5ba-07ab-4bdd-9a47-907e7b0e0e59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:51:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-254683e8-7586-4a70-8940-203a34c3c38f req-45af040e-8576-4d91-8695-e648529e1ad2 service nova] Lock "058df5ba-07ab-4bdd-9a47-907e7b0e0e59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:51:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-254683e8-7586-4a70-8940-203a34c3c38f req-45af040e-8576-4d91-8695-e648529e1ad2 service nova] Lock "058df5ba-07ab-4bdd-9a47-907e7b0e0e59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:51:46 user nova-compute[71229]: DEBUG nova.compute.manager [req-254683e8-7586-4a70-8940-203a34c3c38f req-45af040e-8576-4d91-8695-e648529e1ad2 service nova] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] No waiting events found dispatching network-vif-unplugged-cdfec3e6-f5dc-42e6-98a8-651f46bd37f4 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:51:46 user nova-compute[71229]: DEBUG nova.compute.manager [req-254683e8-7586-4a70-8940-203a34c3c38f req-45af040e-8576-4d91-8695-e648529e1ad2 service nova] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Received event network-vif-unplugged-cdfec3e6-f5dc-42e6-98a8-651f46bd37f4 for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 15:51:46 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Instance destroyed successfully.
Apr 11 15:51:46 user nova-compute[71229]: DEBUG nova.objects.instance [None req-c6ab9afa-cf5c-4af4-ab1a-a4cd123c54c2 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lazy-loading 'resources' on Instance uuid 058df5ba-07ab-4bdd-9a47-907e7b0e0e59 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:51:46 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-c6ab9afa-cf5c-4af4-ab1a-a4cd123c54c2 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:35:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1607555869',display_name='tempest-ServerRescueNegativeTestJSON-server-1607555869',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1607555869',id=29,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:37:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d700a53aa25849e0afd562b05881d09a',ramdisk_id='',reservation_id='r-z6w5qaef',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1491000769',owner_user_name='tempest-ServerRescueNegativeTestJSON-1491000769-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:37:49Z,user_data=None,user_id='5c8492f96e5d4f54aaae3679c82b6759',uuid=058df5ba-07ab-4bdd-9a47-907e7b0e0e59,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "cdfec3e6-f5dc-42e6-98a8-651f46bd37f4", "address": "fa:16:3e:47:d3:74", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdfec3e6-f5", "ovs_interfaceid": "cdfec3e6-f5dc-42e6-98a8-651f46bd37f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:51:46 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-c6ab9afa-cf5c-4af4-ab1a-a4cd123c54c2 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Converting VIF {"id": "cdfec3e6-f5dc-42e6-98a8-651f46bd37f4", "address": "fa:16:3e:47:d3:74", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdfec3e6-f5", "ovs_interfaceid": "cdfec3e6-f5dc-42e6-98a8-651f46bd37f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:51:46 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-c6ab9afa-cf5c-4af4-ab1a-a4cd123c54c2 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:d3:74,bridge_name='br-int',has_traffic_filtering=True,id=cdfec3e6-f5dc-42e6-98a8-651f46bd37f4,network=Network(7ba20249-9c62-46d7-810c-8144c1a1f17e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdfec3e6-f5') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:51:46 user nova-compute[71229]: DEBUG os_vif [None req-c6ab9afa-cf5c-4af4-ab1a-a4cd123c54c2 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:d3:74,bridge_name='br-int',has_traffic_filtering=True,id=cdfec3e6-f5dc-42e6-98a8-651f46bd37f4,network=Network(7ba20249-9c62-46d7-810c-8144c1a1f17e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdfec3e6-f5') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:51:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:51:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcdfec3e6-f5, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:51:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:51:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:51:46 user nova-compute[71229]: INFO os_vif [None req-c6ab9afa-cf5c-4af4-ab1a-a4cd123c54c2 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:d3:74,bridge_name='br-int',has_traffic_filtering=True,id=cdfec3e6-f5dc-42e6-98a8-651f46bd37f4,network=Network(7ba20249-9c62-46d7-810c-8144c1a1f17e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdfec3e6-f5')
Apr 11 15:51:46 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-c6ab9afa-cf5c-4af4-ab1a-a4cd123c54c2 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Deleting instance files /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59_del
Apr 11 15:51:46 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-c6ab9afa-cf5c-4af4-ab1a-a4cd123c54c2 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Deletion of /opt/stack/data/nova/instances/058df5ba-07ab-4bdd-9a47-907e7b0e0e59_del complete
Apr 11 15:51:46 user nova-compute[71229]: INFO nova.compute.manager [None req-c6ab9afa-cf5c-4af4-ab1a-a4cd123c54c2 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Took 0.67 seconds to destroy the instance on the hypervisor.
Apr 11 15:51:46 user nova-compute[71229]: DEBUG oslo.service.loopingcall [None req-c6ab9afa-cf5c-4af4-ab1a-a4cd123c54c2 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71229) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 15:51:46 user nova-compute[71229]: DEBUG nova.compute.manager [-] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Deallocating network for instance {{(pid=71229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 15:51:46 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] deallocate_for_instance() {{(pid=71229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 15:51:47 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:51:47 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Took 0.78 seconds to deallocate network for instance.
Apr 11 15:51:47 user nova-compute[71229]: DEBUG nova.compute.manager [req-f4055a34-5ab4-43d8-9a5c-5c2c4a779844 req-f4387862-ba60-437c-88cb-5c54450789d9 service nova] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Received event network-vif-deleted-cdfec3e6-f5dc-42e6-98a8-651f46bd37f4 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:51:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c6ab9afa-cf5c-4af4-ab1a-a4cd123c54c2 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:51:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c6ab9afa-cf5c-4af4-ab1a-a4cd123c54c2 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:51:47 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-c6ab9afa-cf5c-4af4-ab1a-a4cd123c54c2 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:51:47 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-c6ab9afa-cf5c-4af4-ab1a-a4cd123c54c2 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:51:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c6ab9afa-cf5c-4af4-ab1a-a4cd123c54c2 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.168s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:51:47 user nova-compute[71229]: INFO nova.scheduler.client.report [None req-c6ab9afa-cf5c-4af4-ab1a-a4cd123c54c2 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Deleted allocations for instance 058df5ba-07ab-4bdd-9a47-907e7b0e0e59
Apr 11 15:51:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c6ab9afa-cf5c-4af4-ab1a-a4cd123c54c2 tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "058df5ba-07ab-4bdd-9a47-907e7b0e0e59" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.806s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:51:48 user nova-compute[71229]: DEBUG nova.compute.manager [req-53b4a8fd-31e8-488e-9d51-d9a54fb34a08 req-9c37227e-d874-4f66-86c4-4ff644c2ca59 service nova] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Received event network-vif-plugged-cdfec3e6-f5dc-42e6-98a8-651f46bd37f4 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:51:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-53b4a8fd-31e8-488e-9d51-d9a54fb34a08 req-9c37227e-d874-4f66-86c4-4ff644c2ca59 service nova] Acquiring lock "058df5ba-07ab-4bdd-9a47-907e7b0e0e59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:51:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-53b4a8fd-31e8-488e-9d51-d9a54fb34a08 req-9c37227e-d874-4f66-86c4-4ff644c2ca59 service nova] Lock "058df5ba-07ab-4bdd-9a47-907e7b0e0e59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:51:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-53b4a8fd-31e8-488e-9d51-d9a54fb34a08 req-9c37227e-d874-4f66-86c4-4ff644c2ca59 service nova] Lock "058df5ba-07ab-4bdd-9a47-907e7b0e0e59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:51:48 user nova-compute[71229]: DEBUG nova.compute.manager [req-53b4a8fd-31e8-488e-9d51-d9a54fb34a08 req-9c37227e-d874-4f66-86c4-4ff644c2ca59 service nova] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] No waiting events found dispatching network-vif-plugged-cdfec3e6-f5dc-42e6-98a8-651f46bd37f4 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:51:48 user nova-compute[71229]: WARNING nova.compute.manager [req-53b4a8fd-31e8-488e-9d51-d9a54fb34a08 req-9c37227e-d874-4f66-86c4-4ff644c2ca59 service nova] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Received unexpected event network-vif-plugged-cdfec3e6-f5dc-42e6-98a8-651f46bd37f4 for instance with vm_state deleted and task_state None.
Apr 11 15:51:51 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:51:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-96c0622c-fe44-4b34-b7c4-7699010c0ee7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:51:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-96c0622c-fe44-4b34-b7c4-7699010c0ee7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:51:51 user nova-compute[71229]: INFO nova.compute.manager [None req-96c0622c-fe44-4b34-b7c4-7699010c0ee7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Detaching volume 5da66830-cebd-441e-8573-1480f8fe8e15
Apr 11 15:51:52 user nova-compute[71229]: INFO nova.virt.block_device [None req-96c0622c-fe44-4b34-b7c4-7699010c0ee7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Attempting to driver detach volume 5da66830-cebd-441e-8573-1480f8fe8e15 from mountpoint /dev/vdb
Apr 11 15:51:52 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-96c0622c-fe44-4b34-b7c4-7699010c0ee7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Attempting to detach device vdb from instance f0fc18ff-897c-4f97-95b6-9f25d11dba88 from the persistent domain config. {{(pid=71229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-96c0622c-fe44-4b34-b7c4-7699010c0ee7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 15:51:52 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:51:52 user nova-compute[71229]:   <source dev="/dev/sdb"/>
Apr 11 15:51:52 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 15:51:52 user nova-compute[71229]:   <serial>5da66830-cebd-441e-8573-1480f8fe8e15</serial>
Apr 11 15:51:52 user nova-compute[71229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 15:51:52 user nova-compute[71229]: </disk>
Apr 11 15:51:52 user nova-compute[71229]:  {{(pid=71229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 15:51:52 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-96c0622c-fe44-4b34-b7c4-7699010c0ee7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Successfully detached device vdb from instance f0fc18ff-897c-4f97-95b6-9f25d11dba88 from the persistent domain config.
Apr 11 15:51:52 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-96c0622c-fe44-4b34-b7c4-7699010c0ee7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f0fc18ff-897c-4f97-95b6-9f25d11dba88 from the live domain config. {{(pid=71229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-96c0622c-fe44-4b34-b7c4-7699010c0ee7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 15:51:52 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:51:52 user nova-compute[71229]:   <source dev="/dev/sdb"/>
Apr 11 15:51:52 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 15:51:52 user nova-compute[71229]:   <serial>5da66830-cebd-441e-8573-1480f8fe8e15</serial>
Apr 11 15:51:52 user nova-compute[71229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 15:51:52 user nova-compute[71229]: </disk>
Apr 11 15:51:52 user nova-compute[71229]:  {{(pid=71229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Received event <DeviceRemovedEvent: 1681228312.4444797, f0fc18ff-897c-4f97-95b6-9f25d11dba88 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71229) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-96c0622c-fe44-4b34-b7c4-7699010c0ee7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f0fc18ff-897c-4f97-95b6-9f25d11dba88 {{(pid=71229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 15:51:52 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-96c0622c-fe44-4b34-b7c4-7699010c0ee7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Successfully detached device vdb from instance f0fc18ff-897c-4f97-95b6-9f25d11dba88 from the live domain config.
Apr 11 15:51:52 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96c0622c-fe44-4b34-b7c4-7699010c0ee7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c0622c-fe44-4b34-b7c4-7699010c0ee7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DmJIsVlB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:51:52 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-96c0622c-fe44-4b34-b7c4-7699010c0ee7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:51:52 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-96c0622c-fe44-4b34-b7c4-7699010c0ee7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-96c0622c-fe44-4b34-b7c4-7699010c0ee7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b00e646-9137-44f7-8d1a-e80bc18cd865]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c0622c-fe44-4b34-b7c4-7699010c0ee7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 15:51:52 user nova-compute[71229]: No targets found.
Apr 11 15:51:52 user nova-compute[71229]: iSNS:
Apr 11 15:51:52 user nova-compute[71229]: No targets found.
Apr 11 15:51:52 user nova-compute[71229]: STATIC:
Apr 11 15:51:52 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0
Apr 11 15:51:52 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:51:52 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:51:52 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15
Apr 11 15:51:52 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:51:52 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:51:52 user nova-compute[71229]: FIRMWARE:
Apr 11 15:51:52 user nova-compute[71229]: No targets found.
Apr 11 15:51:52 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c0622c-fe44-4b34-b7c4-7699010c0ee7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 15:51:52 user nova-compute[71229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 15:51:52 user nova-compute[71229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71229) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c0622c-fe44-4b34-b7c4-7699010c0ee7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15', 0)] {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd5789f-1e11-484e-a6f0-97caee2ae2b3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f8d81d-a496-42eb-9f2a-d16f9229cb0a]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c0622c-fe44-4b34-b7c4-7699010c0ee7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15 (non-flash)
Apr 11 15:51:52 user nova-compute[71229]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 (non-flash)
Apr 11 15:51:52 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c0622c-fe44-4b34-b7c4-7699010c0ee7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15 (non-flash)
Apr 11 15:51:52 user nova-compute[71229]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 (non-flash)
Apr 11 15:51:52 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c0622c-fe44-4b34-b7c4-7699010c0ee7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb5c2b29e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15'): ({'sdb'}, set())}) {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-96c0622c-fe44-4b34-b7c4-7699010c0ee7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Removing single pathed devices sdb {{(pid=71229) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[96aaef2c-f172-4390-bfbd-a35b5bb7e6e6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd267432-3261-42cd-bf64-f0bca1f034a2]: (4, ('ok\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-96c0622c-fe44-4b34-b7c4-7699010c0ee7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Flushing IO for device /dev/sdb {{(pid=71229) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f11730-177a-461e-a8c8-3faa425add6e]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-96c0622c-fe44-4b34-b7c4-7699010c0ee7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71229) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78fa941-409d-499f-9dbb-0f1c729ea6ac]: (4, ('1', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-96c0622c-fe44-4b34-b7c4-7699010c0ee7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-96c0622c-fe44-4b34-b7c4-7699010c0ee7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] SCSI volumes sdb have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c0622c-fe44-4b34-b7c4-7699010c0ee7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15')] {{(pid=71229) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9004ecd-69bf-4262-a43e-8db37bf05a4d]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c0622c-fe44-4b34-b7c4-7699010c0ee7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15 -p 172.16.0.220:3260 --logout {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9324ec82-a5f9-40ce-a25a-82c1da7d12a8]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c0622c-fe44-4b34-b7c4-7699010c0ee7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15, portal: 172.16.0.220,3260]
Apr 11 15:51:52 user nova-compute[71229]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15, portal: 172.16.0.220,3260] successful.
Apr 11 15:51:52 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15 -p 172.16.0.220:3260 --op delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da66830-cebd-441e-8573-1480f8fe8e15 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8226fc54-89b3-470c-a38a-1ee64a60947c]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c0622c-fe44-4b34-b7c4-7699010c0ee7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-96c0622c-fe44-4b34-b7c4-7699010c0ee7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c0622c-fe44-4b34-b7c4-7699010c0ee7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] <== disconnect_volume: return (320ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:51:52 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96c0622c-fe44-4b34-b7c4-7699010c0ee7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 15:51:53 user nova-compute[71229]: DEBUG nova.objects.instance [None req-96c0622c-fe44-4b34-b7c4-7699010c0ee7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lazy-loading 'flavor' on Instance uuid f0fc18ff-897c-4f97-95b6-9f25d11dba88 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:51:53 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-96c0622c-fe44-4b34-b7c4-7699010c0ee7 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.663s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:51:56 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:51:56 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Cleaning up deleted instances {{(pid=71229) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 15:51:56 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] There are 0 instances to clean {{(pid=71229) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 15:51:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:51:57 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:52:01 user nova-compute[71229]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681228306.7474306, 058df5ba-07ab-4bdd-9a47-907e7b0e0e59 => Stopped> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:52:01 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] VM Stopped (Lifecycle Event)
Apr 11 15:52:01 user nova-compute[71229]: DEBUG nova.compute.manager [None req-4aca7ed9-8e4a-47d7-9f16-110db30218b9 None None] [instance: 058df5ba-07ab-4bdd-9a47-907e7b0e0e59] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:52:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:52:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:52:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:52:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:52:15 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:52:15 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 15:52:16 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:52:16 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 15:52:16 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Didn't find any instances for network info cache update. {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 15:52:16 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:52:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:52:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:52:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:52:16 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 15:52:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:52:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:52:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:52:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:52:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:52:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:52:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:52:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:52:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:52:17 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:52:17 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:52:17 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:52:17 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8562MB free_disk=25.927349090576172GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 15:52:17 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:52:17 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:52:17 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 6f6ae64a-c760-4ba3-8a50-d380835d9913 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:52:17 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance f0fc18ff-897c-4f97-95b6-9f25d11dba88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:52:17 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 507b2cc1-0a6c-4ae2-a254-3a991f495fe3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:52:17 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 15:52:17 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 15:52:18 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:52:18 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:52:18 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 15:52:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.279s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:52:20 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:52:20 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:52:21 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:52:21 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:52:21 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:52:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:52:22 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:52:23 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:52:23 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:52:23 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71229) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 15:52:24 user nova-compute[71229]: DEBUG nova.compute.manager [req-3555d724-613c-4596-a92a-386d1f18bec0 req-d4bc0fb8-a714-45cd-b4fb-f6a6ecd451cd service nova] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Received event network-changed-ffa45d48-79f2-4055-bb7c-33172e34fb8b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:52:24 user nova-compute[71229]: DEBUG nova.compute.manager [req-3555d724-613c-4596-a92a-386d1f18bec0 req-d4bc0fb8-a714-45cd-b4fb-f6a6ecd451cd service nova] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Refreshing instance network info cache due to event network-changed-ffa45d48-79f2-4055-bb7c-33172e34fb8b. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:52:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3555d724-613c-4596-a92a-386d1f18bec0 req-d4bc0fb8-a714-45cd-b4fb-f6a6ecd451cd service nova] Acquiring lock "refresh_cache-507b2cc1-0a6c-4ae2-a254-3a991f495fe3" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:52:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3555d724-613c-4596-a92a-386d1f18bec0 req-d4bc0fb8-a714-45cd-b4fb-f6a6ecd451cd service nova] Acquired lock "refresh_cache-507b2cc1-0a6c-4ae2-a254-3a991f495fe3" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:52:24 user nova-compute[71229]: DEBUG nova.network.neutron [req-3555d724-613c-4596-a92a-386d1f18bec0 req-d4bc0fb8-a714-45cd-b4fb-f6a6ecd451cd service nova] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Refreshing network info cache for port ffa45d48-79f2-4055-bb7c-33172e34fb8b {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:52:24 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:52:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "507b2cc1-0a6c-4ae2-a254-3a991f495fe3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:52:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "507b2cc1-0a6c-4ae2-a254-3a991f495fe3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:52:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "507b2cc1-0a6c-4ae2-a254-3a991f495fe3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:52:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "507b2cc1-0a6c-4ae2-a254-3a991f495fe3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:52:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "507b2cc1-0a6c-4ae2-a254-3a991f495fe3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:52:24 user nova-compute[71229]: INFO nova.compute.manager [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Terminating instance
Apr 11 15:52:24 user nova-compute[71229]: DEBUG nova.compute.manager [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Start destroying the instance on the hypervisor. {{(pid=71229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 15:52:24 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:52:24 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:52:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:52:25 user nova-compute[71229]: DEBUG nova.network.neutron [req-3555d724-613c-4596-a92a-386d1f18bec0 req-d4bc0fb8-a714-45cd-b4fb-f6a6ecd451cd service nova] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Updated VIF entry in instance network info cache for port ffa45d48-79f2-4055-bb7c-33172e34fb8b. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:52:25 user nova-compute[71229]: DEBUG nova.network.neutron [req-3555d724-613c-4596-a92a-386d1f18bec0 req-d4bc0fb8-a714-45cd-b4fb-f6a6ecd451cd service nova] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Updating instance_info_cache with network_info: [{"id": "ffa45d48-79f2-4055-bb7c-33172e34fb8b", "address": "fa:16:3e:9a:29:b2", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa45d48-79", "ovs_interfaceid": "ffa45d48-79f2-4055-bb7c-33172e34fb8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:52:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3555d724-613c-4596-a92a-386d1f18bec0 req-d4bc0fb8-a714-45cd-b4fb-f6a6ecd451cd service nova] Releasing lock "refresh_cache-507b2cc1-0a6c-4ae2-a254-3a991f495fe3" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:52:25 user nova-compute[71229]: DEBUG nova.compute.manager [req-0a2a2004-6998-4c54-b618-19236ad66653 req-ce667451-5c05-48cd-9838-2d25727009fe service nova] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Received event network-vif-unplugged-ffa45d48-79f2-4055-bb7c-33172e34fb8b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:52:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-0a2a2004-6998-4c54-b618-19236ad66653 req-ce667451-5c05-48cd-9838-2d25727009fe service nova] Acquiring lock "507b2cc1-0a6c-4ae2-a254-3a991f495fe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:52:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-0a2a2004-6998-4c54-b618-19236ad66653 req-ce667451-5c05-48cd-9838-2d25727009fe service nova] Lock "507b2cc1-0a6c-4ae2-a254-3a991f495fe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:52:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-0a2a2004-6998-4c54-b618-19236ad66653 req-ce667451-5c05-48cd-9838-2d25727009fe service nova] Lock "507b2cc1-0a6c-4ae2-a254-3a991f495fe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:52:25 user nova-compute[71229]: DEBUG nova.compute.manager [req-0a2a2004-6998-4c54-b618-19236ad66653 req-ce667451-5c05-48cd-9838-2d25727009fe service nova] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] No waiting events found dispatching network-vif-unplugged-ffa45d48-79f2-4055-bb7c-33172e34fb8b {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:52:25 user nova-compute[71229]: DEBUG nova.compute.manager [req-0a2a2004-6998-4c54-b618-19236ad66653 req-ce667451-5c05-48cd-9838-2d25727009fe service nova] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Received event network-vif-unplugged-ffa45d48-79f2-4055-bb7c-33172e34fb8b for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 15:52:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:52:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:52:25 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Instance destroyed successfully.
Apr 11 15:52:25 user nova-compute[71229]: DEBUG nova.objects.instance [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lazy-loading 'resources' on Instance uuid 507b2cc1-0a6c-4ae2-a254-3a991f495fe3 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:52:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:52:25 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:50:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1640081057',display_name='tempest-TestVolumeBootPattern-server-1640081057',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1640081057',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHFmBexXT+1iiEvWvrTBCCfLTFSZaBECTRUjU2HFOZ99DTdS224XqNm6W0NLu+fhNbtUG4d3cptal0K2Oy5ZbjfRTK7G/g++ylfyvf1YI+eSa1yX5tyMrdSO5dom9On9A==',key_name='tempest-TestVolumeBootPattern-1289860889',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:50:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='312851c65ba1434691eca0cd2a8cd6d2',ramdisk_id='',reservation_id='r-1n5tdizc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1933582504',owner_user_name='tempest-TestVolumeBootPattern-1933582504-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:50:43Z,user_data=None,user_id='c2110b74f38642afa560e1c9790d3f81',uuid=507b2cc1-0a6c-4ae2-a254-3a991f495fe3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ffa45d48-79f2-4055-bb7c-33172e34fb8b", "address": "fa:16:3e:9a:29:b2", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa45d48-79", "ovs_interfaceid": "ffa45d48-79f2-4055-bb7c-33172e34fb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:52:25 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Converting VIF {"id": "ffa45d48-79f2-4055-bb7c-33172e34fb8b", "address": "fa:16:3e:9a:29:b2", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa45d48-79", "ovs_interfaceid": "ffa45d48-79f2-4055-bb7c-33172e34fb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:52:25 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:29:b2,bridge_name='br-int',has_traffic_filtering=True,id=ffa45d48-79f2-4055-bb7c-33172e34fb8b,network=Network(8d262ba8-b9c3-44ed-8431-6c295eb9ea24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffa45d48-79') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:52:25 user nova-compute[71229]: DEBUG os_vif [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:29:b2,bridge_name='br-int',has_traffic_filtering=True,id=ffa45d48-79f2-4055-bb7c-33172e34fb8b,network=Network(8d262ba8-b9c3-44ed-8431-6c295eb9ea24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffa45d48-79') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:52:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:52:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapffa45d48-79, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:52:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:52:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:52:25 user nova-compute[71229]: INFO os_vif [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:29:b2,bridge_name='br-int',has_traffic_filtering=True,id=ffa45d48-79f2-4055-bb7c-33172e34fb8b,network=Network(8d262ba8-b9c3-44ed-8431-6c295eb9ea24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffa45d48-79')
Apr 11 15:52:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:52:25 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 15:52:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bYXCcZln', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:52:25 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:52:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:52:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:52:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:52:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:52:25 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[54bb9606-f40d-4f4b-aef1-a075c096b431]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:52:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 15:52:25 user nova-compute[71229]: No targets found.
Apr 11 15:52:25 user nova-compute[71229]: iSNS:
Apr 11 15:52:25 user nova-compute[71229]: No targets found.
Apr 11 15:52:25 user nova-compute[71229]: STATIC:
Apr 11 15:52:25 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0
Apr 11 15:52:25 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:52:25 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:52:25 user nova-compute[71229]: FIRMWARE:
Apr 11 15:52:25 user nova-compute[71229]: No targets found.
Apr 11 15:52:25 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:52:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 15:52:25 user nova-compute[71229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 15:52:25 user nova-compute[71229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71229) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 15:52:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0', 0)] {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 15:52:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:52:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:52:25 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bc9686-323e-47ad-b38d-a3dda9665052]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:52:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:52:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:52:25 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1eded7-1fe9-496f-acc7-b7b977925968]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:52:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 (non-flash)
Apr 11 15:52:25 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:52:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 (non-flash)
Apr 11 15:52:25 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:52:25 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb286dcca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0'): ({'sdc'}, set())}) {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 15:52:25 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Removing single pathed devices sdc {{(pid=71229) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 15:52:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:52:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:52:25 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc82c3a-b01a-42f1-856d-a200a176417e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:52:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:52:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:52:25 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a13be5-b96c-40a7-b93c-6f2075576223]: (4, ('ok\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:52:25 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Flushing IO for device /dev/sdc {{(pid=71229) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 15:52:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:52:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:52:25 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8303b2-74ea-44fc-bfb7-33cc8eba2c0d]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:52:25 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71229) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 15:52:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:52:26 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.140s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:52:26 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[97bf245b-730f-4f6e-87af-ea949098dca2]: (4, ('1', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:52:26 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 15:52:26 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] SCSI volumes sdc have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 15:52:26 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0')] {{(pid=71229) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 15:52:26 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:52:26 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:52:26 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1f4e22-9f09-4a51-bdce-078ccf06c8c9]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:52:26 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:52:26 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 -p 172.16.0.220:3260 --logout {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:52:26 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:52:26 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d41c09-b4e6-4046-894a-e5d68da0a212]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:52:26 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0, portal: 172.16.0.220,3260]
Apr 11 15:52:26 user nova-compute[71229]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0, portal: 172.16.0.220,3260] successful.
Apr 11 15:52:26 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:52:26 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 -p 172.16.0.220:3260 --op delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:52:26 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:52:26 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[348f2964-c396-445d-a543-19df51e3441d]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:52:26 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:52:26 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.418s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:52:26 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] <== disconnect_volume: return (420ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:52:26 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 15:52:26 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Deleting instance files /opt/stack/data/nova/instances/507b2cc1-0a6c-4ae2-a254-3a991f495fe3_del
Apr 11 15:52:26 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Deletion of /opt/stack/data/nova/instances/507b2cc1-0a6c-4ae2-a254-3a991f495fe3_del complete
Apr 11 15:52:26 user nova-compute[71229]: INFO nova.compute.manager [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Took 1.31 seconds to destroy the instance on the hypervisor.
Apr 11 15:52:26 user nova-compute[71229]: DEBUG oslo.service.loopingcall [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71229) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 15:52:26 user nova-compute[71229]: DEBUG nova.compute.manager [-] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Deallocating network for instance {{(pid=71229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 15:52:26 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] deallocate_for_instance() {{(pid=71229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 15:52:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:52:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:52:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:52:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:52:26 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:52:26 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Took 0.78 seconds to deallocate network for instance.
Apr 11 15:52:26 user nova-compute[71229]: DEBUG nova.compute.manager [req-d2d45ffc-4895-4bce-8695-160c25cba99f req-9b19cbb4-d536-4b96-b668-8095d47775f8 service nova] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Received event network-vif-deleted-ffa45d48-79f2-4055-bb7c-33172e34fb8b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:52:27 user nova-compute[71229]: DEBUG nova.compute.manager [req-2f5c9999-cc40-4e4b-979f-2044f60b0583 req-31dcdf34-24df-4904-b258-1519c60e0966 service nova] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Received event network-vif-plugged-ffa45d48-79f2-4055-bb7c-33172e34fb8b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:52:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2f5c9999-cc40-4e4b-979f-2044f60b0583 req-31dcdf34-24df-4904-b258-1519c60e0966 service nova] Acquiring lock "507b2cc1-0a6c-4ae2-a254-3a991f495fe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:52:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2f5c9999-cc40-4e4b-979f-2044f60b0583 req-31dcdf34-24df-4904-b258-1519c60e0966 service nova] Lock "507b2cc1-0a6c-4ae2-a254-3a991f495fe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:52:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2f5c9999-cc40-4e4b-979f-2044f60b0583 req-31dcdf34-24df-4904-b258-1519c60e0966 service nova] Lock "507b2cc1-0a6c-4ae2-a254-3a991f495fe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:52:27 user nova-compute[71229]: DEBUG nova.compute.manager [req-2f5c9999-cc40-4e4b-979f-2044f60b0583 req-31dcdf34-24df-4904-b258-1519c60e0966 service nova] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] No waiting events found dispatching network-vif-plugged-ffa45d48-79f2-4055-bb7c-33172e34fb8b {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:52:27 user nova-compute[71229]: WARNING nova.compute.manager [req-2f5c9999-cc40-4e4b-979f-2044f60b0583 req-31dcdf34-24df-4904-b258-1519c60e0966 service nova] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Received unexpected event network-vif-plugged-ffa45d48-79f2-4055-bb7c-33172e34fb8b for instance with vm_state active and task_state deleting.
Apr 11 15:52:27 user nova-compute[71229]: DEBUG nova.compute.manager [req-2f5c9999-cc40-4e4b-979f-2044f60b0583 req-31dcdf34-24df-4904-b258-1519c60e0966 service nova] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Received event network-vif-plugged-ffa45d48-79f2-4055-bb7c-33172e34fb8b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:52:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2f5c9999-cc40-4e4b-979f-2044f60b0583 req-31dcdf34-24df-4904-b258-1519c60e0966 service nova] Acquiring lock "507b2cc1-0a6c-4ae2-a254-3a991f495fe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:52:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2f5c9999-cc40-4e4b-979f-2044f60b0583 req-31dcdf34-24df-4904-b258-1519c60e0966 service nova] Lock "507b2cc1-0a6c-4ae2-a254-3a991f495fe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:52:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2f5c9999-cc40-4e4b-979f-2044f60b0583 req-31dcdf34-24df-4904-b258-1519c60e0966 service nova] Lock "507b2cc1-0a6c-4ae2-a254-3a991f495fe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:52:27 user nova-compute[71229]: DEBUG nova.compute.manager [req-2f5c9999-cc40-4e4b-979f-2044f60b0583 req-31dcdf34-24df-4904-b258-1519c60e0966 service nova] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] No waiting events found dispatching network-vif-plugged-ffa45d48-79f2-4055-bb7c-33172e34fb8b {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:52:27 user nova-compute[71229]: WARNING nova.compute.manager [req-2f5c9999-cc40-4e4b-979f-2044f60b0583 req-31dcdf34-24df-4904-b258-1519c60e0966 service nova] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Received unexpected event network-vif-plugged-ffa45d48-79f2-4055-bb7c-33172e34fb8b for instance with vm_state active and task_state deleting.
Apr 11 15:52:27 user nova-compute[71229]: DEBUG nova.compute.manager [req-2f5c9999-cc40-4e4b-979f-2044f60b0583 req-31dcdf34-24df-4904-b258-1519c60e0966 service nova] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Received event network-vif-plugged-ffa45d48-79f2-4055-bb7c-33172e34fb8b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:52:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2f5c9999-cc40-4e4b-979f-2044f60b0583 req-31dcdf34-24df-4904-b258-1519c60e0966 service nova] Acquiring lock "507b2cc1-0a6c-4ae2-a254-3a991f495fe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:52:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2f5c9999-cc40-4e4b-979f-2044f60b0583 req-31dcdf34-24df-4904-b258-1519c60e0966 service nova] Lock "507b2cc1-0a6c-4ae2-a254-3a991f495fe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:52:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2f5c9999-cc40-4e4b-979f-2044f60b0583 req-31dcdf34-24df-4904-b258-1519c60e0966 service nova] Lock "507b2cc1-0a6c-4ae2-a254-3a991f495fe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:52:27 user nova-compute[71229]: DEBUG nova.compute.manager [req-2f5c9999-cc40-4e4b-979f-2044f60b0583 req-31dcdf34-24df-4904-b258-1519c60e0966 service nova] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] No waiting events found dispatching network-vif-plugged-ffa45d48-79f2-4055-bb7c-33172e34fb8b {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:52:27 user nova-compute[71229]: WARNING nova.compute.manager [req-2f5c9999-cc40-4e4b-979f-2044f60b0583 req-31dcdf34-24df-4904-b258-1519c60e0966 service nova] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Received unexpected event network-vif-plugged-ffa45d48-79f2-4055-bb7c-33172e34fb8b for instance with vm_state active and task_state deleting.
Apr 11 15:52:27 user nova-compute[71229]: DEBUG nova.compute.manager [req-2f5c9999-cc40-4e4b-979f-2044f60b0583 req-31dcdf34-24df-4904-b258-1519c60e0966 service nova] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Received event network-vif-unplugged-ffa45d48-79f2-4055-bb7c-33172e34fb8b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:52:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2f5c9999-cc40-4e4b-979f-2044f60b0583 req-31dcdf34-24df-4904-b258-1519c60e0966 service nova] Acquiring lock "507b2cc1-0a6c-4ae2-a254-3a991f495fe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:52:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2f5c9999-cc40-4e4b-979f-2044f60b0583 req-31dcdf34-24df-4904-b258-1519c60e0966 service nova] Lock "507b2cc1-0a6c-4ae2-a254-3a991f495fe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:52:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2f5c9999-cc40-4e4b-979f-2044f60b0583 req-31dcdf34-24df-4904-b258-1519c60e0966 service nova] Lock "507b2cc1-0a6c-4ae2-a254-3a991f495fe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:52:27 user nova-compute[71229]: DEBUG nova.compute.manager [req-2f5c9999-cc40-4e4b-979f-2044f60b0583 req-31dcdf34-24df-4904-b258-1519c60e0966 service nova] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] No waiting events found dispatching network-vif-unplugged-ffa45d48-79f2-4055-bb7c-33172e34fb8b {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:52:27 user nova-compute[71229]: DEBUG nova.compute.manager [req-2f5c9999-cc40-4e4b-979f-2044f60b0583 req-31dcdf34-24df-4904-b258-1519c60e0966 service nova] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Received event network-vif-unplugged-ffa45d48-79f2-4055-bb7c-33172e34fb8b for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 15:52:27 user nova-compute[71229]: DEBUG nova.compute.manager [req-2f5c9999-cc40-4e4b-979f-2044f60b0583 req-31dcdf34-24df-4904-b258-1519c60e0966 service nova] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Received event network-vif-plugged-ffa45d48-79f2-4055-bb7c-33172e34fb8b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:52:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2f5c9999-cc40-4e4b-979f-2044f60b0583 req-31dcdf34-24df-4904-b258-1519c60e0966 service nova] Acquiring lock "507b2cc1-0a6c-4ae2-a254-3a991f495fe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:52:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2f5c9999-cc40-4e4b-979f-2044f60b0583 req-31dcdf34-24df-4904-b258-1519c60e0966 service nova] Lock "507b2cc1-0a6c-4ae2-a254-3a991f495fe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:52:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-2f5c9999-cc40-4e4b-979f-2044f60b0583 req-31dcdf34-24df-4904-b258-1519c60e0966 service nova] Lock "507b2cc1-0a6c-4ae2-a254-3a991f495fe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:52:27 user nova-compute[71229]: DEBUG nova.compute.manager [req-2f5c9999-cc40-4e4b-979f-2044f60b0583 req-31dcdf34-24df-4904-b258-1519c60e0966 service nova] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] No waiting events found dispatching network-vif-plugged-ffa45d48-79f2-4055-bb7c-33172e34fb8b {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:52:27 user nova-compute[71229]: WARNING nova.compute.manager [req-2f5c9999-cc40-4e4b-979f-2044f60b0583 req-31dcdf34-24df-4904-b258-1519c60e0966 service nova] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Received unexpected event network-vif-plugged-ffa45d48-79f2-4055-bb7c-33172e34fb8b for instance with vm_state active and task_state deleting.
Apr 11 15:52:27 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:52:27 user nova-compute[71229]: INFO nova.compute.manager [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Took 0.76 seconds to detach 1 volumes for instance.
Apr 11 15:52:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:52:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:52:27 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:52:27 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:52:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.189s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:52:28 user nova-compute[71229]: INFO nova.scheduler.client.report [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Deleted allocations for instance 507b2cc1-0a6c-4ae2-a254-3a991f495fe3
Apr 11 15:52:28 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-654053ad-5abd-4ef5-b262-d60e0c319474 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "507b2cc1-0a6c-4ae2-a254-3a991f495fe3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.209s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:52:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:52:35 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:52:35 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:52:35 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 15:52:35 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 15:52:35 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 15:52:35 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:52:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5924f1d7-438f-475a-8705-1f736254e86c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "6f6ae64a-c760-4ba3-8a50-d380835d9913" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:52:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5924f1d7-438f-475a-8705-1f736254e86c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "6f6ae64a-c760-4ba3-8a50-d380835d9913" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:52:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5924f1d7-438f-475a-8705-1f736254e86c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "6f6ae64a-c760-4ba3-8a50-d380835d9913-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:52:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5924f1d7-438f-475a-8705-1f736254e86c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "6f6ae64a-c760-4ba3-8a50-d380835d9913-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:52:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5924f1d7-438f-475a-8705-1f736254e86c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "6f6ae64a-c760-4ba3-8a50-d380835d9913-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:52:36 user nova-compute[71229]: INFO nova.compute.manager [None req-5924f1d7-438f-475a-8705-1f736254e86c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Terminating instance
Apr 11 15:52:36 user nova-compute[71229]: DEBUG nova.compute.manager [None req-5924f1d7-438f-475a-8705-1f736254e86c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Start destroying the instance on the hypervisor. {{(pid=71229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 15:52:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:52:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:52:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:52:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:52:36 user nova-compute[71229]: DEBUG nova.compute.manager [req-422c44e5-0e8f-4584-aebe-bdd3630aa383 req-7814dbdd-aa98-4396-b6c5-53c2391025ca service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Received event network-vif-unplugged-2b891eeb-973f-492a-9059-55961bb956bf {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:52:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-422c44e5-0e8f-4584-aebe-bdd3630aa383 req-7814dbdd-aa98-4396-b6c5-53c2391025ca service nova] Acquiring lock "6f6ae64a-c760-4ba3-8a50-d380835d9913-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:52:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-422c44e5-0e8f-4584-aebe-bdd3630aa383 req-7814dbdd-aa98-4396-b6c5-53c2391025ca service nova] Lock "6f6ae64a-c760-4ba3-8a50-d380835d9913-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:52:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-422c44e5-0e8f-4584-aebe-bdd3630aa383 req-7814dbdd-aa98-4396-b6c5-53c2391025ca service nova] Lock "6f6ae64a-c760-4ba3-8a50-d380835d9913-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:52:36 user nova-compute[71229]: DEBUG nova.compute.manager [req-422c44e5-0e8f-4584-aebe-bdd3630aa383 req-7814dbdd-aa98-4396-b6c5-53c2391025ca service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] No waiting events found dispatching network-vif-unplugged-2b891eeb-973f-492a-9059-55961bb956bf {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:52:36 user nova-compute[71229]: DEBUG nova.compute.manager [req-422c44e5-0e8f-4584-aebe-bdd3630aa383 req-7814dbdd-aa98-4396-b6c5-53c2391025ca service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Received event network-vif-unplugged-2b891eeb-973f-492a-9059-55961bb956bf for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 15:52:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:52:37 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Instance destroyed successfully.
Apr 11 15:52:37 user nova-compute[71229]: DEBUG nova.objects.instance [None req-5924f1d7-438f-475a-8705-1f736254e86c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lazy-loading 'resources' on Instance uuid 6f6ae64a-c760-4ba3-8a50-d380835d9913 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:52:37 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-5924f1d7-438f-475a-8705-1f736254e86c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:35:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1967250041',display_name='tempest-ServerRescueNegativeTestJSON-server-1967250041',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1967250041',id=28,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:40:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d700a53aa25849e0afd562b05881d09a',ramdisk_id='',reservation_id='r-467thbtg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1491000769',owner_user_name='tempest-ServerRescueNegativeTestJSON-1491000769-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:42:32Z,user_data=None,user_id='5c8492f96e5d4f54aaae3679c82b6759',uuid=6f6ae64a-c760-4ba3-8a50-d380835d9913,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b891eeb-973f-492a-9059-55961bb956bf", "address": "fa:16:3e:97:b1:ae", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b891eeb-97", "ovs_interfaceid": "2b891eeb-973f-492a-9059-55961bb956bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:52:37 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-5924f1d7-438f-475a-8705-1f736254e86c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Converting VIF {"id": "2b891eeb-973f-492a-9059-55961bb956bf", "address": "fa:16:3e:97:b1:ae", "network": {"id": "7ba20249-9c62-46d7-810c-8144c1a1f17e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1053011995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d700a53aa25849e0afd562b05881d09a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b891eeb-97", "ovs_interfaceid": "2b891eeb-973f-492a-9059-55961bb956bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:52:37 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-5924f1d7-438f-475a-8705-1f736254e86c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:b1:ae,bridge_name='br-int',has_traffic_filtering=True,id=2b891eeb-973f-492a-9059-55961bb956bf,network=Network(7ba20249-9c62-46d7-810c-8144c1a1f17e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b891eeb-97') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:52:37 user nova-compute[71229]: DEBUG os_vif [None req-5924f1d7-438f-475a-8705-1f736254e86c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:b1:ae,bridge_name='br-int',has_traffic_filtering=True,id=2b891eeb-973f-492a-9059-55961bb956bf,network=Network(7ba20249-9c62-46d7-810c-8144c1a1f17e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b891eeb-97') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:52:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:52:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b891eeb-97, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:52:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:52:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:52:37 user nova-compute[71229]: INFO os_vif [None req-5924f1d7-438f-475a-8705-1f736254e86c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:b1:ae,bridge_name='br-int',has_traffic_filtering=True,id=2b891eeb-973f-492a-9059-55961bb956bf,network=Network(7ba20249-9c62-46d7-810c-8144c1a1f17e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b891eeb-97')
Apr 11 15:52:37 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-5924f1d7-438f-475a-8705-1f736254e86c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Deleting instance files /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913_del
Apr 11 15:52:37 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-5924f1d7-438f-475a-8705-1f736254e86c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Deletion of /opt/stack/data/nova/instances/6f6ae64a-c760-4ba3-8a50-d380835d9913_del complete
Apr 11 15:52:37 user nova-compute[71229]: INFO nova.compute.manager [None req-5924f1d7-438f-475a-8705-1f736254e86c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 11 15:52:37 user nova-compute[71229]: DEBUG oslo.service.loopingcall [None req-5924f1d7-438f-475a-8705-1f736254e86c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71229) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 15:52:37 user nova-compute[71229]: DEBUG nova.compute.manager [-] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Deallocating network for instance {{(pid=71229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 15:52:37 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] deallocate_for_instance() {{(pid=71229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 15:52:37 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:52:37 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Took 0.47 seconds to deallocate network for instance.
Apr 11 15:52:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5924f1d7-438f-475a-8705-1f736254e86c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:52:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5924f1d7-438f-475a-8705-1f736254e86c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:52:38 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-5924f1d7-438f-475a-8705-1f736254e86c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:52:38 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-5924f1d7-438f-475a-8705-1f736254e86c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:52:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5924f1d7-438f-475a-8705-1f736254e86c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.183s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:52:38 user nova-compute[71229]: INFO nova.scheduler.client.report [None req-5924f1d7-438f-475a-8705-1f736254e86c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Deleted allocations for instance 6f6ae64a-c760-4ba3-8a50-d380835d9913
Apr 11 15:52:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5924f1d7-438f-475a-8705-1f736254e86c tempest-ServerRescueNegativeTestJSON-1491000769 tempest-ServerRescueNegativeTestJSON-1491000769-project-member] Lock "6f6ae64a-c760-4ba3-8a50-d380835d9913" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.696s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:52:39 user nova-compute[71229]: DEBUG nova.compute.manager [req-5183c3ab-82fd-48b2-8aab-1225743a0788 req-b2be6553-bf36-48b6-b82b-931df93f974d service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Received event network-vif-plugged-2b891eeb-973f-492a-9059-55961bb956bf {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:52:39 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-5183c3ab-82fd-48b2-8aab-1225743a0788 req-b2be6553-bf36-48b6-b82b-931df93f974d service nova] Acquiring lock "6f6ae64a-c760-4ba3-8a50-d380835d9913-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:52:39 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-5183c3ab-82fd-48b2-8aab-1225743a0788 req-b2be6553-bf36-48b6-b82b-931df93f974d service nova] Lock "6f6ae64a-c760-4ba3-8a50-d380835d9913-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:52:39 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-5183c3ab-82fd-48b2-8aab-1225743a0788 req-b2be6553-bf36-48b6-b82b-931df93f974d service nova] Lock "6f6ae64a-c760-4ba3-8a50-d380835d9913-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:52:39 user nova-compute[71229]: DEBUG nova.compute.manager [req-5183c3ab-82fd-48b2-8aab-1225743a0788 req-b2be6553-bf36-48b6-b82b-931df93f974d service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] No waiting events found dispatching network-vif-plugged-2b891eeb-973f-492a-9059-55961bb956bf {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:52:39 user nova-compute[71229]: WARNING nova.compute.manager [req-5183c3ab-82fd-48b2-8aab-1225743a0788 req-b2be6553-bf36-48b6-b82b-931df93f974d service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Received unexpected event network-vif-plugged-2b891eeb-973f-492a-9059-55961bb956bf for instance with vm_state deleted and task_state None.
Apr 11 15:52:39 user nova-compute[71229]: DEBUG nova.compute.manager [req-5183c3ab-82fd-48b2-8aab-1225743a0788 req-b2be6553-bf36-48b6-b82b-931df93f974d service nova] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Received event network-vif-deleted-2b891eeb-973f-492a-9059-55961bb956bf {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:52:40 user nova-compute[71229]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681228345.6515944, 507b2cc1-0a6c-4ae2-a254-3a991f495fe3 => Stopped> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:52:40 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] VM Stopped (Lifecycle Event)
Apr 11 15:52:40 user nova-compute[71229]: DEBUG nova.compute.manager [None req-de29fb1f-d94c-4dad-bfc9-3661d85754b0 None None] [instance: 507b2cc1-0a6c-4ae2-a254-3a991f495fe3] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:52:42 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:52:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-13a8866f-e80f-400e-8462-ee3fb2d04e24 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:52:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-13a8866f-e80f-400e-8462-ee3fb2d04e24 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:52:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-13a8866f-e80f-400e-8462-ee3fb2d04e24 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:52:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-13a8866f-e80f-400e-8462-ee3fb2d04e24 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:52:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-13a8866f-e80f-400e-8462-ee3fb2d04e24 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:52:43 user nova-compute[71229]: INFO nova.compute.manager [None req-13a8866f-e80f-400e-8462-ee3fb2d04e24 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Terminating instance
Apr 11 15:52:43 user nova-compute[71229]: DEBUG nova.compute.manager [None req-13a8866f-e80f-400e-8462-ee3fb2d04e24 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Start destroying the instance on the hypervisor. {{(pid=71229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 15:52:43 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:52:43 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:52:43 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:52:43 user nova-compute[71229]: DEBUG nova.compute.manager [req-636ace80-60be-4c70-8e2f-6a835dbce17f req-2c7da8b2-0d23-4365-8125-ae851b1de576 service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Received event network-vif-unplugged-cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:52:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-636ace80-60be-4c70-8e2f-6a835dbce17f req-2c7da8b2-0d23-4365-8125-ae851b1de576 service nova] Acquiring lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:52:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-636ace80-60be-4c70-8e2f-6a835dbce17f req-2c7da8b2-0d23-4365-8125-ae851b1de576 service nova] Lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:52:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-636ace80-60be-4c70-8e2f-6a835dbce17f req-2c7da8b2-0d23-4365-8125-ae851b1de576 service nova] Lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:52:43 user nova-compute[71229]: DEBUG nova.compute.manager [req-636ace80-60be-4c70-8e2f-6a835dbce17f req-2c7da8b2-0d23-4365-8125-ae851b1de576 service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] No waiting events found dispatching network-vif-unplugged-cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:52:43 user nova-compute[71229]: DEBUG nova.compute.manager [req-636ace80-60be-4c70-8e2f-6a835dbce17f req-2c7da8b2-0d23-4365-8125-ae851b1de576 service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Received event network-vif-unplugged-cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 15:52:44 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Instance destroyed successfully.
Apr 11 15:52:44 user nova-compute[71229]: DEBUG nova.objects.instance [None req-13a8866f-e80f-400e-8462-ee3fb2d04e24 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lazy-loading 'resources' on Instance uuid f0fc18ff-897c-4f97-95b6-9f25d11dba88 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:52:44 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-13a8866f-e80f-400e-8462-ee3fb2d04e24 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:45:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-264655155',display_name='tempest-ServerStableDeviceRescueTest-server-264655155',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-264655155',id=35,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESSrnhmezC7HQi+h0OdTtButyUJkAu5n8hHJP9eUrxeUgZ1v8+l+B++ncR6In95oR0ORBJlzSH/RoWq4EEt/BxSJF7IPv0bb8yRJgYBk+JaLJ0rhNGgPTIehYPdLc82UA==',key_name='tempest-keypair-363003976',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:49:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='85c9dbdbc7b641f096dc292ea7bf7cd4',ramdisk_id='',reservation_id='r-o21y4kmv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1990539250',owner_user_name='tempest-ServerStableDeviceRescueTest-1990539250-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:51:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b244004380d43699c5a06e817224b3e',uuid=f0fc18ff-897c-4f97-95b6-9f25d11dba88,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01", "address": "fa:16:3e:39:51:c6", "network": {"id": "81031696-fd25-42a1-8c36-43a6eacbab12", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1627850915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c9dbdbc7b641f096dc292ea7bf7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf0cc1bf-40", "ovs_interfaceid": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:52:44 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-13a8866f-e80f-400e-8462-ee3fb2d04e24 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Converting VIF {"id": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01", "address": "fa:16:3e:39:51:c6", "network": {"id": "81031696-fd25-42a1-8c36-43a6eacbab12", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1627850915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c9dbdbc7b641f096dc292ea7bf7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf0cc1bf-40", "ovs_interfaceid": "cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:52:44 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-13a8866f-e80f-400e-8462-ee3fb2d04e24 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:51:c6,bridge_name='br-int',has_traffic_filtering=True,id=cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01,network=Network(81031696-fd25-42a1-8c36-43a6eacbab12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf0cc1bf-40') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:52:44 user nova-compute[71229]: DEBUG os_vif [None req-13a8866f-e80f-400e-8462-ee3fb2d04e24 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:51:c6,bridge_name='br-int',has_traffic_filtering=True,id=cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01,network=Network(81031696-fd25-42a1-8c36-43a6eacbab12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf0cc1bf-40') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:52:44 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:52:44 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcf0cc1bf-40, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:52:44 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:52:44 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:52:44 user nova-compute[71229]: INFO os_vif [None req-13a8866f-e80f-400e-8462-ee3fb2d04e24 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:51:c6,bridge_name='br-int',has_traffic_filtering=True,id=cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01,network=Network(81031696-fd25-42a1-8c36-43a6eacbab12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf0cc1bf-40')
Apr 11 15:52:44 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-13a8866f-e80f-400e-8462-ee3fb2d04e24 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Deleting instance files /opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88_del
Apr 11 15:52:44 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-13a8866f-e80f-400e-8462-ee3fb2d04e24 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Deletion of /opt/stack/data/nova/instances/f0fc18ff-897c-4f97-95b6-9f25d11dba88_del complete
Apr 11 15:52:44 user nova-compute[71229]: INFO nova.compute.manager [None req-13a8866f-e80f-400e-8462-ee3fb2d04e24 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Took 0.83 seconds to destroy the instance on the hypervisor.
Apr 11 15:52:44 user nova-compute[71229]: DEBUG oslo.service.loopingcall [None req-13a8866f-e80f-400e-8462-ee3fb2d04e24 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71229) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 15:52:44 user nova-compute[71229]: DEBUG nova.compute.manager [-] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Deallocating network for instance {{(pid=71229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 15:52:44 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] deallocate_for_instance() {{(pid=71229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 15:52:45 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:52:45 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Took 0.63 seconds to deallocate network for instance.
Apr 11 15:52:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-13a8866f-e80f-400e-8462-ee3fb2d04e24 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:52:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-13a8866f-e80f-400e-8462-ee3fb2d04e24 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:52:45 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-13a8866f-e80f-400e-8462-ee3fb2d04e24 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:52:45 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-13a8866f-e80f-400e-8462-ee3fb2d04e24 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:52:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-13a8866f-e80f-400e-8462-ee3fb2d04e24 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.111s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:52:45 user nova-compute[71229]: INFO nova.scheduler.client.report [None req-13a8866f-e80f-400e-8462-ee3fb2d04e24 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Deleted allocations for instance f0fc18ff-897c-4f97-95b6-9f25d11dba88
Apr 11 15:52:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-13a8866f-e80f-400e-8462-ee3fb2d04e24 tempest-ServerStableDeviceRescueTest-1990539250 tempest-ServerStableDeviceRescueTest-1990539250-project-member] Lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.770s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:52:45 user nova-compute[71229]: DEBUG nova.compute.manager [req-e3da1f23-c521-40ef-a361-e8dabc8cdb5e req-78f879d2-4588-47da-bb58-c15f185498d6 service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Received event network-vif-plugged-cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:52:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e3da1f23-c521-40ef-a361-e8dabc8cdb5e req-78f879d2-4588-47da-bb58-c15f185498d6 service nova] Acquiring lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:52:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e3da1f23-c521-40ef-a361-e8dabc8cdb5e req-78f879d2-4588-47da-bb58-c15f185498d6 service nova] Lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:52:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e3da1f23-c521-40ef-a361-e8dabc8cdb5e req-78f879d2-4588-47da-bb58-c15f185498d6 service nova] Lock "f0fc18ff-897c-4f97-95b6-9f25d11dba88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:52:45 user nova-compute[71229]: DEBUG nova.compute.manager [req-e3da1f23-c521-40ef-a361-e8dabc8cdb5e req-78f879d2-4588-47da-bb58-c15f185498d6 service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] No waiting events found dispatching network-vif-plugged-cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:52:45 user nova-compute[71229]: WARNING nova.compute.manager [req-e3da1f23-c521-40ef-a361-e8dabc8cdb5e req-78f879d2-4588-47da-bb58-c15f185498d6 service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Received unexpected event network-vif-plugged-cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 for instance with vm_state deleted and task_state None.
Apr 11 15:52:45 user nova-compute[71229]: DEBUG nova.compute.manager [req-e3da1f23-c521-40ef-a361-e8dabc8cdb5e req-78f879d2-4588-47da-bb58-c15f185498d6 service nova] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Received event network-vif-deleted-cf0cc1bf-40cf-47ed-a68b-4d5caa2fba01 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:52:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:52:52 user nova-compute[71229]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681228357.355126, 6f6ae64a-c760-4ba3-8a50-d380835d9913 => Stopped> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:52:52 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] VM Stopped (Lifecycle Event)
Apr 11 15:52:52 user nova-compute[71229]: DEBUG nova.compute.manager [None req-2311ed77-8071-4594-9dc6-6c8e6016d528 None None] [instance: 6f6ae64a-c760-4ba3-8a50-d380835d9913] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:52:54 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:52:59 user nova-compute[71229]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681228364.376417, f0fc18ff-897c-4f97-95b6-9f25d11dba88 => Stopped> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:52:59 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] VM Stopped (Lifecycle Event)
Apr 11 15:52:59 user nova-compute[71229]: DEBUG nova.compute.manager [None req-cb5c983c-a789-4870-93a3-d022b09d3bfe None None] [instance: f0fc18ff-897c-4f97-95b6-9f25d11dba88] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:52:59 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:53:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:53:09 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:53:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:53:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "56fbe043-133f-4e43-b9db-8ed02a3ed2af" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:53:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "56fbe043-133f-4e43-b9db-8ed02a3ed2af" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:53:16 user nova-compute[71229]: DEBUG nova.compute.manager [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Starting instance... {{(pid=71229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 15:53:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:53:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:53:16 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 15:53:16 user nova-compute[71229]: INFO nova.compute.claims [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Claim successful on node user
Apr 11 15:53:16 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:53:16 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 15:53:16 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Rebuilding the list of instances to heal {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 15:53:16 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Didn't find any instances for network info cache update. {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 15:53:16 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Refreshing inventories for resource provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 15:53:16 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Updating ProviderTree inventory for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 15:53:16 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Updating inventory in ProviderTree for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 15:53:16 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Refreshing aggregate associations for resource provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de, aggregates: None {{(pid=71229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 15:53:16 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Refreshing trait associations for resource provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de, traits: COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=71229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 15:53:16 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:53:16 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:53:17 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.328s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:53:17 user nova-compute[71229]: DEBUG nova.compute.manager [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Start building networks asynchronously for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 15:53:17 user nova-compute[71229]: DEBUG nova.compute.manager [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Allocating IP information in the background. {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 15:53:17 user nova-compute[71229]: DEBUG nova.network.neutron [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] allocate_for_instance() {{(pid=71229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 15:53:17 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 15:53:17 user nova-compute[71229]: DEBUG nova.compute.manager [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Start building block device mappings for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 15:53:17 user nova-compute[71229]: INFO nova.virt.block_device [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Booting with volume 8e80be1f-47e3-4658-bdfe-610ca8e958a0 at /dev/vda
Apr 11 15:53:17 user nova-compute[71229]: DEBUG nova.policy [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c2110b74f38642afa560e1c9790d3f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312851c65ba1434691eca0cd2a8cd6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71229) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 15:53:17 user nova-compute[71229]: DEBUG os_brick.utils [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:53:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:53:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:53:17 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1200e694-b4d4-48e7-a7aa-e5befc347b76]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d55e24a97c90\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:53:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:53:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:53:17 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[325af7c8-c74c-4c8e-a117-7cb1f2c9b0e3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:53:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:53:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:53:17 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9013757a-a0fb-4152-8ebd-f187e9c1a0e3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:53:17 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ea569e-4297-4542-a994-67684eadc8ca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:53:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Running cmd (subprocess): nvme version {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:53:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 'nvme version' failed. Not Retrying. {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:53:17 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] nvme not present on system {{(pid=71229) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 15:53:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:53:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:53:17 user nova-compute[71229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 15:53:17 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a8238d-2d2f-4a3c-9135-7c48006caae7]: (4, '') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:53:17 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71229) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 15:53:17 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 15:53:17 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] LIGHTOS: no hostnqn found. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 15:53:17 user nova-compute[71229]: DEBUG os_brick.utils [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d55e24a97c90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:53:17 user nova-compute[71229]: DEBUG nova.virt.block_device [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Updating existing volume attachment record: 2a029428-6109-41a5-9666-5377b4b7e72d {{(pid=71229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 15:53:17 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:53:17 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 15:53:17 user nova-compute[71229]: DEBUG nova.network.neutron [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Successfully created port: 77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 15:53:18 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:53:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:53:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:53:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:53:18 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 15:53:19 user nova-compute[71229]: DEBUG nova.network.neutron [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Successfully updated port: 77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:53:19 user nova-compute[71229]: DEBUG nova.compute.manager [req-d21dc0b8-2fda-4397-b90e-e48ca4224aa2 req-c31881bc-843f-41f2-8279-59c7d7824b3e service nova] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Received event network-changed-77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:53:19 user nova-compute[71229]: DEBUG nova.compute.manager [req-d21dc0b8-2fda-4397-b90e-e48ca4224aa2 req-c31881bc-843f-41f2-8279-59c7d7824b3e service nova] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Refreshing instance network info cache due to event network-changed-77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:53:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-d21dc0b8-2fda-4397-b90e-e48ca4224aa2 req-c31881bc-843f-41f2-8279-59c7d7824b3e service nova] Acquiring lock "refresh_cache-56fbe043-133f-4e43-b9db-8ed02a3ed2af" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:53:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-d21dc0b8-2fda-4397-b90e-e48ca4224aa2 req-c31881bc-843f-41f2-8279-59c7d7824b3e service nova] Acquired lock "refresh_cache-56fbe043-133f-4e43-b9db-8ed02a3ed2af" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:53:19 user nova-compute[71229]: DEBUG nova.network.neutron [req-d21dc0b8-2fda-4397-b90e-e48ca4224aa2 req-c31881bc-843f-41f2-8279-59c7d7824b3e service nova] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Refreshing network info cache for port 77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:53:19 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:53:19 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:53:19 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8849MB free_disk=26.03736114501953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 15:53:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:53:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:53:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "refresh_cache-56fbe043-133f-4e43-b9db-8ed02a3ed2af" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:53:19 user nova-compute[71229]: DEBUG nova.network.neutron [req-d21dc0b8-2fda-4397-b90e-e48ca4224aa2 req-c31881bc-843f-41f2-8279-59c7d7824b3e service nova] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:53:19 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 56fbe043-133f-4e43-b9db-8ed02a3ed2af actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:53:19 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 15:53:19 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 15:53:19 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:53:19 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:53:19 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 15:53:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.185s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:53:19 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:53:19 user nova-compute[71229]: DEBUG nova.network.neutron [req-d21dc0b8-2fda-4397-b90e-e48ca4224aa2 req-c31881bc-843f-41f2-8279-59c7d7824b3e service nova] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:53:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-d21dc0b8-2fda-4397-b90e-e48ca4224aa2 req-c31881bc-843f-41f2-8279-59c7d7824b3e service nova] Releasing lock "refresh_cache-56fbe043-133f-4e43-b9db-8ed02a3ed2af" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:53:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquired lock "refresh_cache-56fbe043-133f-4e43-b9db-8ed02a3ed2af" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:53:19 user nova-compute[71229]: DEBUG nova.network.neutron [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:53:19 user nova-compute[71229]: DEBUG nova.network.neutron [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:53:19 user nova-compute[71229]: DEBUG nova.network.neutron [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Updating instance_info_cache with network_info: [{"id": "77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b", "address": "fa:16:3e:82:55:d8", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f40fdc-0c", "ovs_interfaceid": "77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:53:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Releasing lock "refresh_cache-56fbe043-133f-4e43-b9db-8ed02a3ed2af" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:53:19 user nova-compute[71229]: DEBUG nova.compute.manager [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Instance network_info: |[{"id": "77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b", "address": "fa:16:3e:82:55:d8", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f40fdc-0c", "ovs_interfaceid": "77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG nova.compute.manager [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Start spawning the instance on the hypervisor. {{(pid=71229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Creating instance directory {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 15:53:21 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Creating image(s)
Apr 11 15:53:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Did not create local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Ensure instance console log exists: /opt/stack/data/nova/instances/56fbe043-133f-4e43-b9db-8ed02a3ed2af/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Start _get_guest_xml network_info=[{"id": "77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b", "address": "fa:16:3e:82:55:d8", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f40fdc-0c", "ovs_interfaceid": "77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bYXCcZln', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '56fbe043-133f-4e43-b9db-8ed02a3ed2af', 'attached_at': '', 'detached_at': '', 'volume_id': '8e80be1f-47e3-4658-bdfe-610ca8e958a0', 'serial': '8e80be1f-47e3-4658-bdfe-610ca8e958a0'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '2a029428-6109-41a5-9666-5377b4b7e72d', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:53:21 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:53:21 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:53:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bYXCcZln', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:53:21 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:53:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:53:21 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:53:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:53:21 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 15:53:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c94ad1-3e31-4fdc-ba73-fbb7d6768836]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 15:53:21 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e245c3bb-4a11-42d9-8d1c-026bfe40cbc6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0] added\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0] added
Apr 11 15:53:21 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc12b85-ec8c-4629-8bf3-4a5ae10382ab]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0a2e0c-f977-409a-9f35-6db3fea7b4d0]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bYXCcZln {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bYXCcZln" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[05022448-3482-458b-b897-29b2adb13fff]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bYXCcZln'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b03aef9-f6ba-4a50-9127-574ae7007748]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4338d42c-d019-43bf-b1b2-1788633fedbd]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 11 15:53:21 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 11 15:53:21 user nova-compute[71229]:  {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:53:21 user nova-compute[71229]: WARNING os_brick.initiator.connectors.iscsi [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 11 15:53:21 user nova-compute[71229]: 
Apr 11 15:53:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 -p 172.16.0.220:3260 --login {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad37ea6-48c1-467e-938b-28301a633f1a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0, portal: 172.16.0.220,3260]
Apr 11 15:53:21 user nova-compute[71229]: Login to [iface: default, target: iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0, portal: 172.16.0.220,3260] successful.
Apr 11 15:53:21 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dafd131-e520-4009-a2f6-7aba294e6db1]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[99cff53b-daf9-4799-b82c-e204f74eb30c]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 (non-flash)
Apr 11 15:53:21 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 (non-flash)
Apr 11 15:53:21 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[47da1594-f6e8-46e6-be2b-4c9b36113d7b]: (4, ('- - 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:53:21 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bYXCcZln', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 15:53:22 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:53:22 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:53:22 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:53:22 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '26361366139316636', 'path': '/dev/sdb'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:53:22 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361366139316636', 'path': '/dev/sdb'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 15:53:22 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-168309070',display_name='tempest-TestVolumeBootPattern-server-168309070',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-168309070',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHFmBexXT+1iiEvWvrTBCCfLTFSZaBECTRUjU2HFOZ99DTdS224XqNm6W0NLu+fhNbtUG4d3cptal0K2Oy5ZbjfRTK7G/g++ylfyvf1YI+eSa1yX5tyMrdSO5dom9On9A==',key_name='tempest-TestVolumeBootPattern-1289860889',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='312851c65ba1434691eca0cd2a8cd6d2',ramdisk_id='',reservation_id='r-a246itbz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1933582504',owner_user_name='tempest-TestVolumeBootPattern-1933582504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:53:17Z,user_data=None,user_id='c2110b74f38642afa560e1c9790d3f81',uuid=56fbe043-133f-4e43-b9db-8ed02a3ed2af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b", "address": "fa:16:3e:82:55:d8", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f40fdc-0c", "ovs_interfaceid": "77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:53:22 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Converting VIF {"id": "77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b", "address": "fa:16:3e:82:55:d8", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f40fdc-0c", "ovs_interfaceid": "77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:53:22 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:55:d8,bridge_name='br-int',has_traffic_filtering=True,id=77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b,network=Network(8d262ba8-b9c3-44ed-8431-6c295eb9ea24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77f40fdc-0c') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:53:22 user nova-compute[71229]: DEBUG nova.objects.instance [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lazy-loading 'pci_devices' on Instance uuid 56fbe043-133f-4e43-b9db-8ed02a3ed2af {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:53:22 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:53:22 user nova-compute[71229]:   <uuid>56fbe043-133f-4e43-b9db-8ed02a3ed2af</uuid>
Apr 11 15:53:22 user nova-compute[71229]:   <name>instance-00000026</name>
Apr 11 15:53:22 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:53:22 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:53:22 user nova-compute[71229]:   <metadata>
Apr 11 15:53:22 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:53:22 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:53:22 user nova-compute[71229]:       <nova:name>tempest-TestVolumeBootPattern-server-168309070</nova:name>
Apr 11 15:53:22 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:53:21</nova:creationTime>
Apr 11 15:53:22 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:53:22 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:53:22 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:53:22 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:53:22 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:53:22 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:53:22 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:53:22 user nova-compute[71229]:       <nova:owner>
Apr 11 15:53:22 user nova-compute[71229]:         <nova:user uuid="c2110b74f38642afa560e1c9790d3f81">tempest-TestVolumeBootPattern-1933582504-project-member</nova:user>
Apr 11 15:53:22 user nova-compute[71229]:         <nova:project uuid="312851c65ba1434691eca0cd2a8cd6d2">tempest-TestVolumeBootPattern-1933582504</nova:project>
Apr 11 15:53:22 user nova-compute[71229]:       </nova:owner>
Apr 11 15:53:22 user nova-compute[71229]:       <nova:ports>
Apr 11 15:53:22 user nova-compute[71229]:         <nova:port uuid="77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b">
Apr 11 15:53:22 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 11 15:53:22 user nova-compute[71229]:         </nova:port>
Apr 11 15:53:22 user nova-compute[71229]:       </nova:ports>
Apr 11 15:53:22 user nova-compute[71229]:     </nova:instance>
Apr 11 15:53:22 user nova-compute[71229]:   </metadata>
Apr 11 15:53:22 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:53:22 user nova-compute[71229]:     <system>
Apr 11 15:53:22 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:53:22 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:53:22 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:53:22 user nova-compute[71229]:       <entry name="serial">56fbe043-133f-4e43-b9db-8ed02a3ed2af</entry>
Apr 11 15:53:22 user nova-compute[71229]:       <entry name="uuid">56fbe043-133f-4e43-b9db-8ed02a3ed2af</entry>
Apr 11 15:53:22 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:53:22 user nova-compute[71229]:     </system>
Apr 11 15:53:22 user nova-compute[71229]:   </sysinfo>
Apr 11 15:53:22 user nova-compute[71229]:   <os>
Apr 11 15:53:22 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:53:22 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 15:53:22 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:53:22 user nova-compute[71229]:   </os>
Apr 11 15:53:22 user nova-compute[71229]:   <features>
Apr 11 15:53:22 user nova-compute[71229]:     <acpi/>
Apr 11 15:53:22 user nova-compute[71229]:     <apic/>
Apr 11 15:53:22 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:53:22 user nova-compute[71229]:   </features>
Apr 11 15:53:22 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:53:22 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:53:22 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:53:22 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:53:22 user nova-compute[71229]:   </clock>
Apr 11 15:53:22 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:53:22 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:53:22 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:53:22 user nova-compute[71229]:   </cpu>
Apr 11 15:53:22 user nova-compute[71229]:   <devices>
Apr 11 15:53:22 user nova-compute[71229]:     <disk type="block" device="disk">
Apr 11 15:53:22 user nova-compute[71229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:53:22 user nova-compute[71229]:       <source dev="/dev/sdb"/>
Apr 11 15:53:22 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:53:22 user nova-compute[71229]:       <serial>8e80be1f-47e3-4658-bdfe-610ca8e958a0</serial>
Apr 11 15:53:22 user nova-compute[71229]:     </disk>
Apr 11 15:53:22 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:53:22 user nova-compute[71229]:       <mac address="fa:16:3e:82:55:d8"/>
Apr 11 15:53:22 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:53:22 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:53:22 user nova-compute[71229]:       <target dev="tap77f40fdc-0c"/>
Apr 11 15:53:22 user nova-compute[71229]:     </interface>
Apr 11 15:53:22 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:53:22 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/56fbe043-133f-4e43-b9db-8ed02a3ed2af/console.log" append="off"/>
Apr 11 15:53:22 user nova-compute[71229]:     </serial>
Apr 11 15:53:22 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:53:22 user nova-compute[71229]:     <video>
Apr 11 15:53:22 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:53:22 user nova-compute[71229]:     </video>
Apr 11 15:53:22 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:53:22 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:53:22 user nova-compute[71229]:     </rng>
Apr 11 15:53:22 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:53:22 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:53:22 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:53:22 user nova-compute[71229]:     </memballoon>
Apr 11 15:53:22 user nova-compute[71229]:   </devices>
Apr 11 15:53:22 user nova-compute[71229]: </domain>
Apr 11 15:53:22 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:53:23 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-168309070',display_name='tempest-TestVolumeBootPattern-server-168309070',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-168309070',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHFmBexXT+1iiEvWvrTBCCfLTFSZaBECTRUjU2HFOZ99DTdS224XqNm6W0NLu+fhNbtUG4d3cptal0K2Oy5ZbjfRTK7G/g++ylfyvf1YI+eSa1yX5tyMrdSO5dom9On9A==',key_name='tempest-TestVolumeBootPattern-1289860889',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='312851c65ba1434691eca0cd2a8cd6d2',ramdisk_id='',reservation_id='r-a246itbz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1933582504',owner_user_name='tempest-TestVolumeBootPattern-1933582504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:53:17Z,user_data=None,user_id='c2110b74f38642afa560e1c9790d3f81',uuid=56fbe043-133f-4e43-b9db-8ed02a3ed2af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b", "address": "fa:16:3e:82:55:d8", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f40fdc-0c", "ovs_interfaceid": "77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:53:23 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Converting VIF {"id": "77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b", "address": "fa:16:3e:82:55:d8", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f40fdc-0c", "ovs_interfaceid": "77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:53:23 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:55:d8,bridge_name='br-int',has_traffic_filtering=True,id=77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b,network=Network(8d262ba8-b9c3-44ed-8431-6c295eb9ea24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77f40fdc-0c') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:53:23 user nova-compute[71229]: DEBUG os_vif [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:55:d8,bridge_name='br-int',has_traffic_filtering=True,id=77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b,network=Network(8d262ba8-b9c3-44ed-8431-6c295eb9ea24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77f40fdc-0c') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:53:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:53:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:53:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:53:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:53:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap77f40fdc-0c, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:53:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap77f40fdc-0c, col_values=(('external_ids', {'iface-id': '77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:55:d8', 'vm-uuid': '56fbe043-133f-4e43-b9db-8ed02a3ed2af'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:53:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:53:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:53:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:53:23 user nova-compute[71229]: INFO os_vif [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:55:d8,bridge_name='br-int',has_traffic_filtering=True,id=77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b,network=Network(8d262ba8-b9c3-44ed-8431-6c295eb9ea24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77f40fdc-0c')
Apr 11 15:53:23 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:53:23 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] No VIF found with MAC fa:16:3e:82:55:d8, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:53:23 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:53:24 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:53:24 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:53:24 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:53:24 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:53:24 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:53:24 user nova-compute[71229]: DEBUG nova.compute.manager [req-9921dafe-8137-4e88-aad6-fe713a97188f req-bfe27d1d-c682-462d-a410-709b21d237b7 service nova] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Received event network-vif-plugged-77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:53:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-9921dafe-8137-4e88-aad6-fe713a97188f req-bfe27d1d-c682-462d-a410-709b21d237b7 service nova] Acquiring lock "56fbe043-133f-4e43-b9db-8ed02a3ed2af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:53:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-9921dafe-8137-4e88-aad6-fe713a97188f req-bfe27d1d-c682-462d-a410-709b21d237b7 service nova] Lock "56fbe043-133f-4e43-b9db-8ed02a3ed2af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:53:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-9921dafe-8137-4e88-aad6-fe713a97188f req-bfe27d1d-c682-462d-a410-709b21d237b7 service nova] Lock "56fbe043-133f-4e43-b9db-8ed02a3ed2af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:53:24 user nova-compute[71229]: DEBUG nova.compute.manager [req-9921dafe-8137-4e88-aad6-fe713a97188f req-bfe27d1d-c682-462d-a410-709b21d237b7 service nova] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] No waiting events found dispatching network-vif-plugged-77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:53:24 user nova-compute[71229]: WARNING nova.compute.manager [req-9921dafe-8137-4e88-aad6-fe713a97188f req-bfe27d1d-c682-462d-a410-709b21d237b7 service nova] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Received unexpected event network-vif-plugged-77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b for instance with vm_state building and task_state spawning.
Apr 11 15:53:24 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:53:24 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:53:24 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:53:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:53:25 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:53:26 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681228406.458663, 56fbe043-133f-4e43-b9db-8ed02a3ed2af => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:53:26 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] VM Resumed (Lifecycle Event)
Apr 11 15:53:26 user nova-compute[71229]: DEBUG nova.compute.manager [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 15:53:26 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Guest created on hypervisor {{(pid=71229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 15:53:26 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Instance spawned successfully.
Apr 11 15:53:26 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 15:53:26 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:53:26 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Found default for hw_cdrom_bus of ide {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:53:26 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Found default for hw_disk_bus of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:53:26 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Found default for hw_input_bus of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:53:26 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Found default for hw_pointer_model of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:53:26 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Found default for hw_video_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:53:26 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Found default for hw_vif_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:53:26 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:53:26 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:53:26 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681228406.4598196, 56fbe043-133f-4e43-b9db-8ed02a3ed2af => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:53:26 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] VM Started (Lifecycle Event)
Apr 11 15:53:26 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:53:26 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:53:26 user nova-compute[71229]: INFO nova.compute.manager [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Took 5.08 seconds to spawn the instance on the hypervisor.
Apr 11 15:53:26 user nova-compute[71229]: DEBUG nova.compute.manager [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:53:26 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:53:26 user nova-compute[71229]: INFO nova.compute.manager [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Took 10.07 seconds to build instance.
Apr 11 15:53:26 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-d12084c1-2ecc-4de9-a3d5-de9e6bc1ead6 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "56fbe043-133f-4e43-b9db-8ed02a3ed2af" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.174s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:53:26 user nova-compute[71229]: DEBUG nova.compute.manager [req-3e79a472-b312-48a9-8766-002ebc078e25 req-f8fa174b-0df1-4711-b558-6183a923cff9 service nova] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Received event network-vif-plugged-77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:53:26 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3e79a472-b312-48a9-8766-002ebc078e25 req-f8fa174b-0df1-4711-b558-6183a923cff9 service nova] Acquiring lock "56fbe043-133f-4e43-b9db-8ed02a3ed2af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:53:26 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3e79a472-b312-48a9-8766-002ebc078e25 req-f8fa174b-0df1-4711-b558-6183a923cff9 service nova] Lock "56fbe043-133f-4e43-b9db-8ed02a3ed2af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:53:26 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3e79a472-b312-48a9-8766-002ebc078e25 req-f8fa174b-0df1-4711-b558-6183a923cff9 service nova] Lock "56fbe043-133f-4e43-b9db-8ed02a3ed2af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:53:26 user nova-compute[71229]: DEBUG nova.compute.manager [req-3e79a472-b312-48a9-8766-002ebc078e25 req-f8fa174b-0df1-4711-b558-6183a923cff9 service nova] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] No waiting events found dispatching network-vif-plugged-77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:53:26 user nova-compute[71229]: WARNING nova.compute.manager [req-3e79a472-b312-48a9-8766-002ebc078e25 req-f8fa174b-0df1-4711-b558-6183a923cff9 service nova] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Received unexpected event network-vif-plugged-77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b for instance with vm_state active and task_state None.
Apr 11 15:53:27 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:53:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:53:29 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:53:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:53:33 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:53:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:53:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:53:42 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:53:42 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:53:43 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:53:45 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:53:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:53:48 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:53:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:53:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:53:48 user nova-compute[71229]: DEBUG nova.compute.manager [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Starting instance... {{(pid=71229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 15:53:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:53:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:53:48 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 15:53:48 user nova-compute[71229]: INFO nova.compute.claims [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Claim successful on node user
Apr 11 15:53:48 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:53:48 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:53:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.214s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:53:48 user nova-compute[71229]: DEBUG nova.compute.manager [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Start building networks asynchronously for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 15:53:48 user nova-compute[71229]: DEBUG nova.compute.manager [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Allocating IP information in the background. {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 15:53:48 user nova-compute[71229]: DEBUG nova.network.neutron [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] allocate_for_instance() {{(pid=71229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 15:53:48 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 15:53:48 user nova-compute[71229]: DEBUG nova.compute.manager [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Start building block device mappings for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 15:53:48 user nova-compute[71229]: DEBUG nova.policy [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa87f179b35a4d1db2336802e8f104e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa330c512f045dc8a5946be3563fdcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71229) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 15:53:48 user nova-compute[71229]: DEBUG nova.compute.manager [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Start spawning the instance on the hypervisor. {{(pid=71229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 15:53:48 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Creating instance directory {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 15:53:48 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Creating image(s)
Apr 11 15:53:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "/opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:53:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "/opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:53:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "/opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:53:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:53:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.139s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:53:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:53:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:53:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:53:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.138s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:53:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk 1073741824 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:53:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk 1073741824" returned: 0 in 0.048s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:53:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:53:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:53:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.137s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:53:49 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk. size=1073741824 {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 15:53:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:53:49 user nova-compute[71229]: DEBUG nova.network.neutron [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Successfully created port: 8fd17bd8-2470-4931-8df3-b1ca41125d39 {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 15:53:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:53:49 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Cannot resize image /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk to a smaller size. {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 15:53:49 user nova-compute[71229]: DEBUG nova.objects.instance [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lazy-loading 'migration_context' on Instance uuid 0d6c5972-e53b-47e9-8f13-7df1ad86020e {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:53:49 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Created local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 15:53:49 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Ensure instance console log exists: /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 15:53:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:53:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:53:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:53:49 user nova-compute[71229]: DEBUG nova.network.neutron [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Successfully updated port: 8fd17bd8-2470-4931-8df3-b1ca41125d39 {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:53:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "refresh_cache-0d6c5972-e53b-47e9-8f13-7df1ad86020e" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:53:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquired lock "refresh_cache-0d6c5972-e53b-47e9-8f13-7df1ad86020e" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:53:49 user nova-compute[71229]: DEBUG nova.network.neutron [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:53:49 user nova-compute[71229]: DEBUG nova.network.neutron [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:53:49 user nova-compute[71229]: DEBUG nova.compute.manager [req-f2b15ab9-5783-44ee-9bc5-629e78fa61ec req-9a1b03e2-e936-46f9-8a42-ef034dee60bd service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Received event network-changed-8fd17bd8-2470-4931-8df3-b1ca41125d39 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:53:49 user nova-compute[71229]: DEBUG nova.compute.manager [req-f2b15ab9-5783-44ee-9bc5-629e78fa61ec req-9a1b03e2-e936-46f9-8a42-ef034dee60bd service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Refreshing instance network info cache due to event network-changed-8fd17bd8-2470-4931-8df3-b1ca41125d39. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:53:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-f2b15ab9-5783-44ee-9bc5-629e78fa61ec req-9a1b03e2-e936-46f9-8a42-ef034dee60bd service nova] Acquiring lock "refresh_cache-0d6c5972-e53b-47e9-8f13-7df1ad86020e" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:53:50 user nova-compute[71229]: DEBUG nova.network.neutron [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Updating instance_info_cache with network_info: [{"id": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "address": "fa:16:3e:ba:60:e0", "network": {"id": "e6f9483b-53f6-4696-b451-52aeb6ec13d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822664747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa330c512f045dc8a5946be3563fdcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd17bd8-24", "ovs_interfaceid": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:53:50 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Releasing lock "refresh_cache-0d6c5972-e53b-47e9-8f13-7df1ad86020e" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:53:50 user nova-compute[71229]: DEBUG nova.compute.manager [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Instance network_info: |[{"id": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "address": "fa:16:3e:ba:60:e0", "network": {"id": "e6f9483b-53f6-4696-b451-52aeb6ec13d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822664747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa330c512f045dc8a5946be3563fdcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd17bd8-24", "ovs_interfaceid": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 15:53:50 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-f2b15ab9-5783-44ee-9bc5-629e78fa61ec req-9a1b03e2-e936-46f9-8a42-ef034dee60bd service nova] Acquired lock "refresh_cache-0d6c5972-e53b-47e9-8f13-7df1ad86020e" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:53:50 user nova-compute[71229]: DEBUG nova.network.neutron [req-f2b15ab9-5783-44ee-9bc5-629e78fa61ec req-9a1b03e2-e936-46f9-8a42-ef034dee60bd service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Refreshing network info cache for port 8fd17bd8-2470-4931-8df3-b1ca41125d39 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:53:50 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Start _get_guest_xml network_info=[{"id": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "address": "fa:16:3e:ba:60:e0", "network": {"id": "e6f9483b-53f6-4696-b451-52aeb6ec13d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822664747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa330c512f045dc8a5946be3563fdcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd17bd8-24", "ovs_interfaceid": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '52fe638c-5ada-47d5-b376-233bfa808a37'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:53:50 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:53:50 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:53:50 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:53:50 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:53:50 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:53:50 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:53:50 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:53:50 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:53:50 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:53:50 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:53:50 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:53:50 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:53:50 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:53:50 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:53:50 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:53:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-873450080',display_name='tempest-AttachVolumeTestJSON-server-873450080',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-873450080',id=39,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA++uuXe6FyaUH7+6A7LXI9JAeQOW0LGZU8i83jm7ocQcCkrPDDJFgc0QxuJD62Az+edRqtAEJw2zMA+YyRUWi6KTatWRW/2wsFjFL2TMdY96WvhmRoEL5HXtf0K6rtWuw==',key_name='tempest-keypair-1501547376',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8fa330c512f045dc8a5946be3563fdcd',ramdisk_id='',reservation_id='r-y1ru7450',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1691938977',owner_user_name='tempest-AttachVolumeTestJSON-1691938977-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:53:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa87f179b35a4d1db2336802e8f104e4',uuid=0d6c5972-e53b-47e9-8f13-7df1ad86020e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "address": "fa:16:3e:ba:60:e0", "network": {"id": "e6f9483b-53f6-4696-b451-52aeb6ec13d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822664747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa330c512f045dc8a5946be3563fdcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd17bd8-24", "ovs_interfaceid": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:53:50 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Converting VIF {"id": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "address": "fa:16:3e:ba:60:e0", "network": {"id": "e6f9483b-53f6-4696-b451-52aeb6ec13d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822664747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa330c512f045dc8a5946be3563fdcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd17bd8-24", "ovs_interfaceid": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:53:50 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:60:e0,bridge_name='br-int',has_traffic_filtering=True,id=8fd17bd8-2470-4931-8df3-b1ca41125d39,network=Network(e6f9483b-53f6-4696-b451-52aeb6ec13d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fd17bd8-24') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:53:50 user nova-compute[71229]: DEBUG nova.objects.instance [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d6c5972-e53b-47e9-8f13-7df1ad86020e {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:53:50 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:53:50 user nova-compute[71229]:   <uuid>0d6c5972-e53b-47e9-8f13-7df1ad86020e</uuid>
Apr 11 15:53:50 user nova-compute[71229]:   <name>instance-00000027</name>
Apr 11 15:53:50 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:53:50 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:53:50 user nova-compute[71229]:   <metadata>
Apr 11 15:53:50 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:53:50 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:53:50 user nova-compute[71229]:       <nova:name>tempest-AttachVolumeTestJSON-server-873450080</nova:name>
Apr 11 15:53:50 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:53:50</nova:creationTime>
Apr 11 15:53:50 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:53:50 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:53:50 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:53:50 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:53:50 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:53:50 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:53:50 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:53:50 user nova-compute[71229]:       <nova:owner>
Apr 11 15:53:50 user nova-compute[71229]:         <nova:user uuid="aa87f179b35a4d1db2336802e8f104e4">tempest-AttachVolumeTestJSON-1691938977-project-member</nova:user>
Apr 11 15:53:50 user nova-compute[71229]:         <nova:project uuid="8fa330c512f045dc8a5946be3563fdcd">tempest-AttachVolumeTestJSON-1691938977</nova:project>
Apr 11 15:53:50 user nova-compute[71229]:       </nova:owner>
Apr 11 15:53:50 user nova-compute[71229]:       <nova:root type="image" uuid="52fe638c-5ada-47d5-b376-233bfa808a37"/>
Apr 11 15:53:50 user nova-compute[71229]:       <nova:ports>
Apr 11 15:53:50 user nova-compute[71229]:         <nova:port uuid="8fd17bd8-2470-4931-8df3-b1ca41125d39">
Apr 11 15:53:50 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 11 15:53:50 user nova-compute[71229]:         </nova:port>
Apr 11 15:53:50 user nova-compute[71229]:       </nova:ports>
Apr 11 15:53:50 user nova-compute[71229]:     </nova:instance>
Apr 11 15:53:50 user nova-compute[71229]:   </metadata>
Apr 11 15:53:50 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:53:50 user nova-compute[71229]:     <system>
Apr 11 15:53:50 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:53:50 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:53:50 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:53:50 user nova-compute[71229]:       <entry name="serial">0d6c5972-e53b-47e9-8f13-7df1ad86020e</entry>
Apr 11 15:53:50 user nova-compute[71229]:       <entry name="uuid">0d6c5972-e53b-47e9-8f13-7df1ad86020e</entry>
Apr 11 15:53:50 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:53:50 user nova-compute[71229]:     </system>
Apr 11 15:53:50 user nova-compute[71229]:   </sysinfo>
Apr 11 15:53:50 user nova-compute[71229]:   <os>
Apr 11 15:53:50 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:53:50 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 15:53:50 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:53:50 user nova-compute[71229]:   </os>
Apr 11 15:53:50 user nova-compute[71229]:   <features>
Apr 11 15:53:50 user nova-compute[71229]:     <acpi/>
Apr 11 15:53:50 user nova-compute[71229]:     <apic/>
Apr 11 15:53:50 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:53:50 user nova-compute[71229]:   </features>
Apr 11 15:53:50 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:53:50 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:53:50 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:53:50 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:53:50 user nova-compute[71229]:   </clock>
Apr 11 15:53:50 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:53:50 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:53:50 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:53:50 user nova-compute[71229]:   </cpu>
Apr 11 15:53:50 user nova-compute[71229]:   <devices>
Apr 11 15:53:50 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 15:53:50 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 15:53:50 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk"/>
Apr 11 15:53:50 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:53:50 user nova-compute[71229]:     </disk>
Apr 11 15:53:50 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:53:50 user nova-compute[71229]:       <mac address="fa:16:3e:ba:60:e0"/>
Apr 11 15:53:50 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:53:50 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:53:50 user nova-compute[71229]:       <target dev="tap8fd17bd8-24"/>
Apr 11 15:53:50 user nova-compute[71229]:     </interface>
Apr 11 15:53:50 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:53:50 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/console.log" append="off"/>
Apr 11 15:53:50 user nova-compute[71229]:     </serial>
Apr 11 15:53:50 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:53:50 user nova-compute[71229]:     <video>
Apr 11 15:53:50 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:53:50 user nova-compute[71229]:     </video>
Apr 11 15:53:50 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:53:50 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:53:50 user nova-compute[71229]:     </rng>
Apr 11 15:53:50 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:53:50 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:53:50 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:53:50 user nova-compute[71229]:     </memballoon>
Apr 11 15:53:50 user nova-compute[71229]:   </devices>
Apr 11 15:53:50 user nova-compute[71229]: </domain>
Apr 11 15:53:50 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:53:50 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:53:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-873450080',display_name='tempest-AttachVolumeTestJSON-server-873450080',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-873450080',id=39,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA++uuXe6FyaUH7+6A7LXI9JAeQOW0LGZU8i83jm7ocQcCkrPDDJFgc0QxuJD62Az+edRqtAEJw2zMA+YyRUWi6KTatWRW/2wsFjFL2TMdY96WvhmRoEL5HXtf0K6rtWuw==',key_name='tempest-keypair-1501547376',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8fa330c512f045dc8a5946be3563fdcd',ramdisk_id='',reservation_id='r-y1ru7450',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1691938977',owner_user_name='tempest-AttachVolumeTestJSON-1691938977-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:53:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa87f179b35a4d1db2336802e8f104e4',uuid=0d6c5972-e53b-47e9-8f13-7df1ad86020e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "address": "fa:16:3e:ba:60:e0", "network": {"id": "e6f9483b-53f6-4696-b451-52aeb6ec13d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822664747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa330c512f045dc8a5946be3563fdcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd17bd8-24", "ovs_interfaceid": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:53:50 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Converting VIF {"id": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "address": "fa:16:3e:ba:60:e0", "network": {"id": "e6f9483b-53f6-4696-b451-52aeb6ec13d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822664747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa330c512f045dc8a5946be3563fdcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd17bd8-24", "ovs_interfaceid": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:53:50 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:60:e0,bridge_name='br-int',has_traffic_filtering=True,id=8fd17bd8-2470-4931-8df3-b1ca41125d39,network=Network(e6f9483b-53f6-4696-b451-52aeb6ec13d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fd17bd8-24') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:53:50 user nova-compute[71229]: DEBUG os_vif [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:60:e0,bridge_name='br-int',has_traffic_filtering=True,id=8fd17bd8-2470-4931-8df3-b1ca41125d39,network=Network(e6f9483b-53f6-4696-b451-52aeb6ec13d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fd17bd8-24') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:53:50 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:53:50 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:53:50 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:53:50 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:53:50 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8fd17bd8-24, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:53:50 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8fd17bd8-24, col_values=(('external_ids', {'iface-id': '8fd17bd8-2470-4931-8df3-b1ca41125d39', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:60:e0', 'vm-uuid': '0d6c5972-e53b-47e9-8f13-7df1ad86020e'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:53:50 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:53:50 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:53:50 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:53:50 user nova-compute[71229]: INFO os_vif [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:60:e0,bridge_name='br-int',has_traffic_filtering=True,id=8fd17bd8-2470-4931-8df3-b1ca41125d39,network=Network(e6f9483b-53f6-4696-b451-52aeb6ec13d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fd17bd8-24')
Apr 11 15:53:50 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:53:50 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] No VIF found with MAC fa:16:3e:ba:60:e0, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:53:50 user nova-compute[71229]: DEBUG nova.network.neutron [req-f2b15ab9-5783-44ee-9bc5-629e78fa61ec req-9a1b03e2-e936-46f9-8a42-ef034dee60bd service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Updated VIF entry in instance network info cache for port 8fd17bd8-2470-4931-8df3-b1ca41125d39. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:53:50 user nova-compute[71229]: DEBUG nova.network.neutron [req-f2b15ab9-5783-44ee-9bc5-629e78fa61ec req-9a1b03e2-e936-46f9-8a42-ef034dee60bd service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Updating instance_info_cache with network_info: [{"id": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "address": "fa:16:3e:ba:60:e0", "network": {"id": "e6f9483b-53f6-4696-b451-52aeb6ec13d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822664747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa330c512f045dc8a5946be3563fdcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd17bd8-24", "ovs_interfaceid": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:53:50 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-f2b15ab9-5783-44ee-9bc5-629e78fa61ec req-9a1b03e2-e936-46f9-8a42-ef034dee60bd service nova] Releasing lock "refresh_cache-0d6c5972-e53b-47e9-8f13-7df1ad86020e" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:53:51 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:53:51 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:53:51 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:53:52 user nova-compute[71229]: DEBUG nova.compute.manager [req-7120822b-c745-46f1-b5fe-399c542a770c req-a85cf3d7-ca8c-4f9b-8c92-5ee59a67a50f service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Received event network-vif-plugged-8fd17bd8-2470-4931-8df3-b1ca41125d39 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:53:52 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-7120822b-c745-46f1-b5fe-399c542a770c req-a85cf3d7-ca8c-4f9b-8c92-5ee59a67a50f service nova] Acquiring lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:53:52 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-7120822b-c745-46f1-b5fe-399c542a770c req-a85cf3d7-ca8c-4f9b-8c92-5ee59a67a50f service nova] Lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:53:52 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-7120822b-c745-46f1-b5fe-399c542a770c req-a85cf3d7-ca8c-4f9b-8c92-5ee59a67a50f service nova] Lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:53:52 user nova-compute[71229]: DEBUG nova.compute.manager [req-7120822b-c745-46f1-b5fe-399c542a770c req-a85cf3d7-ca8c-4f9b-8c92-5ee59a67a50f service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] No waiting events found dispatching network-vif-plugged-8fd17bd8-2470-4931-8df3-b1ca41125d39 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:53:52 user nova-compute[71229]: WARNING nova.compute.manager [req-7120822b-c745-46f1-b5fe-399c542a770c req-a85cf3d7-ca8c-4f9b-8c92-5ee59a67a50f service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Received unexpected event network-vif-plugged-8fd17bd8-2470-4931-8df3-b1ca41125d39 for instance with vm_state building and task_state spawning.
Apr 11 15:53:52 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:53:52 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:53:52 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:53:52 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:53:53 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681228433.7388508, 0d6c5972-e53b-47e9-8f13-7df1ad86020e => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:53:53 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] VM Resumed (Lifecycle Event)
Apr 11 15:53:53 user nova-compute[71229]: DEBUG nova.compute.manager [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 15:53:53 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Guest created on hypervisor {{(pid=71229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 15:53:53 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Instance spawned successfully.
Apr 11 15:53:53 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 15:53:53 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:53:53 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:53:53 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Found default for hw_cdrom_bus of ide {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:53:53 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Found default for hw_disk_bus of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:53:53 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Found default for hw_input_bus of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:53:53 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Found default for hw_pointer_model of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:53:53 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Found default for hw_video_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:53:53 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Found default for hw_vif_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:53:53 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:53:53 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681228433.7400944, 0d6c5972-e53b-47e9-8f13-7df1ad86020e => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:53:53 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] VM Started (Lifecycle Event)
Apr 11 15:53:53 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:53:53 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:53:53 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:53:53 user nova-compute[71229]: INFO nova.compute.manager [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Took 5.24 seconds to spawn the instance on the hypervisor.
Apr 11 15:53:53 user nova-compute[71229]: DEBUG nova.compute.manager [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:53:53 user nova-compute[71229]: INFO nova.compute.manager [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Took 5.77 seconds to build instance.
Apr 11 15:53:53 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-949d92b7-7a31-4dd4-b904-612dfc928725 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.867s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:53:54 user nova-compute[71229]: DEBUG nova.compute.manager [req-a126fa39-7d61-47ed-836f-e384f4bcf6e0 req-7163897a-f4b3-4175-906e-7644d85b50ce service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Received event network-vif-plugged-8fd17bd8-2470-4931-8df3-b1ca41125d39 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:53:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a126fa39-7d61-47ed-836f-e384f4bcf6e0 req-7163897a-f4b3-4175-906e-7644d85b50ce service nova] Acquiring lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:53:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a126fa39-7d61-47ed-836f-e384f4bcf6e0 req-7163897a-f4b3-4175-906e-7644d85b50ce service nova] Lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:53:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a126fa39-7d61-47ed-836f-e384f4bcf6e0 req-7163897a-f4b3-4175-906e-7644d85b50ce service nova] Lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:53:54 user nova-compute[71229]: DEBUG nova.compute.manager [req-a126fa39-7d61-47ed-836f-e384f4bcf6e0 req-7163897a-f4b3-4175-906e-7644d85b50ce service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] No waiting events found dispatching network-vif-plugged-8fd17bd8-2470-4931-8df3-b1ca41125d39 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:53:54 user nova-compute[71229]: WARNING nova.compute.manager [req-a126fa39-7d61-47ed-836f-e384f4bcf6e0 req-7163897a-f4b3-4175-906e-7644d85b50ce service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Received unexpected event network-vif-plugged-8fd17bd8-2470-4931-8df3-b1ca41125d39 for instance with vm_state active and task_state None.
Apr 11 15:53:55 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:53:57 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:54:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:54:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:54:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:54:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:54:10 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:54:12 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:54:15 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:54:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:54:17 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:54:17 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 15:54:17 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Rebuilding the list of instances to heal {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 15:54:17 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "refresh_cache-56fbe043-133f-4e43-b9db-8ed02a3ed2af" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:54:17 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquired lock "refresh_cache-56fbe043-133f-4e43-b9db-8ed02a3ed2af" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:54:17 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Forcefully refreshing network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 15:54:17 user nova-compute[71229]: DEBUG nova.objects.instance [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lazy-loading 'info_cache' on Instance uuid 56fbe043-133f-4e43-b9db-8ed02a3ed2af {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:54:18 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Updating instance_info_cache with network_info: [{"id": "77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b", "address": "fa:16:3e:82:55:d8", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f40fdc-0c", "ovs_interfaceid": "77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:54:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Releasing lock "refresh_cache-56fbe043-133f-4e43-b9db-8ed02a3ed2af" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:54:18 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Updated the network info_cache for instance {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 15:54:18 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:54:18 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 15:54:20 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:54:20 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:54:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:54:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:54:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:54:20 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 15:54:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:54:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:54:20 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:54:21 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:54:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:54:21 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:54:21 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:54:21 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8724MB free_disk=26.013195037841797GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 15:54:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:54:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:54:21 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 56fbe043-133f-4e43-b9db-8ed02a3ed2af actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:54:21 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:54:21 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 15:54:21 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 15:54:21 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:54:21 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:54:21 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 15:54:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.247s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:54:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:54:22 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:54:22 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:54:24 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:54:24 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:54:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:54:25 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:54:25 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:54:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:54:35 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:54:40 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:54:40 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:54:40 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 15:54:40 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 15:54:40 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 15:54:40 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:54:42 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:54:45 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:54:50 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:54:50 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:54:50 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 15:54:50 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 15:54:50 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 15:54:50 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:54:55 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:54:55 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:54:55 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 15:54:55 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 15:54:55 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 15:54:55 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:55:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:55:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:55:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 15:55:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 15:55:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 15:55:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:55:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:55:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:55:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 15:55:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 15:55:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 15:55:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:55:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:55:08 user nova-compute[71229]: DEBUG nova.compute.manager [req-e2f89a7d-d1e6-4c23-8c7d-c273d0913996 req-624ea3eb-0a5c-485d-a2f0-5b4c4cf91738 service nova] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Received event network-changed-77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:55:08 user nova-compute[71229]: DEBUG nova.compute.manager [req-e2f89a7d-d1e6-4c23-8c7d-c273d0913996 req-624ea3eb-0a5c-485d-a2f0-5b4c4cf91738 service nova] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Refreshing instance network info cache due to event network-changed-77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:55:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e2f89a7d-d1e6-4c23-8c7d-c273d0913996 req-624ea3eb-0a5c-485d-a2f0-5b4c4cf91738 service nova] Acquiring lock "refresh_cache-56fbe043-133f-4e43-b9db-8ed02a3ed2af" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:55:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e2f89a7d-d1e6-4c23-8c7d-c273d0913996 req-624ea3eb-0a5c-485d-a2f0-5b4c4cf91738 service nova] Acquired lock "refresh_cache-56fbe043-133f-4e43-b9db-8ed02a3ed2af" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:55:08 user nova-compute[71229]: DEBUG nova.network.neutron [req-e2f89a7d-d1e6-4c23-8c7d-c273d0913996 req-624ea3eb-0a5c-485d-a2f0-5b4c4cf91738 service nova] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Refreshing network info cache for port 77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:55:08 user nova-compute[71229]: DEBUG nova.network.neutron [req-e2f89a7d-d1e6-4c23-8c7d-c273d0913996 req-624ea3eb-0a5c-485d-a2f0-5b4c4cf91738 service nova] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Updated VIF entry in instance network info cache for port 77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:55:08 user nova-compute[71229]: DEBUG nova.network.neutron [req-e2f89a7d-d1e6-4c23-8c7d-c273d0913996 req-624ea3eb-0a5c-485d-a2f0-5b4c4cf91738 service nova] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Updating instance_info_cache with network_info: [{"id": "77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b", "address": "fa:16:3e:82:55:d8", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f40fdc-0c", "ovs_interfaceid": "77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:55:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e2f89a7d-d1e6-4c23-8c7d-c273d0913996 req-624ea3eb-0a5c-485d-a2f0-5b4c4cf91738 service nova] Releasing lock "refresh_cache-56fbe043-133f-4e43-b9db-8ed02a3ed2af" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:55:10 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:55:12 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "7889054a-8f28-4a2b-95b3-ec64dc421681" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:55:12 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "7889054a-8f28-4a2b-95b3-ec64dc421681" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:55:12 user nova-compute[71229]: DEBUG nova.compute.manager [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Starting instance... {{(pid=71229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 15:55:12 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:55:12 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:55:12 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 15:55:12 user nova-compute[71229]: INFO nova.compute.claims [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Claim successful on node user
Apr 11 15:55:12 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:55:12 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:55:12 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.221s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:55:12 user nova-compute[71229]: DEBUG nova.compute.manager [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Start building networks asynchronously for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 15:55:12 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:55:12 user nova-compute[71229]: DEBUG nova.compute.manager [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Allocating IP information in the background. {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 15:55:12 user nova-compute[71229]: DEBUG nova.network.neutron [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] allocate_for_instance() {{(pid=71229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 15:55:12 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 15:55:12 user nova-compute[71229]: DEBUG nova.compute.manager [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Start building block device mappings for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 15:55:12 user nova-compute[71229]: INFO nova.virt.block_device [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Booting with volume fa9e7f7f-d130-4bd7-abd6-1d4bf3659714 at /dev/vda
Apr 11 15:55:12 user nova-compute[71229]: DEBUG nova.policy [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c2110b74f38642afa560e1c9790d3f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312851c65ba1434691eca0cd2a8cd6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71229) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 15:55:12 user nova-compute[71229]: DEBUG os_brick.utils [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:55:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:55:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:55:12 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb9f2d5-d15b-40aa-af17-e6a1bfe73809]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d55e24a97c90\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:55:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:55:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:55:12 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78e036d-5583-49e4-a170-c45c01e6566b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:55:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:55:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:55:12 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[172d79a0-412b-4916-a0f6-f2c100c3653b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:55:12 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b42a420-8630-4b10-8678-a92001d95468]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:55:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Running cmd (subprocess): nvme version {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:55:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] 'nvme version' failed. Not Retrying. {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:55:12 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] nvme not present on system {{(pid=71229) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 15:55:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:55:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:55:12 user nova-compute[71229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 15:55:12 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[04bdd87d-8d1d-4481-9528-fd7be0ee63ba]: (4, '') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:55:12 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71229) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 15:55:12 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 15:55:12 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] LIGHTOS: no hostnqn found. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 15:55:12 user nova-compute[71229]: DEBUG os_brick.utils [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d55e24a97c90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:55:12 user nova-compute[71229]: DEBUG nova.virt.block_device [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Updating existing volume attachment record: 7582a7d3-d7c7-419a-b9da-be1b578fab6a {{(pid=71229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 15:55:13 user nova-compute[71229]: DEBUG nova.network.neutron [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Successfully created port: fb3bb75a-7f7c-4611-91bf-313a7f1610b5 {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 15:55:13 user nova-compute[71229]: DEBUG nova.network.neutron [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Successfully updated port: fb3bb75a-7f7c-4611-91bf-313a7f1610b5 {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 15:55:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "refresh_cache-7889054a-8f28-4a2b-95b3-ec64dc421681" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:55:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquired lock "refresh_cache-7889054a-8f28-4a2b-95b3-ec64dc421681" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:55:13 user nova-compute[71229]: DEBUG nova.network.neutron [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:55:13 user nova-compute[71229]: DEBUG nova.compute.manager [req-4f867a37-b88f-4c3b-94be-ad2d2bb5041c req-939ab349-b60c-43e2-8e75-dc82b510c8d9 service nova] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Received event network-changed-fb3bb75a-7f7c-4611-91bf-313a7f1610b5 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:55:13 user nova-compute[71229]: DEBUG nova.compute.manager [req-4f867a37-b88f-4c3b-94be-ad2d2bb5041c req-939ab349-b60c-43e2-8e75-dc82b510c8d9 service nova] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Refreshing instance network info cache due to event network-changed-fb3bb75a-7f7c-4611-91bf-313a7f1610b5. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:55:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4f867a37-b88f-4c3b-94be-ad2d2bb5041c req-939ab349-b60c-43e2-8e75-dc82b510c8d9 service nova] Acquiring lock "refresh_cache-7889054a-8f28-4a2b-95b3-ec64dc421681" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:55:13 user nova-compute[71229]: DEBUG nova.network.neutron [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 15:55:14 user nova-compute[71229]: DEBUG nova.network.neutron [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Updating instance_info_cache with network_info: [{"id": "fb3bb75a-7f7c-4611-91bf-313a7f1610b5", "address": "fa:16:3e:f3:14:15", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb3bb75a-7f", "ovs_interfaceid": "fb3bb75a-7f7c-4611-91bf-313a7f1610b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:55:14 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Releasing lock "refresh_cache-7889054a-8f28-4a2b-95b3-ec64dc421681" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:55:14 user nova-compute[71229]: DEBUG nova.compute.manager [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Instance network_info: |[{"id": "fb3bb75a-7f7c-4611-91bf-313a7f1610b5", "address": "fa:16:3e:f3:14:15", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb3bb75a-7f", "ovs_interfaceid": "fb3bb75a-7f7c-4611-91bf-313a7f1610b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 15:55:14 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4f867a37-b88f-4c3b-94be-ad2d2bb5041c req-939ab349-b60c-43e2-8e75-dc82b510c8d9 service nova] Acquired lock "refresh_cache-7889054a-8f28-4a2b-95b3-ec64dc421681" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:55:14 user nova-compute[71229]: DEBUG nova.network.neutron [req-4f867a37-b88f-4c3b-94be-ad2d2bb5041c req-939ab349-b60c-43e2-8e75-dc82b510c8d9 service nova] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Refreshing network info cache for port fb3bb75a-7f7c-4611-91bf-313a7f1610b5 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:55:14 user nova-compute[71229]: DEBUG nova.network.neutron [req-4f867a37-b88f-4c3b-94be-ad2d2bb5041c req-939ab349-b60c-43e2-8e75-dc82b510c8d9 service nova] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Updated VIF entry in instance network info cache for port fb3bb75a-7f7c-4611-91bf-313a7f1610b5. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:55:14 user nova-compute[71229]: DEBUG nova.network.neutron [req-4f867a37-b88f-4c3b-94be-ad2d2bb5041c req-939ab349-b60c-43e2-8e75-dc82b510c8d9 service nova] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Updating instance_info_cache with network_info: [{"id": "fb3bb75a-7f7c-4611-91bf-313a7f1610b5", "address": "fa:16:3e:f3:14:15", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb3bb75a-7f", "ovs_interfaceid": "fb3bb75a-7f7c-4611-91bf-313a7f1610b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:55:14 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4f867a37-b88f-4c3b-94be-ad2d2bb5041c req-939ab349-b60c-43e2-8e75-dc82b510c8d9 service nova] Releasing lock "refresh_cache-7889054a-8f28-4a2b-95b3-ec64dc421681" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:55:15 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:55:16 user nova-compute[71229]: DEBUG nova.compute.manager [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Start spawning the instance on the hypervisor. {{(pid=71229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 15:55:16 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Creating instance directory {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 15:55:16 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Creating image(s)
Apr 11 15:55:16 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Did not create local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 15:55:16 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Ensure instance console log exists: /opt/stack/data/nova/instances/7889054a-8f28-4a2b-95b3-ec64dc421681/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 15:55:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:55:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:55:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:55:16 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Start _get_guest_xml network_info=[{"id": "fb3bb75a-7f7c-4611-91bf-313a7f1610b5", "address": "fa:16:3e:f3:14:15", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb3bb75a-7f", "ovs_interfaceid": "fb3bb75a-7f7c-4611-91bf-313a7f1610b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ERXyYFaL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7889054a-8f28-4a2b-95b3-ec64dc421681', 'attached_at': '', 'detached_at': '', 'volume_id': 'fa9e7f7f-d130-4bd7-abd6-1d4bf3659714', 'serial': 'fa9e7f7f-d130-4bd7-abd6-1d4bf3659714'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '7582a7d3-d7c7-419a-b9da-be1b578fab6a', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:55:16 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:55:16 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:55:16 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:55:16 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:55:16 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:55:16 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:55:16 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:55:16 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:55:16 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:55:16 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:55:16 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:55:16 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:55:16 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:55:16 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:55:16 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 15:55:16 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ERXyYFaL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:55:16 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:55:16 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:55:16 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:55:16 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:55:16 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:55:16 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:55:16 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 15:55:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714 -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:55:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:55:16 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[856a92e3-4f1d-4a45-a88e-acf79168a73c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:55:16 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 15:55:16 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:55:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714 -p 172.16.0.220:3260 --interface default --op new {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:55:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:55:17 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ba5ea1-bf82-4989-ab9a-a801e8b1579c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714] added\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:55:17 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714] added
Apr 11 15:55:17 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:55:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:55:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:55:17 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[388d8d71-e8b3-4194-90b4-907ac94d2f26]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:55:17 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:55:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:55:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:55:17 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb50a4a-5dea-452a-abb2-b1a172029e7c]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:55:17 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:55:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ERXyYFaL {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:55:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ERXyYFaL" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:55:17 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5989391e-8ccd-4d92-8921-90faad71ceab]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:55:17 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ERXyYFaL'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:55:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:55:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:55:17 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda93814-18dc-412d-8a72-08746306661d]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:55:17 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:55:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:55:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:55:17 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5745a480-2c46-492f-abe4-80b3c5c602b3]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:55:17 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 (non-flash)
Apr 11 15:55:17 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:55:17 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 (non-flash)
Apr 11 15:55:17 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:55:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714 -p 172.16.0.220:3260 --login {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:55:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:55:17 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a378a53-47e1-41b1-8cf2-cee531eae590]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:55:17 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714, portal: 172.16.0.220,3260]
Apr 11 15:55:17 user nova-compute[71229]: Login to [iface: default, target: iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714, portal: 172.16.0.220,3260] successful.
Apr 11 15:55:17 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:55:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:55:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:55:17 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f628cf3e-51e6-42ef-828a-02330b079f61]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:55:17 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:55:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:55:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:55:17 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22b6f6c-2bfb-4587-9187-93af25264ff9]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:55:17 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 (non-flash)
Apr 11 15:55:17 user nova-compute[71229]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714 (non-flash)
Apr 11 15:55:17 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:55:17 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 (non-flash)
Apr 11 15:55:17 user nova-compute[71229]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714 (non-flash)
Apr 11 15:55:17 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:55:17 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:55:17 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 15:55:17 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 15:55:17 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 15:55:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:55:17 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:55:17 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[108f3659-1956-401a-8d97-d1c8212dba19]: (4, ('- - 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:55:17 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:55:17 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ERXyYFaL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 15:55:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:55:17 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:55:17 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 15:55:18 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:55:18 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26236346336613361', 'path': '/dev/sdc'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:55:18 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236346336613361', 'path': '/dev/sdc'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 15:55:18 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:55:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-171471328',display_name='tempest-TestVolumeBootPattern-server-171471328',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-171471328',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHFmBexXT+1iiEvWvrTBCCfLTFSZaBECTRUjU2HFOZ99DTdS224XqNm6W0NLu+fhNbtUG4d3cptal0K2Oy5ZbjfRTK7G/g++ylfyvf1YI+eSa1yX5tyMrdSO5dom9On9A==',key_name='tempest-TestVolumeBootPattern-1289860889',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='312851c65ba1434691eca0cd2a8cd6d2',ramdisk_id='',reservation_id='r-9bkzcpnz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1933582504',owner_user_name='tempest-TestVolumeBootPattern-1933582504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:55:13Z,user_data=None,user_id='c2110b74f38642afa560e1c9790d3f81',uuid=7889054a-8f28-4a2b-95b3-ec64dc421681,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb3bb75a-7f7c-4611-91bf-313a7f1610b5", "address": "fa:16:3e:f3:14:15", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb3bb75a-7f", "ovs_interfaceid": "fb3bb75a-7f7c-4611-91bf-313a7f1610b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:55:18 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Converting VIF {"id": "fb3bb75a-7f7c-4611-91bf-313a7f1610b5", "address": "fa:16:3e:f3:14:15", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb3bb75a-7f", "ovs_interfaceid": "fb3bb75a-7f7c-4611-91bf-313a7f1610b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:55:18 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:14:15,bridge_name='br-int',has_traffic_filtering=True,id=fb3bb75a-7f7c-4611-91bf-313a7f1610b5,network=Network(8d262ba8-b9c3-44ed-8431-6c295eb9ea24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb3bb75a-7f') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:55:18 user nova-compute[71229]: DEBUG nova.objects.instance [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lazy-loading 'pci_devices' on Instance uuid 7889054a-8f28-4a2b-95b3-ec64dc421681 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:55:18 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:55:18 user nova-compute[71229]:   <uuid>7889054a-8f28-4a2b-95b3-ec64dc421681</uuid>
Apr 11 15:55:18 user nova-compute[71229]:   <name>instance-00000028</name>
Apr 11 15:55:18 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:55:18 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:55:18 user nova-compute[71229]:   <metadata>
Apr 11 15:55:18 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:55:18 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:55:18 user nova-compute[71229]:       <nova:name>tempest-TestVolumeBootPattern-server-171471328</nova:name>
Apr 11 15:55:18 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:55:16</nova:creationTime>
Apr 11 15:55:18 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:55:18 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:55:18 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:55:18 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:55:18 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:55:18 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:55:18 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:55:18 user nova-compute[71229]:       <nova:owner>
Apr 11 15:55:18 user nova-compute[71229]:         <nova:user uuid="c2110b74f38642afa560e1c9790d3f81">tempest-TestVolumeBootPattern-1933582504-project-member</nova:user>
Apr 11 15:55:18 user nova-compute[71229]:         <nova:project uuid="312851c65ba1434691eca0cd2a8cd6d2">tempest-TestVolumeBootPattern-1933582504</nova:project>
Apr 11 15:55:18 user nova-compute[71229]:       </nova:owner>
Apr 11 15:55:18 user nova-compute[71229]:       <nova:ports>
Apr 11 15:55:18 user nova-compute[71229]:         <nova:port uuid="fb3bb75a-7f7c-4611-91bf-313a7f1610b5">
Apr 11 15:55:18 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 11 15:55:18 user nova-compute[71229]:         </nova:port>
Apr 11 15:55:18 user nova-compute[71229]:       </nova:ports>
Apr 11 15:55:18 user nova-compute[71229]:     </nova:instance>
Apr 11 15:55:18 user nova-compute[71229]:   </metadata>
Apr 11 15:55:18 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:55:18 user nova-compute[71229]:     <system>
Apr 11 15:55:18 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:55:18 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:55:18 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:55:18 user nova-compute[71229]:       <entry name="serial">7889054a-8f28-4a2b-95b3-ec64dc421681</entry>
Apr 11 15:55:18 user nova-compute[71229]:       <entry name="uuid">7889054a-8f28-4a2b-95b3-ec64dc421681</entry>
Apr 11 15:55:18 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:55:18 user nova-compute[71229]:     </system>
Apr 11 15:55:18 user nova-compute[71229]:   </sysinfo>
Apr 11 15:55:18 user nova-compute[71229]:   <os>
Apr 11 15:55:18 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:55:18 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 15:55:18 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:55:18 user nova-compute[71229]:   </os>
Apr 11 15:55:18 user nova-compute[71229]:   <features>
Apr 11 15:55:18 user nova-compute[71229]:     <acpi/>
Apr 11 15:55:18 user nova-compute[71229]:     <apic/>
Apr 11 15:55:18 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:55:18 user nova-compute[71229]:   </features>
Apr 11 15:55:18 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:55:18 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:55:18 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:55:18 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:55:18 user nova-compute[71229]:   </clock>
Apr 11 15:55:18 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:55:18 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:55:18 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:55:18 user nova-compute[71229]:   </cpu>
Apr 11 15:55:18 user nova-compute[71229]:   <devices>
Apr 11 15:55:18 user nova-compute[71229]:     <disk type="block" device="disk">
Apr 11 15:55:18 user nova-compute[71229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:55:18 user nova-compute[71229]:       <source dev="/dev/sdc"/>
Apr 11 15:55:18 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:55:18 user nova-compute[71229]:       <serial>fa9e7f7f-d130-4bd7-abd6-1d4bf3659714</serial>
Apr 11 15:55:18 user nova-compute[71229]:     </disk>
Apr 11 15:55:18 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:55:18 user nova-compute[71229]:       <mac address="fa:16:3e:f3:14:15"/>
Apr 11 15:55:18 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:55:18 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:55:18 user nova-compute[71229]:       <target dev="tapfb3bb75a-7f"/>
Apr 11 15:55:18 user nova-compute[71229]:     </interface>
Apr 11 15:55:18 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:55:18 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/7889054a-8f28-4a2b-95b3-ec64dc421681/console.log" append="off"/>
Apr 11 15:55:18 user nova-compute[71229]:     </serial>
Apr 11 15:55:18 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:55:18 user nova-compute[71229]:     <video>
Apr 11 15:55:18 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:55:18 user nova-compute[71229]:     </video>
Apr 11 15:55:18 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:55:18 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:55:18 user nova-compute[71229]:     </rng>
Apr 11 15:55:18 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:55:18 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:55:18 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:55:18 user nova-compute[71229]:     </memballoon>
Apr 11 15:55:18 user nova-compute[71229]:   </devices>
Apr 11 15:55:18 user nova-compute[71229]: </domain>
Apr 11 15:55:18 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:55:18 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:55:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-171471328',display_name='tempest-TestVolumeBootPattern-server-171471328',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-171471328',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHFmBexXT+1iiEvWvrTBCCfLTFSZaBECTRUjU2HFOZ99DTdS224XqNm6W0NLu+fhNbtUG4d3cptal0K2Oy5ZbjfRTK7G/g++ylfyvf1YI+eSa1yX5tyMrdSO5dom9On9A==',key_name='tempest-TestVolumeBootPattern-1289860889',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='312851c65ba1434691eca0cd2a8cd6d2',ramdisk_id='',reservation_id='r-9bkzcpnz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1933582504',owner_user_name='tempest-TestVolumeBootPattern-1933582504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:55:13Z,user_data=None,user_id='c2110b74f38642afa560e1c9790d3f81',uuid=7889054a-8f28-4a2b-95b3-ec64dc421681,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb3bb75a-7f7c-4611-91bf-313a7f1610b5", "address": "fa:16:3e:f3:14:15", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb3bb75a-7f", "ovs_interfaceid": "fb3bb75a-7f7c-4611-91bf-313a7f1610b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:55:18 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Converting VIF {"id": "fb3bb75a-7f7c-4611-91bf-313a7f1610b5", "address": "fa:16:3e:f3:14:15", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb3bb75a-7f", "ovs_interfaceid": "fb3bb75a-7f7c-4611-91bf-313a7f1610b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:55:18 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:14:15,bridge_name='br-int',has_traffic_filtering=True,id=fb3bb75a-7f7c-4611-91bf-313a7f1610b5,network=Network(8d262ba8-b9c3-44ed-8431-6c295eb9ea24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb3bb75a-7f') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:55:18 user nova-compute[71229]: DEBUG os_vif [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:14:15,bridge_name='br-int',has_traffic_filtering=True,id=fb3bb75a-7f7c-4611-91bf-313a7f1610b5,network=Network(8d262ba8-b9c3-44ed-8431-6c295eb9ea24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb3bb75a-7f') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:55:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:55:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:55:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:55:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:55:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb3bb75a-7f, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:55:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfb3bb75a-7f, col_values=(('external_ids', {'iface-id': 'fb3bb75a-7f7c-4611-91bf-313a7f1610b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:14:15', 'vm-uuid': '7889054a-8f28-4a2b-95b3-ec64dc421681'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:55:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:55:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:55:18 user nova-compute[71229]: INFO os_vif [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:14:15,bridge_name='br-int',has_traffic_filtering=True,id=fb3bb75a-7f7c-4611-91bf-313a7f1610b5,network=Network(8d262ba8-b9c3-44ed-8431-6c295eb9ea24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb3bb75a-7f')
Apr 11 15:55:18 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:55:18 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] No VIF found with MAC fa:16:3e:f3:14:15, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:55:18 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:55:18 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 15:55:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "refresh_cache-0d6c5972-e53b-47e9-8f13-7df1ad86020e" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:55:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquired lock "refresh_cache-0d6c5972-e53b-47e9-8f13-7df1ad86020e" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:55:18 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Forcefully refreshing network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 15:55:19 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Updating instance_info_cache with network_info: [{"id": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "address": "fa:16:3e:ba:60:e0", "network": {"id": "e6f9483b-53f6-4696-b451-52aeb6ec13d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822664747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa330c512f045dc8a5946be3563fdcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd17bd8-24", "ovs_interfaceid": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:55:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Releasing lock "refresh_cache-0d6c5972-e53b-47e9-8f13-7df1ad86020e" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:55:19 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Updated the network info_cache for instance {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 15:55:19 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:55:19 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:55:19 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:55:19 user nova-compute[71229]: DEBUG nova.compute.manager [req-4a45b395-7fad-4679-9fee-0518d37b39be req-089cac70-69bd-4814-a165-29afc799adb6 service nova] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Received event network-vif-plugged-fb3bb75a-7f7c-4611-91bf-313a7f1610b5 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:55:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4a45b395-7fad-4679-9fee-0518d37b39be req-089cac70-69bd-4814-a165-29afc799adb6 service nova] Acquiring lock "7889054a-8f28-4a2b-95b3-ec64dc421681-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:55:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4a45b395-7fad-4679-9fee-0518d37b39be req-089cac70-69bd-4814-a165-29afc799adb6 service nova] Lock "7889054a-8f28-4a2b-95b3-ec64dc421681-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:55:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4a45b395-7fad-4679-9fee-0518d37b39be req-089cac70-69bd-4814-a165-29afc799adb6 service nova] Lock "7889054a-8f28-4a2b-95b3-ec64dc421681-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:55:19 user nova-compute[71229]: DEBUG nova.compute.manager [req-4a45b395-7fad-4679-9fee-0518d37b39be req-089cac70-69bd-4814-a165-29afc799adb6 service nova] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] No waiting events found dispatching network-vif-plugged-fb3bb75a-7f7c-4611-91bf-313a7f1610b5 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:55:19 user nova-compute[71229]: WARNING nova.compute.manager [req-4a45b395-7fad-4679-9fee-0518d37b39be req-089cac70-69bd-4814-a165-29afc799adb6 service nova] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Received unexpected event network-vif-plugged-fb3bb75a-7f7c-4611-91bf-313a7f1610b5 for instance with vm_state building and task_state spawning.
Apr 11 15:55:19 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:55:21 user nova-compute[71229]: DEBUG nova.compute.manager [req-9b9cd767-7f89-46f6-990d-a12f2ec7fafe req-28d98814-8ba4-4dfe-91f2-f8d2caa26414 service nova] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Received event network-vif-plugged-fb3bb75a-7f7c-4611-91bf-313a7f1610b5 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:55:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-9b9cd767-7f89-46f6-990d-a12f2ec7fafe req-28d98814-8ba4-4dfe-91f2-f8d2caa26414 service nova] Acquiring lock "7889054a-8f28-4a2b-95b3-ec64dc421681-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:55:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-9b9cd767-7f89-46f6-990d-a12f2ec7fafe req-28d98814-8ba4-4dfe-91f2-f8d2caa26414 service nova] Lock "7889054a-8f28-4a2b-95b3-ec64dc421681-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:55:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-9b9cd767-7f89-46f6-990d-a12f2ec7fafe req-28d98814-8ba4-4dfe-91f2-f8d2caa26414 service nova] Lock "7889054a-8f28-4a2b-95b3-ec64dc421681-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:55:21 user nova-compute[71229]: DEBUG nova.compute.manager [req-9b9cd767-7f89-46f6-990d-a12f2ec7fafe req-28d98814-8ba4-4dfe-91f2-f8d2caa26414 service nova] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] No waiting events found dispatching network-vif-plugged-fb3bb75a-7f7c-4611-91bf-313a7f1610b5 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:55:21 user nova-compute[71229]: WARNING nova.compute.manager [req-9b9cd767-7f89-46f6-990d-a12f2ec7fafe req-28d98814-8ba4-4dfe-91f2-f8d2caa26414 service nova] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Received unexpected event network-vif-plugged-fb3bb75a-7f7c-4611-91bf-313a7f1610b5 for instance with vm_state building and task_state spawning.
Apr 11 15:55:21 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681228521.851589, 7889054a-8f28-4a2b-95b3-ec64dc421681 => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:55:21 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] VM Resumed (Lifecycle Event)
Apr 11 15:55:21 user nova-compute[71229]: DEBUG nova.compute.manager [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 15:55:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Guest created on hypervisor {{(pid=71229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 15:55:21 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Instance spawned successfully.
Apr 11 15:55:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 15:55:21 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:55:21 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:55:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Found default for hw_cdrom_bus of ide {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:55:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Found default for hw_disk_bus of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:55:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Found default for hw_input_bus of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:55:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Found default for hw_pointer_model of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:55:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Found default for hw_video_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:55:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Found default for hw_vif_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 15:55:21 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:55:21 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681228521.851807, 7889054a-8f28-4a2b-95b3-ec64dc421681 => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:55:21 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] VM Started (Lifecycle Event)
Apr 11 15:55:21 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:55:21 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:55:21 user nova-compute[71229]: INFO nova.compute.manager [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Took 5.08 seconds to spawn the instance on the hypervisor.
Apr 11 15:55:21 user nova-compute[71229]: DEBUG nova.compute.manager [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:55:21 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 15:55:22 user nova-compute[71229]: INFO nova.compute.manager [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Took 9.86 seconds to build instance.
Apr 11 15:55:22 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4c809500-039b-4792-aafb-21b1d3f78696 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "7889054a-8f28-4a2b-95b3-ec64dc421681" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.954s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:55:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:55:22 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:55:22 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:55:22 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:55:22 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:55:22 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:55:22 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 15:55:22 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:55:22 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:55:22 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:55:23 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:55:23 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:55:23 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:55:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:55:23 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:55:23 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:55:23 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8681MB free_disk=26.003585815429688GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 15:55:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:55:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:55:23 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 56fbe043-133f-4e43-b9db-8ed02a3ed2af actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:55:23 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:55:23 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 7889054a-8f28-4a2b-95b3-ec64dc421681 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:55:23 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 15:55:23 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 15:55:23 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:55:23 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:55:23 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 15:55:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.280s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:55:24 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:55:25 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:55:26 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:55:26 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:55:27 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:55:27 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:55:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:55:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:55:36 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:55:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:55:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:55:39 user nova-compute[71229]: DEBUG nova.compute.manager [req-81d8d0e4-c4aa-4deb-a355-e37f189e6967 req-cb67ed60-928f-4a34-a212-b7bd34f72e0e service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Received event network-changed-8fd17bd8-2470-4931-8df3-b1ca41125d39 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:55:39 user nova-compute[71229]: DEBUG nova.compute.manager [req-81d8d0e4-c4aa-4deb-a355-e37f189e6967 req-cb67ed60-928f-4a34-a212-b7bd34f72e0e service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Refreshing instance network info cache due to event network-changed-8fd17bd8-2470-4931-8df3-b1ca41125d39. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:55:39 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-81d8d0e4-c4aa-4deb-a355-e37f189e6967 req-cb67ed60-928f-4a34-a212-b7bd34f72e0e service nova] Acquiring lock "refresh_cache-0d6c5972-e53b-47e9-8f13-7df1ad86020e" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:55:39 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-81d8d0e4-c4aa-4deb-a355-e37f189e6967 req-cb67ed60-928f-4a34-a212-b7bd34f72e0e service nova] Acquired lock "refresh_cache-0d6c5972-e53b-47e9-8f13-7df1ad86020e" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:55:39 user nova-compute[71229]: DEBUG nova.network.neutron [req-81d8d0e4-c4aa-4deb-a355-e37f189e6967 req-cb67ed60-928f-4a34-a212-b7bd34f72e0e service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Refreshing network info cache for port 8fd17bd8-2470-4931-8df3-b1ca41125d39 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:55:39 user nova-compute[71229]: DEBUG nova.network.neutron [req-81d8d0e4-c4aa-4deb-a355-e37f189e6967 req-cb67ed60-928f-4a34-a212-b7bd34f72e0e service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Updated VIF entry in instance network info cache for port 8fd17bd8-2470-4931-8df3-b1ca41125d39. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:55:39 user nova-compute[71229]: DEBUG nova.network.neutron [req-81d8d0e4-c4aa-4deb-a355-e37f189e6967 req-cb67ed60-928f-4a34-a212-b7bd34f72e0e service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Updating instance_info_cache with network_info: [{"id": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "address": "fa:16:3e:ba:60:e0", "network": {"id": "e6f9483b-53f6-4696-b451-52aeb6ec13d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822664747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa330c512f045dc8a5946be3563fdcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd17bd8-24", "ovs_interfaceid": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:55:39 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-81d8d0e4-c4aa-4deb-a355-e37f189e6967 req-cb67ed60-928f-4a34-a212-b7bd34f72e0e service nova] Releasing lock "refresh_cache-0d6c5972-e53b-47e9-8f13-7df1ad86020e" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:55:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:55:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:55:40 user nova-compute[71229]: DEBUG nova.objects.instance [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lazy-loading 'flavor' on Instance uuid 0d6c5972-e53b-47e9-8f13-7df1ad86020e {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:55:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:55:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:55:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:55:40 user nova-compute[71229]: INFO nova.compute.manager [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Attaching volume 0b6dc374-b525-44a2-8e35-d4a723ae5915 to /dev/vdb
Apr 11 15:55:40 user nova-compute[71229]: DEBUG os_brick.utils [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:55:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:55:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:55:40 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae19a0b6-29ec-47e5-980a-c8498dc68c96]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d55e24a97c90\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:55:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:55:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:55:41 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[558dcb8e-81de-4c0c-b6cd-fca07e11acaa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:55:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:55:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:55:41 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c24982-89f8-4408-a2c1-e256489d939e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:55:41 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b1706d-2dd2-4945-9e51-2603908c1e74]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:55:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Running cmd (subprocess): nvme version {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:55:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 'nvme version' failed. Not Retrying. {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:55:41 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] nvme not present on system {{(pid=71229) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 15:55:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:55:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 15:55:41 user nova-compute[71229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 15:55:41 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8494cd-cb2d-45c8-a009-b1bd99bd695e]: (4, '') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:55:41 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71229) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 15:55:41 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 15:55:41 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] LIGHTOS: no hostnqn found. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 15:55:41 user nova-compute[71229]: DEBUG os_brick.utils [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d55e24a97c90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:55:41 user nova-compute[71229]: DEBUG nova.virt.block_device [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Updating existing volume attachment record: f1312597-673a-4c5d-907e-7cfa37240fbf {{(pid=71229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 15:55:42 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:55:43 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hYDREkBL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:55:45 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:55:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:55:45 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:55:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:55:45 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 15:55:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f435ada-0cf9-4e37-8b2c-2930d9369d45]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 15:55:45 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 -p 172.16.0.220:3260 --interface default --op new {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7f132b-dad3-4c72-9bbe-f5dc5066eb36]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915] added\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915] added
Apr 11 15:55:45 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b73200-5cb4-43fe-acee-0ff65b068072]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb8f69e-fd14-431c-a6cd-9dd3bcf2a50c]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hYDREkBL {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hYDREkBL" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8188d4aa-fe0b-41f2-83dd-da515b9e52cd]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hYDREkBL'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[91446bb5-9d31-41c5-a50c-0ffc4af21e8f]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e21ab8e-3fd6-4476-91fd-6d5eee20c68f]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 (non-flash)
Apr 11 15:55:45 user nova-compute[71229]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714 (non-flash)
Apr 11 15:55:45 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 (non-flash)
Apr 11 15:55:45 user nova-compute[71229]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714 (non-flash)
Apr 11 15:55:45 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 -p 172.16.0.220:3260 --login {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd449c3-cac3-493a-85ea-fd2e640d534c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915, portal: 172.16.0.220,3260]
Apr 11 15:55:45 user nova-compute[71229]: Login to [iface: default, target: iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915, portal: 172.16.0.220,3260] successful.
Apr 11 15:55:45 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3a8170-094e-4f19-927d-29b585ce193c]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[25609f55-4944-4f60-a5ca-5afaed3df8cd]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 (non-flash)
Apr 11 15:55:45 user nova-compute[71229]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714 (non-flash)
Apr 11 15:55:45 user nova-compute[71229]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 (non-flash)
Apr 11 15:55:45 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 (non-flash)
Apr 11 15:55:45 user nova-compute[71229]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714 (non-flash)
Apr 11 15:55:45 user nova-compute[71229]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 (non-flash)
Apr 11 15:55:45 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] HCTL ('35', '-', '-', 0) found on session 46 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6d95c5-4108-4abd-87fa-9916d0eae213]: (4, ('- - 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:55:45 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: None {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:55:46 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:55:46 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hYDREkBL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 15:55:46 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:55:46 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '26331623362346266', 'path': '/dev/sdd'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:55:46 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331623362346266', 'path': '/dev/sdd'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 15:55:46 user nova-compute[71229]: DEBUG nova.objects.instance [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lazy-loading 'flavor' on Instance uuid 0d6c5972-e53b-47e9-8f13-7df1ad86020e {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:55:46 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 15:55:46 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:55:46 user nova-compute[71229]:   <source dev="/dev/sdd"/>
Apr 11 15:55:46 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 15:55:46 user nova-compute[71229]:   <serial>0b6dc374-b525-44a2-8e35-d4a723ae5915</serial>
Apr 11 15:55:46 user nova-compute[71229]: </disk>
Apr 11 15:55:46 user nova-compute[71229]:  {{(pid=71229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 15:55:46 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:55:46 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 15:55:46 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] No VIF found with MAC fa:16:3e:ba:60:e0, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 15:55:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-1bdb1fab-0a55-4a66-aec1-624c32d064de tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.131s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:55:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:55:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ece5ab05-88fc-4cf4-867f-8f85959069fa tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:55:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ece5ab05-88fc-4cf4-867f-8f85959069fa tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:55:47 user nova-compute[71229]: DEBUG nova.compute.manager [None req-ece5ab05-88fc-4cf4-867f-8f85959069fa tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:55:47 user nova-compute[71229]: DEBUG nova.compute.manager [None req-ece5ab05-88fc-4cf4-867f-8f85959069fa tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71229) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 11 15:55:47 user nova-compute[71229]: DEBUG nova.objects.instance [None req-ece5ab05-88fc-4cf4-867f-8f85959069fa tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lazy-loading 'flavor' on Instance uuid 0d6c5972-e53b-47e9-8f13-7df1ad86020e {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:55:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:55:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:55:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:55:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:55:47 user nova-compute[71229]: DEBUG nova.compute.manager [req-a11e05ae-45f3-4b1a-be13-b0ab0628042d req-f3cf633d-f74b-4ab2-9710-d82178ee7566 service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Received event network-vif-unplugged-8fd17bd8-2470-4931-8df3-b1ca41125d39 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:55:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a11e05ae-45f3-4b1a-be13-b0ab0628042d req-f3cf633d-f74b-4ab2-9710-d82178ee7566 service nova] Acquiring lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:55:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a11e05ae-45f3-4b1a-be13-b0ab0628042d req-f3cf633d-f74b-4ab2-9710-d82178ee7566 service nova] Lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:55:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a11e05ae-45f3-4b1a-be13-b0ab0628042d req-f3cf633d-f74b-4ab2-9710-d82178ee7566 service nova] Lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:55:47 user nova-compute[71229]: DEBUG nova.compute.manager [req-a11e05ae-45f3-4b1a-be13-b0ab0628042d req-f3cf633d-f74b-4ab2-9710-d82178ee7566 service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] No waiting events found dispatching network-vif-unplugged-8fd17bd8-2470-4931-8df3-b1ca41125d39 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:55:47 user nova-compute[71229]: WARNING nova.compute.manager [req-a11e05ae-45f3-4b1a-be13-b0ab0628042d req-f3cf633d-f74b-4ab2-9710-d82178ee7566 service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Received unexpected event network-vif-unplugged-8fd17bd8-2470-4931-8df3-b1ca41125d39 for instance with vm_state active and task_state powering-off.
Apr 11 15:55:48 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:55:48 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Instance destroyed successfully.
Apr 11 15:55:48 user nova-compute[71229]: DEBUG nova.compute.manager [None req-ece5ab05-88fc-4cf4-867f-8f85959069fa tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:55:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-ece5ab05-88fc-4cf4-867f-8f85959069fa tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.853s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:55:48 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:55:50 user nova-compute[71229]: DEBUG nova.compute.manager [req-9d0bafae-0c24-4a14-8815-bf86d940db0a req-38643a7f-365b-4694-b0b7-a16f6c7a1889 service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Received event network-vif-plugged-8fd17bd8-2470-4931-8df3-b1ca41125d39 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:55:50 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-9d0bafae-0c24-4a14-8815-bf86d940db0a req-38643a7f-365b-4694-b0b7-a16f6c7a1889 service nova] Acquiring lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:55:50 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-9d0bafae-0c24-4a14-8815-bf86d940db0a req-38643a7f-365b-4694-b0b7-a16f6c7a1889 service nova] Lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:55:50 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-9d0bafae-0c24-4a14-8815-bf86d940db0a req-38643a7f-365b-4694-b0b7-a16f6c7a1889 service nova] Lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:55:50 user nova-compute[71229]: DEBUG nova.compute.manager [req-9d0bafae-0c24-4a14-8815-bf86d940db0a req-38643a7f-365b-4694-b0b7-a16f6c7a1889 service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] No waiting events found dispatching network-vif-plugged-8fd17bd8-2470-4931-8df3-b1ca41125d39 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:55:50 user nova-compute[71229]: WARNING nova.compute.manager [req-9d0bafae-0c24-4a14-8815-bf86d940db0a req-38643a7f-365b-4694-b0b7-a16f6c7a1889 service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Received unexpected event network-vif-plugged-8fd17bd8-2470-4931-8df3-b1ca41125d39 for instance with vm_state stopped and task_state None.
Apr 11 15:55:53 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:55:57 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:55:58 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:56:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:56:03 user nova-compute[71229]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681228548.337647, 0d6c5972-e53b-47e9-8f13-7df1ad86020e => Stopped> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:56:03 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] VM Stopped (Lifecycle Event)
Apr 11 15:56:03 user nova-compute[71229]: DEBUG nova.compute.manager [None req-9a3e23da-e173-4af4-a9d4-0d0c69e30350 None None] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:56:03 user nova-compute[71229]: DEBUG nova.compute.manager [None req-9a3e23da-e173-4af4-a9d4-0d0c69e30350 None None] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:56:03 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:56:08 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:56:12 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:56:13 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:56:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:56:18 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:56:18 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 15:56:20 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:56:20 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 15:56:20 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Rebuilding the list of instances to heal {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 15:56:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "refresh_cache-56fbe043-133f-4e43-b9db-8ed02a3ed2af" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:56:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquired lock "refresh_cache-56fbe043-133f-4e43-b9db-8ed02a3ed2af" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:56:20 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Forcefully refreshing network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 15:56:20 user nova-compute[71229]: DEBUG nova.objects.instance [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lazy-loading 'info_cache' on Instance uuid 56fbe043-133f-4e43-b9db-8ed02a3ed2af {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:56:21 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Updating instance_info_cache with network_info: [{"id": "77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b", "address": "fa:16:3e:82:55:d8", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f40fdc-0c", "ovs_interfaceid": "77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:56:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Releasing lock "refresh_cache-56fbe043-133f-4e43-b9db-8ed02a3ed2af" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:56:21 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Updated the network info_cache for instance {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 15:56:22 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:56:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:56:24 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:56:24 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:56:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:56:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:56:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:56:24 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 15:56:24 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:56:24 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:56:24 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:56:25 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:56:25 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:56:25 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:56:25 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:56:25 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:56:25 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:56:25 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8734MB free_disk=26.00238800048828GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 15:56:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:56:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:56:25 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 56fbe043-133f-4e43-b9db-8ed02a3ed2af actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:56:25 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:56:25 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 7889054a-8f28-4a2b-95b3-ec64dc421681 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:56:25 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 15:56:25 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 15:56:25 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:56:25 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:56:25 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 15:56:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.261s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:56:27 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:56:27 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:56:27 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:56:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:56:28 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:56:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:56:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:56:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:56:43 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:56:46 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:56:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:56:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:56:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:56:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:56:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:56:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:56:46 user nova-compute[71229]: DEBUG nova.virt.libvirt.imagecache [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Verify base images {{(pid=71229) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Apr 11 15:56:46 user nova-compute[71229]: DEBUG nova.virt.libvirt.imagecache [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=71229) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 11 15:56:46 user nova-compute[71229]: DEBUG nova.virt.libvirt.imagecache [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Image id 52fe638c-5ada-47d5-b376-233bfa808a37 yields fingerprint 6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a {{(pid=71229) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 11 15:56:46 user nova-compute[71229]: INFO nova.virt.libvirt.imagecache [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] image 52fe638c-5ada-47d5-b376-233bfa808a37 at (/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a): checking
Apr 11 15:56:46 user nova-compute[71229]: DEBUG nova.virt.libvirt.imagecache [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] image 52fe638c-5ada-47d5-b376-233bfa808a37 at (/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a): image is in use {{(pid=71229) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Apr 11 15:56:46 user nova-compute[71229]: DEBUG nova.virt.libvirt.imagecache [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] 7889054a-8f28-4a2b-95b3-ec64dc421681 is a valid instance name {{(pid=71229) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 11 15:56:46 user nova-compute[71229]: DEBUG nova.virt.libvirt.imagecache [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] 56fbe043-133f-4e43-b9db-8ed02a3ed2af is a valid instance name {{(pid=71229) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 11 15:56:46 user nova-compute[71229]: DEBUG nova.virt.libvirt.imagecache [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] 0d6c5972-e53b-47e9-8f13-7df1ad86020e is a valid instance name {{(pid=71229) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 11 15:56:46 user nova-compute[71229]: DEBUG nova.virt.libvirt.imagecache [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] 0d6c5972-e53b-47e9-8f13-7df1ad86020e has a disk file {{(pid=71229) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Apr 11 15:56:46 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:56:46 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:56:46 user nova-compute[71229]: DEBUG nova.virt.libvirt.imagecache [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e is backed by 6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a {{(pid=71229) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Apr 11 15:56:46 user nova-compute[71229]: WARNING nova.virt.libvirt.imagecache [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Unknown base file: /opt/stack/data/nova/instances/_base/0ea4f4863ec734d876b497d439f2cc84b2ac8ad6
Apr 11 15:56:46 user nova-compute[71229]: WARNING nova.virt.libvirt.imagecache [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Unknown base file: /opt/stack/data/nova/instances/_base/2a6c856c397ddcbd7b785bdd35b8b0e4215b5a23
Apr 11 15:56:46 user nova-compute[71229]: WARNING nova.virt.libvirt.imagecache [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ad75252f204c5a5da63dc2b1c040fdefe8eb0101
Apr 11 15:56:46 user nova-compute[71229]: WARNING nova.virt.libvirt.imagecache [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Unknown base file: /opt/stack/data/nova/instances/_base/0c22094c568ddb27dfdc0a5b565aa24ac8771928
Apr 11 15:56:46 user nova-compute[71229]: WARNING nova.virt.libvirt.imagecache [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Unknown base file: /opt/stack/data/nova/instances/_base/a4a2efe8715353e8e729f83cecfb97b8f359c98b
Apr 11 15:56:46 user nova-compute[71229]: WARNING nova.virt.libvirt.imagecache [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Unknown base file: /opt/stack/data/nova/instances/_base/0c1309c913e910f94bada2b43edf82abdb5aa65b
Apr 11 15:56:46 user nova-compute[71229]: WARNING nova.virt.libvirt.imagecache [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Unknown base file: /opt/stack/data/nova/instances/_base/2a43d9b15523ef3658db9e91fc56634e204b3f23
Apr 11 15:56:46 user nova-compute[71229]: WARNING nova.virt.libvirt.imagecache [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Unknown base file: /opt/stack/data/nova/instances/_base/38c584cca3c5ffb4989f409824cec94a15e6f5da
Apr 11 15:56:46 user nova-compute[71229]: WARNING nova.virt.libvirt.imagecache [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Unknown base file: /opt/stack/data/nova/instances/_base/f5b3dfefdf8867a11ef3d904c3bec91eb9e5c5bd
Apr 11 15:56:46 user nova-compute[71229]: INFO nova.virt.libvirt.imagecache [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Active base files: /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a
Apr 11 15:56:46 user nova-compute[71229]: INFO nova.virt.libvirt.imagecache [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Removable base files: /opt/stack/data/nova/instances/_base/0ea4f4863ec734d876b497d439f2cc84b2ac8ad6 /opt/stack/data/nova/instances/_base/2a6c856c397ddcbd7b785bdd35b8b0e4215b5a23 /opt/stack/data/nova/instances/_base/ad75252f204c5a5da63dc2b1c040fdefe8eb0101 /opt/stack/data/nova/instances/_base/0c22094c568ddb27dfdc0a5b565aa24ac8771928 /opt/stack/data/nova/instances/_base/a4a2efe8715353e8e729f83cecfb97b8f359c98b /opt/stack/data/nova/instances/_base/0c1309c913e910f94bada2b43edf82abdb5aa65b /opt/stack/data/nova/instances/_base/2a43d9b15523ef3658db9e91fc56634e204b3f23 /opt/stack/data/nova/instances/_base/38c584cca3c5ffb4989f409824cec94a15e6f5da /opt/stack/data/nova/instances/_base/f5b3dfefdf8867a11ef3d904c3bec91eb9e5c5bd
Apr 11 15:56:46 user nova-compute[71229]: INFO nova.virt.libvirt.imagecache [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0ea4f4863ec734d876b497d439f2cc84b2ac8ad6
Apr 11 15:56:46 user nova-compute[71229]: INFO nova.virt.libvirt.imagecache [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2a6c856c397ddcbd7b785bdd35b8b0e4215b5a23
Apr 11 15:56:46 user nova-compute[71229]: INFO nova.virt.libvirt.imagecache [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ad75252f204c5a5da63dc2b1c040fdefe8eb0101
Apr 11 15:56:46 user nova-compute[71229]: INFO nova.virt.libvirt.imagecache [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0c22094c568ddb27dfdc0a5b565aa24ac8771928
Apr 11 15:56:46 user nova-compute[71229]: INFO nova.virt.libvirt.imagecache [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a4a2efe8715353e8e729f83cecfb97b8f359c98b
Apr 11 15:56:46 user nova-compute[71229]: INFO nova.virt.libvirt.imagecache [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0c1309c913e910f94bada2b43edf82abdb5aa65b
Apr 11 15:56:46 user nova-compute[71229]: INFO nova.virt.libvirt.imagecache [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2a43d9b15523ef3658db9e91fc56634e204b3f23
Apr 11 15:56:46 user nova-compute[71229]: INFO nova.virt.libvirt.imagecache [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/38c584cca3c5ffb4989f409824cec94a15e6f5da
Apr 11 15:56:46 user nova-compute[71229]: INFO nova.virt.libvirt.imagecache [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f5b3dfefdf8867a11ef3d904c3bec91eb9e5c5bd
Apr 11 15:56:46 user nova-compute[71229]: DEBUG nova.virt.libvirt.imagecache [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Verification complete {{(pid=71229) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Apr 11 15:56:46 user nova-compute[71229]: DEBUG nova.virt.libvirt.imagecache [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Verify swap images {{(pid=71229) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Apr 11 15:56:46 user nova-compute[71229]: DEBUG nova.virt.libvirt.imagecache [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Verify ephemeral images {{(pid=71229) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Apr 11 15:56:48 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:56:53 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:56:58 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:57:02 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:57:02 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Cleaning up deleted instances {{(pid=71229) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 15:57:02 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] There are 0 instances to clean {{(pid=71229) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 15:57:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:57:03 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:57:03 user nova-compute[71229]: DEBUG nova.compute.manager [req-44b1e0fe-192c-4aa4-a57d-4af4a5d3c7c7 req-b5f28e12-cba2-4b85-a53f-c0ea2886721a service nova] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Received event network-changed-fb3bb75a-7f7c-4611-91bf-313a7f1610b5 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:57:03 user nova-compute[71229]: DEBUG nova.compute.manager [req-44b1e0fe-192c-4aa4-a57d-4af4a5d3c7c7 req-b5f28e12-cba2-4b85-a53f-c0ea2886721a service nova] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Refreshing instance network info cache due to event network-changed-fb3bb75a-7f7c-4611-91bf-313a7f1610b5. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:57:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-44b1e0fe-192c-4aa4-a57d-4af4a5d3c7c7 req-b5f28e12-cba2-4b85-a53f-c0ea2886721a service nova] Acquiring lock "refresh_cache-7889054a-8f28-4a2b-95b3-ec64dc421681" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:57:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-44b1e0fe-192c-4aa4-a57d-4af4a5d3c7c7 req-b5f28e12-cba2-4b85-a53f-c0ea2886721a service nova] Acquired lock "refresh_cache-7889054a-8f28-4a2b-95b3-ec64dc421681" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:57:03 user nova-compute[71229]: DEBUG nova.network.neutron [req-44b1e0fe-192c-4aa4-a57d-4af4a5d3c7c7 req-b5f28e12-cba2-4b85-a53f-c0ea2886721a service nova] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Refreshing network info cache for port fb3bb75a-7f7c-4611-91bf-313a7f1610b5 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:57:04 user nova-compute[71229]: DEBUG nova.network.neutron [req-44b1e0fe-192c-4aa4-a57d-4af4a5d3c7c7 req-b5f28e12-cba2-4b85-a53f-c0ea2886721a service nova] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Updated VIF entry in instance network info cache for port fb3bb75a-7f7c-4611-91bf-313a7f1610b5. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:57:04 user nova-compute[71229]: DEBUG nova.network.neutron [req-44b1e0fe-192c-4aa4-a57d-4af4a5d3c7c7 req-b5f28e12-cba2-4b85-a53f-c0ea2886721a service nova] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Updating instance_info_cache with network_info: [{"id": "fb3bb75a-7f7c-4611-91bf-313a7f1610b5", "address": "fa:16:3e:f3:14:15", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb3bb75a-7f", "ovs_interfaceid": "fb3bb75a-7f7c-4611-91bf-313a7f1610b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:57:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-44b1e0fe-192c-4aa4-a57d-4af4a5d3c7c7 req-b5f28e12-cba2-4b85-a53f-c0ea2886721a service nova] Releasing lock "refresh_cache-7889054a-8f28-4a2b-95b3-ec64dc421681" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:57:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "7889054a-8f28-4a2b-95b3-ec64dc421681" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:57:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "7889054a-8f28-4a2b-95b3-ec64dc421681" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:57:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "7889054a-8f28-4a2b-95b3-ec64dc421681-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:57:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "7889054a-8f28-4a2b-95b3-ec64dc421681-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:57:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "7889054a-8f28-4a2b-95b3-ec64dc421681-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:57:04 user nova-compute[71229]: INFO nova.compute.manager [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Terminating instance
Apr 11 15:57:04 user nova-compute[71229]: DEBUG nova.compute.manager [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Start destroying the instance on the hypervisor. {{(pid=71229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 15:57:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:57:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:57:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:57:05 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Instance destroyed successfully.
Apr 11 15:57:05 user nova-compute[71229]: DEBUG nova.objects.instance [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lazy-loading 'resources' on Instance uuid 7889054a-8f28-4a2b-95b3-ec64dc421681 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:55:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-171471328',display_name='tempest-TestVolumeBootPattern-server-171471328',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-171471328',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHFmBexXT+1iiEvWvrTBCCfLTFSZaBECTRUjU2HFOZ99DTdS224XqNm6W0NLu+fhNbtUG4d3cptal0K2Oy5ZbjfRTK7G/g++ylfyvf1YI+eSa1yX5tyMrdSO5dom9On9A==',key_name='tempest-TestVolumeBootPattern-1289860889',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:55:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='312851c65ba1434691eca0cd2a8cd6d2',ramdisk_id='',reservation_id='r-9bkzcpnz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1933582504',owner_user_name='tempest-TestVolumeBootPattern-1933582504-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:55:22Z,user_data=None,user_id='c2110b74f38642afa560e1c9790d3f81',uuid=7889054a-8f28-4a2b-95b3-ec64dc421681,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb3bb75a-7f7c-4611-91bf-313a7f1610b5", "address": "fa:16:3e:f3:14:15", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb3bb75a-7f", "ovs_interfaceid": "fb3bb75a-7f7c-4611-91bf-313a7f1610b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Converting VIF {"id": "fb3bb75a-7f7c-4611-91bf-313a7f1610b5", "address": "fa:16:3e:f3:14:15", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb3bb75a-7f", "ovs_interfaceid": "fb3bb75a-7f7c-4611-91bf-313a7f1610b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:14:15,bridge_name='br-int',has_traffic_filtering=True,id=fb3bb75a-7f7c-4611-91bf-313a7f1610b5,network=Network(8d262ba8-b9c3-44ed-8431-6c295eb9ea24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb3bb75a-7f') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG os_vif [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:14:15,bridge_name='br-int',has_traffic_filtering=True,id=fb3bb75a-7f7c-4611-91bf-313a7f1610b5,network=Network(8d262ba8-b9c3-44ed-8431-6c295eb9ea24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb3bb75a-7f') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb3bb75a-7f, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:57:05 user nova-compute[71229]: INFO os_vif [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:14:15,bridge_name='br-int',has_traffic_filtering=True,id=fb3bb75a-7f7c-4611-91bf-313a7f1610b5,network=Network(8d262ba8-b9c3-44ed-8431-6c295eb9ea24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb3bb75a-7f')
Apr 11 15:57:05 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ERXyYFaL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:57:05 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:57:05 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb27479-b5e5-4fb1-a3a3-5c333acf7a54]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 15:57:05 user nova-compute[71229]: No targets found.
Apr 11 15:57:05 user nova-compute[71229]: iSNS:
Apr 11 15:57:05 user nova-compute[71229]: No targets found.
Apr 11 15:57:05 user nova-compute[71229]: STATIC:
Apr 11 15:57:05 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0
Apr 11 15:57:05 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:57:05 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:57:05 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915
Apr 11 15:57:05 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:57:05 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:57:05 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714
Apr 11 15:57:05 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:57:05 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:57:05 user nova-compute[71229]: FIRMWARE:
Apr 11 15:57:05 user nova-compute[71229]: No targets found.
Apr 11 15:57:05 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 15:57:05 user nova-compute[71229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 15:57:05 user nova-compute[71229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71229) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714', 0)] {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f4fc31-99db-4f9f-9820-cf3ff7c68cfa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3762ed34-2742-457f-95a0-b03b4fb40caa]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 (non-flash)
Apr 11 15:57:05 user nova-compute[71229]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714 (non-flash)
Apr 11 15:57:05 user nova-compute[71229]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 (non-flash)
Apr 11 15:57:05 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 (non-flash)
Apr 11 15:57:05 user nova-compute[71229]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714 (non-flash)
Apr 11 15:57:05 user nova-compute[71229]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 (non-flash)
Apr 11 15:57:05 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb286def80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714'): ({'sdc'}, set())}) {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Removing single pathed devices sdc {{(pid=71229) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b22125-6862-4c71-900f-da6d053fe24b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[962b15bb-4f71-4af2-a869-b6cf91f71d1d]: (4, ('ok\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Flushing IO for device /dev/sdc {{(pid=71229) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f598995-f8c9-445a-ab01-b0afe9d67a0a]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71229) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb105071-3a62-4038-bc5f-b13d87e5022c]: (4, ('1', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] SCSI volumes sdc have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714')] {{(pid=71229) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6fdc1e-257d-480e-84d8-124cc84bc8da]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714 -p 172.16.0.220:3260 --logout {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[daee0cd7-205b-4ebc-a874-c068c6a0bde3]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714, portal: 172.16.0.220,3260]
Apr 11 15:57:05 user nova-compute[71229]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714, portal: 172.16.0.220,3260] successful.
Apr 11 15:57:05 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714 -p 172.16.0.220:3260 --op delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa9e7f7f-d130-4bd7-abd6-1d4bf3659714 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0169af34-50fb-4b6f-86a3-928282853add]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] <== disconnect_volume: return (315ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 15:57:05 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Deleting instance files /opt/stack/data/nova/instances/7889054a-8f28-4a2b-95b3-ec64dc421681_del
Apr 11 15:57:05 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Deletion of /opt/stack/data/nova/instances/7889054a-8f28-4a2b-95b3-ec64dc421681_del complete
Apr 11 15:57:05 user nova-compute[71229]: INFO nova.compute.manager [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Took 1.18 seconds to destroy the instance on the hypervisor.
Apr 11 15:57:05 user nova-compute[71229]: DEBUG oslo.service.loopingcall [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71229) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG nova.compute.manager [-] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Deallocating network for instance {{(pid=71229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] deallocate_for_instance() {{(pid=71229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG nova.compute.manager [req-a7c53fd8-aa33-4db3-b8cd-c35f0b13cb39 req-a7862e71-4461-44f4-9ac1-59892e1bdcba service nova] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Received event network-changed-fb3bb75a-7f7c-4611-91bf-313a7f1610b5 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG nova.compute.manager [req-a7c53fd8-aa33-4db3-b8cd-c35f0b13cb39 req-a7862e71-4461-44f4-9ac1-59892e1bdcba service nova] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Refreshing instance network info cache due to event network-changed-fb3bb75a-7f7c-4611-91bf-313a7f1610b5. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a7c53fd8-aa33-4db3-b8cd-c35f0b13cb39 req-a7862e71-4461-44f4-9ac1-59892e1bdcba service nova] Acquiring lock "refresh_cache-7889054a-8f28-4a2b-95b3-ec64dc421681" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a7c53fd8-aa33-4db3-b8cd-c35f0b13cb39 req-a7862e71-4461-44f4-9ac1-59892e1bdcba service nova] Acquired lock "refresh_cache-7889054a-8f28-4a2b-95b3-ec64dc421681" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:57:05 user nova-compute[71229]: DEBUG nova.network.neutron [req-a7c53fd8-aa33-4db3-b8cd-c35f0b13cb39 req-a7862e71-4461-44f4-9ac1-59892e1bdcba service nova] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Refreshing network info cache for port fb3bb75a-7f7c-4611-91bf-313a7f1610b5 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:57:06 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:57:06 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Took 0.48 seconds to deallocate network for instance.
Apr 11 15:57:06 user nova-compute[71229]: DEBUG nova.compute.manager [req-08dba800-0f44-4ad9-b523-ef95ebbc8648 req-7cd0667a-6108-4161-9d6a-bc23c052f804 service nova] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Received event network-vif-deleted-fb3bb75a-7f7c-4611-91bf-313a7f1610b5 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:57:06 user nova-compute[71229]: DEBUG nova.network.neutron [req-a7c53fd8-aa33-4db3-b8cd-c35f0b13cb39 req-a7862e71-4461-44f4-9ac1-59892e1bdcba service nova] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Updated VIF entry in instance network info cache for port fb3bb75a-7f7c-4611-91bf-313a7f1610b5. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:57:06 user nova-compute[71229]: DEBUG nova.network.neutron [req-a7c53fd8-aa33-4db3-b8cd-c35f0b13cb39 req-a7862e71-4461-44f4-9ac1-59892e1bdcba service nova] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Updating instance_info_cache with network_info: [{"id": "fb3bb75a-7f7c-4611-91bf-313a7f1610b5", "address": "fa:16:3e:f3:14:15", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb3bb75a-7f", "ovs_interfaceid": "fb3bb75a-7f7c-4611-91bf-313a7f1610b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:57:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a7c53fd8-aa33-4db3-b8cd-c35f0b13cb39 req-a7862e71-4461-44f4-9ac1-59892e1bdcba service nova] Releasing lock "refresh_cache-7889054a-8f28-4a2b-95b3-ec64dc421681" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:57:06 user nova-compute[71229]: DEBUG nova.compute.manager [req-a7c53fd8-aa33-4db3-b8cd-c35f0b13cb39 req-a7862e71-4461-44f4-9ac1-59892e1bdcba service nova] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Received event network-vif-unplugged-fb3bb75a-7f7c-4611-91bf-313a7f1610b5 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:57:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a7c53fd8-aa33-4db3-b8cd-c35f0b13cb39 req-a7862e71-4461-44f4-9ac1-59892e1bdcba service nova] Acquiring lock "7889054a-8f28-4a2b-95b3-ec64dc421681-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:57:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a7c53fd8-aa33-4db3-b8cd-c35f0b13cb39 req-a7862e71-4461-44f4-9ac1-59892e1bdcba service nova] Lock "7889054a-8f28-4a2b-95b3-ec64dc421681-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:57:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a7c53fd8-aa33-4db3-b8cd-c35f0b13cb39 req-a7862e71-4461-44f4-9ac1-59892e1bdcba service nova] Lock "7889054a-8f28-4a2b-95b3-ec64dc421681-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:57:06 user nova-compute[71229]: DEBUG nova.compute.manager [req-a7c53fd8-aa33-4db3-b8cd-c35f0b13cb39 req-a7862e71-4461-44f4-9ac1-59892e1bdcba service nova] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] No waiting events found dispatching network-vif-unplugged-fb3bb75a-7f7c-4611-91bf-313a7f1610b5 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:57:06 user nova-compute[71229]: DEBUG nova.compute.manager [req-a7c53fd8-aa33-4db3-b8cd-c35f0b13cb39 req-a7862e71-4461-44f4-9ac1-59892e1bdcba service nova] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Received event network-vif-unplugged-fb3bb75a-7f7c-4611-91bf-313a7f1610b5 for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 15:57:06 user nova-compute[71229]: DEBUG nova.compute.manager [req-a7c53fd8-aa33-4db3-b8cd-c35f0b13cb39 req-a7862e71-4461-44f4-9ac1-59892e1bdcba service nova] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Received event network-vif-plugged-fb3bb75a-7f7c-4611-91bf-313a7f1610b5 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:57:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a7c53fd8-aa33-4db3-b8cd-c35f0b13cb39 req-a7862e71-4461-44f4-9ac1-59892e1bdcba service nova] Acquiring lock "7889054a-8f28-4a2b-95b3-ec64dc421681-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:57:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a7c53fd8-aa33-4db3-b8cd-c35f0b13cb39 req-a7862e71-4461-44f4-9ac1-59892e1bdcba service nova] Lock "7889054a-8f28-4a2b-95b3-ec64dc421681-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:57:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-a7c53fd8-aa33-4db3-b8cd-c35f0b13cb39 req-a7862e71-4461-44f4-9ac1-59892e1bdcba service nova] Lock "7889054a-8f28-4a2b-95b3-ec64dc421681-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:57:06 user nova-compute[71229]: DEBUG nova.compute.manager [req-a7c53fd8-aa33-4db3-b8cd-c35f0b13cb39 req-a7862e71-4461-44f4-9ac1-59892e1bdcba service nova] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] No waiting events found dispatching network-vif-plugged-fb3bb75a-7f7c-4611-91bf-313a7f1610b5 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:57:06 user nova-compute[71229]: WARNING nova.compute.manager [req-a7c53fd8-aa33-4db3-b8cd-c35f0b13cb39 req-a7862e71-4461-44f4-9ac1-59892e1bdcba service nova] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Received unexpected event network-vif-plugged-fb3bb75a-7f7c-4611-91bf-313a7f1610b5 for instance with vm_state active and task_state deleting.
Apr 11 15:57:06 user nova-compute[71229]: INFO nova.compute.manager [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Took 0.79 seconds to detach 1 volumes for instance.
Apr 11 15:57:07 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:57:07 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:57:07 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:57:07 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:57:07 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.158s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:57:07 user nova-compute[71229]: INFO nova.scheduler.client.report [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Deleted allocations for instance 7889054a-8f28-4a2b-95b3-ec64dc421681
Apr 11 15:57:07 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-85d62899-d38d-413f-8abc-35cd99b31de8 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "7889054a-8f28-4a2b-95b3-ec64dc421681" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.869s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:57:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:57:10 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:57:15 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:57:18 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:57:18 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 15:57:20 user nova-compute[71229]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681228625.1822858, 7889054a-8f28-4a2b-95b3-ec64dc421681 => Stopped> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:57:20 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] VM Stopped (Lifecycle Event)
Apr 11 15:57:20 user nova-compute[71229]: DEBUG nova.compute.manager [None req-d7caa3ac-c4ad-48e4-aa2c-ca319197583e None None] [instance: 7889054a-8f28-4a2b-95b3-ec64dc421681] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:57:20 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:57:20 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:57:20 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 15:57:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "refresh_cache-0d6c5972-e53b-47e9-8f13-7df1ad86020e" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:57:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquired lock "refresh_cache-0d6c5972-e53b-47e9-8f13-7df1ad86020e" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:57:20 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Forcefully refreshing network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 15:57:21 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Updating instance_info_cache with network_info: [{"id": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "address": "fa:16:3e:ba:60:e0", "network": {"id": "e6f9483b-53f6-4696-b451-52aeb6ec13d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822664747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa330c512f045dc8a5946be3563fdcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd17bd8-24", "ovs_interfaceid": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:57:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Releasing lock "refresh_cache-0d6c5972-e53b-47e9-8f13-7df1ad86020e" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:57:21 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Updated the network info_cache for instance {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 15:57:23 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:57:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:57:26 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:57:26 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:57:26 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:57:26 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:57:26 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:57:26 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:57:26 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:57:26 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 15:57:26 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:57:26 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:57:26 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:57:27 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:57:27 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:57:27 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:57:27 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:57:27 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:57:27 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8797MB free_disk=26.001419067382812GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 15:57:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:57:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:57:27 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 56fbe043-133f-4e43-b9db-8ed02a3ed2af actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:57:27 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:57:27 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 15:57:27 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 15:57:27 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:57:27 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:57:27 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 15:57:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.199s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:57:27 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:57:27 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:57:27 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71229) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 15:57:29 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:57:29 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:57:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:57:35 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:57:36 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:57:38 user nova-compute[71229]: DEBUG nova.objects.instance [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lazy-loading 'flavor' on Instance uuid 0d6c5972-e53b-47e9-8f13-7df1ad86020e {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:57:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "refresh_cache-0d6c5972-e53b-47e9-8f13-7df1ad86020e" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:57:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquired lock "refresh_cache-0d6c5972-e53b-47e9-8f13-7df1ad86020e" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:57:38 user nova-compute[71229]: DEBUG nova.network.neutron [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 15:57:38 user nova-compute[71229]: DEBUG nova.objects.instance [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lazy-loading 'info_cache' on Instance uuid 0d6c5972-e53b-47e9-8f13-7df1ad86020e {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:57:38 user nova-compute[71229]: DEBUG nova.network.neutron [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Updating instance_info_cache with network_info: [{"id": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "address": "fa:16:3e:ba:60:e0", "network": {"id": "e6f9483b-53f6-4696-b451-52aeb6ec13d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822664747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa330c512f045dc8a5946be3563fdcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd17bd8-24", "ovs_interfaceid": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:57:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Releasing lock "refresh_cache-0d6c5972-e53b-47e9-8f13-7df1ad86020e" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:57:38 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Instance destroyed successfully.
Apr 11 15:57:38 user nova-compute[71229]: DEBUG nova.objects.instance [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lazy-loading 'resources' on Instance uuid 0d6c5972-e53b-47e9-8f13-7df1ad86020e {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:57:38 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:53:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-873450080',display_name='tempest-AttachVolumeTestJSON-server-873450080',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-873450080',id=39,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA++uuXe6FyaUH7+6A7LXI9JAeQOW0LGZU8i83jm7ocQcCkrPDDJFgc0QxuJD62Az+edRqtAEJw2zMA+YyRUWi6KTatWRW/2wsFjFL2TMdY96WvhmRoEL5HXtf0K6rtWuw==',key_name='tempest-keypair-1501547376',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:53:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8fa330c512f045dc8a5946be3563fdcd',ramdisk_id='',reservation_id='r-y1ru7450',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1691938977',owner_user_name='tempest-AttachVolumeTestJSON-1691938977-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:55:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa87f179b35a4d1db2336802e8f104e4',uuid=0d6c5972-e53b-47e9-8f13-7df1ad86020e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "address": "fa:16:3e:ba:60:e0", "network": {"id": "e6f9483b-53f6-4696-b451-52aeb6ec13d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822664747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa330c512f045dc8a5946be3563fdcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd17bd8-24", "ovs_interfaceid": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:57:38 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Converting VIF {"id": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "address": "fa:16:3e:ba:60:e0", "network": {"id": "e6f9483b-53f6-4696-b451-52aeb6ec13d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822664747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa330c512f045dc8a5946be3563fdcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd17bd8-24", "ovs_interfaceid": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:57:38 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:60:e0,bridge_name='br-int',has_traffic_filtering=True,id=8fd17bd8-2470-4931-8df3-b1ca41125d39,network=Network(e6f9483b-53f6-4696-b451-52aeb6ec13d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fd17bd8-24') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:57:38 user nova-compute[71229]: DEBUG os_vif [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:60:e0,bridge_name='br-int',has_traffic_filtering=True,id=8fd17bd8-2470-4931-8df3-b1ca41125d39,network=Network(e6f9483b-53f6-4696-b451-52aeb6ec13d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fd17bd8-24') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:57:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:57:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8fd17bd8-24, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:57:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:57:38 user nova-compute[71229]: INFO os_vif [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:60:e0,bridge_name='br-int',has_traffic_filtering=True,id=8fd17bd8-2470-4931-8df3-b1ca41125d39,network=Network(e6f9483b-53f6-4696-b451-52aeb6ec13d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fd17bd8-24')
Apr 11 15:57:38 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 15:57:38 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hYDREkBL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:57:38 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:57:38 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:57:38 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:57:38 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:57:38 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:57:38 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52e8c63-f996-4d69-b81c-d91db11e7556]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:57:38 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 15:57:38 user nova-compute[71229]: No targets found.
Apr 11 15:57:38 user nova-compute[71229]: iSNS:
Apr 11 15:57:38 user nova-compute[71229]: No targets found.
Apr 11 15:57:38 user nova-compute[71229]: STATIC:
Apr 11 15:57:38 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0
Apr 11 15:57:38 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:57:38 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:57:38 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915
Apr 11 15:57:38 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:57:38 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:57:38 user nova-compute[71229]: FIRMWARE:
Apr 11 15:57:38 user nova-compute[71229]: No targets found.
Apr 11 15:57:38 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:57:38 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 15:57:38 user nova-compute[71229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 15:57:38 user nova-compute[71229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71229) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 15:57:38 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915', 0)] {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 15:57:38 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:57:38 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:57:38 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa7d9e2-2889-4e4d-98e2-9d26ef6a0406]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:57:38 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:57:38 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:57:38 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[74416370-ec9b-4019-bcaf-d9cb46a50ee6]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:57:38 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 (non-flash)
Apr 11 15:57:38 user nova-compute[71229]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 (non-flash)
Apr 11 15:57:38 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:57:38 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 (non-flash)
Apr 11 15:57:38 user nova-compute[71229]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 (non-flash)
Apr 11 15:57:38 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:57:38 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb2853a7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915'): ({'sdd'}, set())}) {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 15:57:38 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Removing single pathed devices sdd {{(pid=71229) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 15:57:38 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:57:38 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:57:38 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b9970a-36b9-4d6b-ae5e-985086ec23e2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:57:38 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.032s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c691b95-401d-43bc-824d-5f014edddf19]: (4, ('ok\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Flushing IO for device /dev/sdd {{(pid=71229) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[530a2a61-ac26-4b27-ae55-dc3fcf3069ac]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71229) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[183fb718-13ce-42b9-8c72-b5aac48ae6d8]: (4, ('1', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] SCSI volumes sdd have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915')] {{(pid=71229) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1217e582-d34a-4917-990c-3c385714460c]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 -p 172.16.0.220:3260 --logout {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00e9a09-4399-4784-8c9f-16c44e19f0dc]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915, portal: 172.16.0.220,3260]
Apr 11 15:57:39 user nova-compute[71229]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915, portal: 172.16.0.220,3260] successful.
Apr 11 15:57:39 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 -p 172.16.0.220:3260 --op delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[84de5b43-1989-47d6-b0ac-c81fd5ef73ec]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] <== disconnect_volume: return (325ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Start _get_guest_xml network_info=[{"id": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "address": "fa:16:3e:ba:60:e0", "network": {"id": "e6f9483b-53f6-4696-b451-52aeb6ec13d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822664747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa330c512f045dc8a5946be3563fdcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd17bd8-24", "ovs_interfaceid": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '52fe638c-5ada-47d5-b376-233bfa808a37'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hYDREkBL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '0d6c5972-e53b-47e9-8f13-7df1ad86020e', 'attached_at': '', 'detached_at': '', 'volume_id': '0b6dc374-b525-44a2-8e35-d4a723ae5915', 'serial': '0b6dc374-b525-44a2-8e35-d4a723ae5915'}, 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'f1312597-673a-4c5d-907e-7cfa37240fbf', 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG nova.objects.instance [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lazy-loading 'numa_topology' on Instance uuid 0d6c5972-e53b-47e9-8f13-7df1ad86020e {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:57:39 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:57:39 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:57:39 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG nova.objects.instance [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0d6c5972-e53b-47e9-8f13-7df1ad86020e {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hYDREkBL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:57:39 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:57:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:57:39 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:57:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:57:39 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 15:57:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd872d9d-c7e9-4796-a49c-9388319ce6c2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 15:57:39 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 -p 172.16.0.220:3260 --interface default --op new {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7daf8876-a7d9-4989-84a4-a0101046fc72]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915] added\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915] added
Apr 11 15:57:39 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc85edd8-acf6-4751-82f5-dbc7f1565dab]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2896ae01-ee0c-439a-97ed-a0249bd823f3]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hYDREkBL {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hYDREkBL" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[963fd3a4-be64-4458-a591-6b4ae694e9c8]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hYDREkBL'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb1eadb-13f0-4337-b32b-6ac76da085a7]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad703ed-1373-4d4c-ae9b-d1ed2776b321]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 (non-flash)
Apr 11 15:57:39 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 (non-flash)
Apr 11 15:57:39 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 -p 172.16.0.220:3260 --login {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[616e094a-983c-450b-b9ee-92f54c229e7d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915, portal: 172.16.0.220,3260]
Apr 11 15:57:39 user nova-compute[71229]: Login to [iface: default, target: iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915, portal: 172.16.0.220,3260] successful.
Apr 11 15:57:39 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e19459-45c9-4778-9b80-3805906a43de]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2a8b8f-947f-4585-b8f8-ef0624b7c0fe]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 (non-flash)
Apr 11 15:57:39 user nova-compute[71229]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 (non-flash)
Apr 11 15:57:39 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 (non-flash)
Apr 11 15:57:39 user nova-compute[71229]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 (non-flash)
Apr 11 15:57:39 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2276b415-cb79-4515-9b3f-b8094963816b]: (4, ('- - 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:57:39 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: None {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:57:40 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 15:57:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hYDREkBL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 15:57:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.273s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:57:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] <== connect_volume: return (1274ms) {'type': 'block', 'scsi_wwn': '26331623362346266', 'path': '/dev/sdc'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:57:40 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331623362346266', 'path': '/dev/sdc'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 15:57:40 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:53:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-873450080',display_name='tempest-AttachVolumeTestJSON-server-873450080',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-873450080',id=39,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA++uuXe6FyaUH7+6A7LXI9JAeQOW0LGZU8i83jm7ocQcCkrPDDJFgc0QxuJD62Az+edRqtAEJw2zMA+YyRUWi6KTatWRW/2wsFjFL2TMdY96WvhmRoEL5HXtf0K6rtWuw==',key_name='tempest-keypair-1501547376',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:53:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8fa330c512f045dc8a5946be3563fdcd',ramdisk_id='',reservation_id='r-y1ru7450',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1691938977',owner_user_name='tempest-AttachVolumeTestJSON-1691938977-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:55:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa87f179b35a4d1db2336802e8f104e4',uuid=0d6c5972-e53b-47e9-8f13-7df1ad86020e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "address": "fa:16:3e:ba:60:e0", "network": {"id": "e6f9483b-53f6-4696-b451-52aeb6ec13d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822664747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa330c512f045dc8a5946be3563fdcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd17bd8-24", "ovs_interfaceid": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 15:57:40 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Converting VIF {"id": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "address": "fa:16:3e:ba:60:e0", "network": {"id": "e6f9483b-53f6-4696-b451-52aeb6ec13d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822664747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa330c512f045dc8a5946be3563fdcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd17bd8-24", "ovs_interfaceid": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:57:40 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:60:e0,bridge_name='br-int',has_traffic_filtering=True,id=8fd17bd8-2470-4931-8df3-b1ca41125d39,network=Network(e6f9483b-53f6-4696-b451-52aeb6ec13d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fd17bd8-24') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:57:40 user nova-compute[71229]: DEBUG nova.objects.instance [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d6c5972-e53b-47e9-8f13-7df1ad86020e {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:57:40 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] End _get_guest_xml xml=<domain type="kvm">
Apr 11 15:57:40 user nova-compute[71229]:   <uuid>0d6c5972-e53b-47e9-8f13-7df1ad86020e</uuid>
Apr 11 15:57:40 user nova-compute[71229]:   <name>instance-00000027</name>
Apr 11 15:57:40 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 15:57:40 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 15:57:40 user nova-compute[71229]:   <metadata>
Apr 11 15:57:40 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 15:57:40 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 15:57:40 user nova-compute[71229]:       <nova:name>tempest-AttachVolumeTestJSON-server-873450080</nova:name>
Apr 11 15:57:40 user nova-compute[71229]:       <nova:creationTime>2023-04-11 15:57:39</nova:creationTime>
Apr 11 15:57:40 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 15:57:40 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 15:57:40 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 15:57:40 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 15:57:40 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 15:57:40 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 15:57:40 user nova-compute[71229]:       </nova:flavor>
Apr 11 15:57:40 user nova-compute[71229]:       <nova:owner>
Apr 11 15:57:40 user nova-compute[71229]:         <nova:user uuid="aa87f179b35a4d1db2336802e8f104e4">tempest-AttachVolumeTestJSON-1691938977-project-member</nova:user>
Apr 11 15:57:40 user nova-compute[71229]:         <nova:project uuid="8fa330c512f045dc8a5946be3563fdcd">tempest-AttachVolumeTestJSON-1691938977</nova:project>
Apr 11 15:57:40 user nova-compute[71229]:       </nova:owner>
Apr 11 15:57:40 user nova-compute[71229]:       <nova:root type="image" uuid="52fe638c-5ada-47d5-b376-233bfa808a37"/>
Apr 11 15:57:40 user nova-compute[71229]:       <nova:ports>
Apr 11 15:57:40 user nova-compute[71229]:         <nova:port uuid="8fd17bd8-2470-4931-8df3-b1ca41125d39">
Apr 11 15:57:40 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 11 15:57:40 user nova-compute[71229]:         </nova:port>
Apr 11 15:57:40 user nova-compute[71229]:       </nova:ports>
Apr 11 15:57:40 user nova-compute[71229]:     </nova:instance>
Apr 11 15:57:40 user nova-compute[71229]:   </metadata>
Apr 11 15:57:40 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 15:57:40 user nova-compute[71229]:     <system>
Apr 11 15:57:40 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 15:57:40 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 15:57:40 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 15:57:40 user nova-compute[71229]:       <entry name="serial">0d6c5972-e53b-47e9-8f13-7df1ad86020e</entry>
Apr 11 15:57:40 user nova-compute[71229]:       <entry name="uuid">0d6c5972-e53b-47e9-8f13-7df1ad86020e</entry>
Apr 11 15:57:40 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 15:57:40 user nova-compute[71229]:     </system>
Apr 11 15:57:40 user nova-compute[71229]:   </sysinfo>
Apr 11 15:57:40 user nova-compute[71229]:   <os>
Apr 11 15:57:40 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 15:57:40 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 15:57:40 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 15:57:40 user nova-compute[71229]:   </os>
Apr 11 15:57:40 user nova-compute[71229]:   <features>
Apr 11 15:57:40 user nova-compute[71229]:     <acpi/>
Apr 11 15:57:40 user nova-compute[71229]:     <apic/>
Apr 11 15:57:40 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 15:57:40 user nova-compute[71229]:   </features>
Apr 11 15:57:40 user nova-compute[71229]:   <clock offset="utc">
Apr 11 15:57:40 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 15:57:40 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 15:57:40 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 15:57:40 user nova-compute[71229]:   </clock>
Apr 11 15:57:40 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 15:57:40 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 15:57:40 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 15:57:40 user nova-compute[71229]:   </cpu>
Apr 11 15:57:40 user nova-compute[71229]:   <devices>
Apr 11 15:57:40 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 15:57:40 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 15:57:40 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk"/>
Apr 11 15:57:40 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 15:57:40 user nova-compute[71229]:     </disk>
Apr 11 15:57:40 user nova-compute[71229]:     <disk type="block" device="disk">
Apr 11 15:57:40 user nova-compute[71229]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:57:40 user nova-compute[71229]:       <source dev="/dev/sdc"/>
Apr 11 15:57:40 user nova-compute[71229]:       <target dev="vdb" bus="virtio"/>
Apr 11 15:57:40 user nova-compute[71229]:       <serial>0b6dc374-b525-44a2-8e35-d4a723ae5915</serial>
Apr 11 15:57:40 user nova-compute[71229]:     </disk>
Apr 11 15:57:40 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 15:57:40 user nova-compute[71229]:       <mac address="fa:16:3e:ba:60:e0"/>
Apr 11 15:57:40 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:57:40 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 15:57:40 user nova-compute[71229]:       <target dev="tap8fd17bd8-24"/>
Apr 11 15:57:40 user nova-compute[71229]:     </interface>
Apr 11 15:57:40 user nova-compute[71229]:     <serial type="pty">
Apr 11 15:57:40 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/console.log" append="off"/>
Apr 11 15:57:40 user nova-compute[71229]:     </serial>
Apr 11 15:57:40 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 15:57:40 user nova-compute[71229]:     <video>
Apr 11 15:57:40 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 15:57:40 user nova-compute[71229]:     </video>
Apr 11 15:57:40 user nova-compute[71229]:     <rng model="virtio">
Apr 11 15:57:40 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 15:57:40 user nova-compute[71229]:     </rng>
Apr 11 15:57:40 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 15:57:40 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 15:57:40 user nova-compute[71229]:       <stats period="10"/>
Apr 11 15:57:40 user nova-compute[71229]:     </memballoon>
Apr 11 15:57:40 user nova-compute[71229]:   </devices>
Apr 11 15:57:40 user nova-compute[71229]: </domain>
Apr 11 15:57:40 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 15:57:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:57:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:57:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:57:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:57:40 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:57:40 user nova-compute[71229]: DEBUG nova.objects.instance [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0d6c5972-e53b-47e9-8f13-7df1ad86020e {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:57:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:57:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.132s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:57:41 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk. size=1073741824 {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 15:57:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:57:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:57:41 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Cannot resize image /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk to a smaller size. {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 15:57:41 user nova-compute[71229]: DEBUG nova.objects.instance [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lazy-loading 'migration_context' on Instance uuid 0d6c5972-e53b-47e9-8f13-7df1ad86020e {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:57:41 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:53:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-873450080',display_name='tempest-AttachVolumeTestJSON-server-873450080',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-873450080',id=39,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA++uuXe6FyaUH7+6A7LXI9JAeQOW0LGZU8i83jm7ocQcCkrPDDJFgc0QxuJD62Az+edRqtAEJw2zMA+YyRUWi6KTatWRW/2wsFjFL2TMdY96WvhmRoEL5HXtf0K6rtWuw==',key_name='tempest-keypair-1501547376',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:53:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='8fa330c512f045dc8a5946be3563fdcd',ramdisk_id='',reservation_id='r-y1ru7450',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1691938977',owner_user_name='tempest-AttachVolumeTestJSON-1691938977-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:55:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa87f179b35a4d1db2336802e8f104e4',uuid=0d6c5972-e53b-47e9-8f13-7df1ad86020e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "address": "fa:16:3e:ba:60:e0", "network": {"id": "e6f9483b-53f6-4696-b451-52aeb6ec13d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822664747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa330c512f045dc8a5946be3563fdcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd17bd8-24", "ovs_interfaceid": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 15:57:41 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Converting VIF {"id": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "address": "fa:16:3e:ba:60:e0", "network": {"id": "e6f9483b-53f6-4696-b451-52aeb6ec13d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822664747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa330c512f045dc8a5946be3563fdcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd17bd8-24", "ovs_interfaceid": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:57:41 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:60:e0,bridge_name='br-int',has_traffic_filtering=True,id=8fd17bd8-2470-4931-8df3-b1ca41125d39,network=Network(e6f9483b-53f6-4696-b451-52aeb6ec13d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fd17bd8-24') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:57:41 user nova-compute[71229]: DEBUG os_vif [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:60:e0,bridge_name='br-int',has_traffic_filtering=True,id=8fd17bd8-2470-4931-8df3-b1ca41125d39,network=Network(e6f9483b-53f6-4696-b451-52aeb6ec13d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fd17bd8-24') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 15:57:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:57:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:57:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 15:57:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:57:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8fd17bd8-24, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:57:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8fd17bd8-24, col_values=(('external_ids', {'iface-id': '8fd17bd8-2470-4931-8df3-b1ca41125d39', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:60:e0', 'vm-uuid': '0d6c5972-e53b-47e9-8f13-7df1ad86020e'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:57:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:57:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:57:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:57:41 user nova-compute[71229]: INFO os_vif [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:60:e0,bridge_name='br-int',has_traffic_filtering=True,id=8fd17bd8-2470-4931-8df3-b1ca41125d39,network=Network(e6f9483b-53f6-4696-b451-52aeb6ec13d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fd17bd8-24')
Apr 11 15:57:42 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:57:42 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:57:42 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:57:42 user nova-compute[71229]: DEBUG nova.compute.manager [req-fb800723-d1bf-42e4-a338-679c783a502f req-8df606d8-43d7-45eb-afeb-bbfee4cbba80 service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Received event network-vif-plugged-8fd17bd8-2470-4931-8df3-b1ca41125d39 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:57:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-fb800723-d1bf-42e4-a338-679c783a502f req-8df606d8-43d7-45eb-afeb-bbfee4cbba80 service nova] Acquiring lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:57:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-fb800723-d1bf-42e4-a338-679c783a502f req-8df606d8-43d7-45eb-afeb-bbfee4cbba80 service nova] Lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:57:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-fb800723-d1bf-42e4-a338-679c783a502f req-8df606d8-43d7-45eb-afeb-bbfee4cbba80 service nova] Lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:57:42 user nova-compute[71229]: DEBUG nova.compute.manager [req-fb800723-d1bf-42e4-a338-679c783a502f req-8df606d8-43d7-45eb-afeb-bbfee4cbba80 service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] No waiting events found dispatching network-vif-plugged-8fd17bd8-2470-4931-8df3-b1ca41125d39 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:57:42 user nova-compute[71229]: WARNING nova.compute.manager [req-fb800723-d1bf-42e4-a338-679c783a502f req-8df606d8-43d7-45eb-afeb-bbfee4cbba80 service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Received unexpected event network-vif-plugged-8fd17bd8-2470-4931-8df3-b1ca41125d39 for instance with vm_state stopped and task_state powering-on.
Apr 11 15:57:43 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:57:43 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:57:44 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681228664.6150064, 0d6c5972-e53b-47e9-8f13-7df1ad86020e => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:57:44 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] VM Resumed (Lifecycle Event)
Apr 11 15:57:44 user nova-compute[71229]: DEBUG nova.compute.manager [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 15:57:44 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Instance rebooted successfully.
Apr 11 15:57:44 user nova-compute[71229]: DEBUG nova.compute.manager [None req-b78516b3-900f-467b-8fe4-0fccd459189d tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:57:44 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:57:44 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:57:44 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 11 15:57:44 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681228664.6167724, 0d6c5972-e53b-47e9-8f13-7df1ad86020e => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:57:44 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] VM Started (Lifecycle Event)
Apr 11 15:57:44 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:57:44 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:57:44 user nova-compute[71229]: DEBUG nova.compute.manager [req-0a60b560-6947-403a-87fe-0f2496fe7d67 req-ff1cb218-1c0e-423b-a682-f116f4570363 service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Received event network-vif-plugged-8fd17bd8-2470-4931-8df3-b1ca41125d39 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:57:44 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-0a60b560-6947-403a-87fe-0f2496fe7d67 req-ff1cb218-1c0e-423b-a682-f116f4570363 service nova] Acquiring lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:57:44 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-0a60b560-6947-403a-87fe-0f2496fe7d67 req-ff1cb218-1c0e-423b-a682-f116f4570363 service nova] Lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:57:44 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-0a60b560-6947-403a-87fe-0f2496fe7d67 req-ff1cb218-1c0e-423b-a682-f116f4570363 service nova] Lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:57:44 user nova-compute[71229]: DEBUG nova.compute.manager [req-0a60b560-6947-403a-87fe-0f2496fe7d67 req-ff1cb218-1c0e-423b-a682-f116f4570363 service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] No waiting events found dispatching network-vif-plugged-8fd17bd8-2470-4931-8df3-b1ca41125d39 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:57:44 user nova-compute[71229]: WARNING nova.compute.manager [req-0a60b560-6947-403a-87fe-0f2496fe7d67 req-ff1cb218-1c0e-423b-a682-f116f4570363 service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Received unexpected event network-vif-plugged-8fd17bd8-2470-4931-8df3-b1ca41125d39 for instance with vm_state active and task_state None.
Apr 11 15:57:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:57:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:57:51 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:57:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:57:57 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:57:57 user nova-compute[71229]: DEBUG nova.compute.manager [req-c5a0bc54-d307-4a8d-a13f-16a56962a1ff req-6b3bb145-b095-4aec-9bad-cc68824f07f7 service nova] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Received event network-changed-77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:57:57 user nova-compute[71229]: DEBUG nova.compute.manager [req-c5a0bc54-d307-4a8d-a13f-16a56962a1ff req-6b3bb145-b095-4aec-9bad-cc68824f07f7 service nova] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Refreshing instance network info cache due to event network-changed-77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 15:57:57 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c5a0bc54-d307-4a8d-a13f-16a56962a1ff req-6b3bb145-b095-4aec-9bad-cc68824f07f7 service nova] Acquiring lock "refresh_cache-56fbe043-133f-4e43-b9db-8ed02a3ed2af" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:57:57 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c5a0bc54-d307-4a8d-a13f-16a56962a1ff req-6b3bb145-b095-4aec-9bad-cc68824f07f7 service nova] Acquired lock "refresh_cache-56fbe043-133f-4e43-b9db-8ed02a3ed2af" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:57:57 user nova-compute[71229]: DEBUG nova.network.neutron [req-c5a0bc54-d307-4a8d-a13f-16a56962a1ff req-6b3bb145-b095-4aec-9bad-cc68824f07f7 service nova] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Refreshing network info cache for port 77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 15:57:57 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "56fbe043-133f-4e43-b9db-8ed02a3ed2af" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:57:57 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "56fbe043-133f-4e43-b9db-8ed02a3ed2af" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:57:57 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "56fbe043-133f-4e43-b9db-8ed02a3ed2af-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:57:57 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "56fbe043-133f-4e43-b9db-8ed02a3ed2af-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:57:57 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "56fbe043-133f-4e43-b9db-8ed02a3ed2af-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:57:57 user nova-compute[71229]: INFO nova.compute.manager [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Terminating instance
Apr 11 15:57:57 user nova-compute[71229]: DEBUG nova.compute.manager [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Start destroying the instance on the hypervisor. {{(pid=71229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 15:57:57 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:57:57 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:57:57 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG nova.compute.manager [req-e420b368-9957-40fb-854c-e7d7d6591638 req-0f3e8f54-a551-4ade-bcda-e3290594eb82 service nova] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Received event network-vif-unplugged-77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e420b368-9957-40fb-854c-e7d7d6591638 req-0f3e8f54-a551-4ade-bcda-e3290594eb82 service nova] Acquiring lock "56fbe043-133f-4e43-b9db-8ed02a3ed2af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e420b368-9957-40fb-854c-e7d7d6591638 req-0f3e8f54-a551-4ade-bcda-e3290594eb82 service nova] Lock "56fbe043-133f-4e43-b9db-8ed02a3ed2af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e420b368-9957-40fb-854c-e7d7d6591638 req-0f3e8f54-a551-4ade-bcda-e3290594eb82 service nova] Lock "56fbe043-133f-4e43-b9db-8ed02a3ed2af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG nova.compute.manager [req-e420b368-9957-40fb-854c-e7d7d6591638 req-0f3e8f54-a551-4ade-bcda-e3290594eb82 service nova] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] No waiting events found dispatching network-vif-unplugged-77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG nova.compute.manager [req-e420b368-9957-40fb-854c-e7d7d6591638 req-0f3e8f54-a551-4ade-bcda-e3290594eb82 service nova] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Received event network-vif-unplugged-77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 15:57:58 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Instance destroyed successfully.
Apr 11 15:57:58 user nova-compute[71229]: DEBUG nova.objects.instance [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lazy-loading 'resources' on Instance uuid 56fbe043-133f-4e43-b9db-8ed02a3ed2af {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-168309070',display_name='tempest-TestVolumeBootPattern-server-168309070',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-168309070',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHFmBexXT+1iiEvWvrTBCCfLTFSZaBECTRUjU2HFOZ99DTdS224XqNm6W0NLu+fhNbtUG4d3cptal0K2Oy5ZbjfRTK7G/g++ylfyvf1YI+eSa1yX5tyMrdSO5dom9On9A==',key_name='tempest-TestVolumeBootPattern-1289860889',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:53:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='312851c65ba1434691eca0cd2a8cd6d2',ramdisk_id='',reservation_id='r-a246itbz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1933582504',owner_user_name='tempest-TestVolumeBootPattern-1933582504-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:53:27Z,user_data=None,user_id='c2110b74f38642afa560e1c9790d3f81',uuid=56fbe043-133f-4e43-b9db-8ed02a3ed2af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b", "address": "fa:16:3e:82:55:d8", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f40fdc-0c", "ovs_interfaceid": "77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Converting VIF {"id": "77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b", "address": "fa:16:3e:82:55:d8", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f40fdc-0c", "ovs_interfaceid": "77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:82:55:d8,bridge_name='br-int',has_traffic_filtering=True,id=77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b,network=Network(8d262ba8-b9c3-44ed-8431-6c295eb9ea24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77f40fdc-0c') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG os_vif [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:55:d8,bridge_name='br-int',has_traffic_filtering=True,id=77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b,network=Network(8d262ba8-b9c3-44ed-8431-6c295eb9ea24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77f40fdc-0c') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap77f40fdc-0c, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:57:58 user nova-compute[71229]: INFO os_vif [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:55:d8,bridge_name='br-int',has_traffic_filtering=True,id=77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b,network=Network(8d262ba8-b9c3-44ed-8431-6c295eb9ea24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77f40fdc-0c')
Apr 11 15:57:58 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bYXCcZln', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:57:58 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:57:58 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c272ac-22ea-4384-a47a-684300ec4e71]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 15:57:58 user nova-compute[71229]: No targets found.
Apr 11 15:57:58 user nova-compute[71229]: iSNS:
Apr 11 15:57:58 user nova-compute[71229]: No targets found.
Apr 11 15:57:58 user nova-compute[71229]: STATIC:
Apr 11 15:57:58 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0
Apr 11 15:57:58 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:57:58 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:57:58 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915
Apr 11 15:57:58 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:57:58 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:57:58 user nova-compute[71229]: FIRMWARE:
Apr 11 15:57:58 user nova-compute[71229]: No targets found.
Apr 11 15:57:58 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 15:57:58 user nova-compute[71229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 15:57:58 user nova-compute[71229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71229) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0', 0)] {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[db91c662-ee18-4fab-b152-45c9a046247b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[119e3e50-a2c3-46a6-9b67-917dab11150c]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 (non-flash)
Apr 11 15:57:58 user nova-compute[71229]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 (non-flash)
Apr 11 15:57:58 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 (non-flash)
Apr 11 15:57:58 user nova-compute[71229]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 (non-flash)
Apr 11 15:57:58 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb4c1ac430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0'): ({'sdb'}, set())}) {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Removing single pathed devices sdb {{(pid=71229) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9dc027-404c-4a6c-8674-dfe0a216cd8e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e813c1-1e0b-4ec6-8aed-f3c6dbc0d6c4]: (4, ('ok\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Flushing IO for device /dev/sdb {{(pid=71229) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be1a573-dc99-4648-aa2d-9da904be69c1]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71229) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.027s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ead4d2-a1e8-49a8-b415-84851e06c739]: (4, ('1', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] SCSI volumes sdb have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO699ce9d1-ca6a91f6e1c44141', '/dev/disk/by-id/scsi-26361366139316636', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_699ce9d1') {{(pid=81310) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86de985-45d6-406f-aecd-afc3cd3607b9]: (4, None) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0')] {{(pid=71229) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c93485-438d-4a76-a20c-ab5953c4d689]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 -p 172.16.0.220:3260 --logout {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG nova.network.neutron [req-c5a0bc54-d307-4a8d-a13f-16a56962a1ff req-6b3bb145-b095-4aec-9bad-cc68824f07f7 service nova] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Updated VIF entry in instance network info cache for port 77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG nova.network.neutron [req-c5a0bc54-d307-4a8d-a13f-16a56962a1ff req-6b3bb145-b095-4aec-9bad-cc68824f07f7 service nova] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Updating instance_info_cache with network_info: [{"id": "77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b", "address": "fa:16:3e:82:55:d8", "network": {"id": "8d262ba8-b9c3-44ed-8431-6c295eb9ea24", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2103317429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312851c65ba1434691eca0cd2a8cd6d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f40fdc-0c", "ovs_interfaceid": "77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c5a0bc54-d307-4a8d-a13f-16a56962a1ff req-6b3bb145-b095-4aec-9bad-cc68824f07f7 service nova] Releasing lock "refresh_cache-56fbe043-133f-4e43-b9db-8ed02a3ed2af" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e24f448-d24e-48b0-ac88-a1f66bf98ba1]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0, portal: 172.16.0.220,3260]
Apr 11 15:57:58 user nova-compute[71229]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0, portal: 172.16.0.220,3260] successful.
Apr 11 15:57:58 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 -p 172.16.0.220:3260 --op delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e80be1f-47e3-4658-bdfe-610ca8e958a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d307d9b-f03d-4cea-8af0-1057186fcba3]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] <== disconnect_volume: return (298ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:57:58 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 15:57:58 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Deleting instance files /opt/stack/data/nova/instances/56fbe043-133f-4e43-b9db-8ed02a3ed2af_del
Apr 11 15:57:58 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Deletion of /opt/stack/data/nova/instances/56fbe043-133f-4e43-b9db-8ed02a3ed2af_del complete
Apr 11 15:57:59 user nova-compute[71229]: INFO nova.compute.manager [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Took 1.17 seconds to destroy the instance on the hypervisor.
Apr 11 15:57:59 user nova-compute[71229]: DEBUG oslo.service.loopingcall [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71229) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 15:57:59 user nova-compute[71229]: DEBUG nova.compute.manager [-] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Deallocating network for instance {{(pid=71229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 15:57:59 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] deallocate_for_instance() {{(pid=71229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 15:57:59 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:57:59 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Took 0.52 seconds to deallocate network for instance.
Apr 11 15:58:00 user nova-compute[71229]: INFO nova.compute.manager [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Took 0.76 seconds to detach 1 volumes for instance.
Apr 11 15:58:00 user nova-compute[71229]: DEBUG nova.compute.manager [req-d8c23a53-dfbe-4237-823d-cf234b5f9c83 req-c551ab54-5fc2-4647-b471-170ca559eaa7 service nova] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Received event network-vif-plugged-77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:58:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-d8c23a53-dfbe-4237-823d-cf234b5f9c83 req-c551ab54-5fc2-4647-b471-170ca559eaa7 service nova] Acquiring lock "56fbe043-133f-4e43-b9db-8ed02a3ed2af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:58:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-d8c23a53-dfbe-4237-823d-cf234b5f9c83 req-c551ab54-5fc2-4647-b471-170ca559eaa7 service nova] Lock "56fbe043-133f-4e43-b9db-8ed02a3ed2af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:58:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-d8c23a53-dfbe-4237-823d-cf234b5f9c83 req-c551ab54-5fc2-4647-b471-170ca559eaa7 service nova] Lock "56fbe043-133f-4e43-b9db-8ed02a3ed2af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:58:00 user nova-compute[71229]: DEBUG nova.compute.manager [req-d8c23a53-dfbe-4237-823d-cf234b5f9c83 req-c551ab54-5fc2-4647-b471-170ca559eaa7 service nova] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] No waiting events found dispatching network-vif-plugged-77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:58:00 user nova-compute[71229]: WARNING nova.compute.manager [req-d8c23a53-dfbe-4237-823d-cf234b5f9c83 req-c551ab54-5fc2-4647-b471-170ca559eaa7 service nova] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Received unexpected event network-vif-plugged-77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b for instance with vm_state active and task_state deleting.
Apr 11 15:58:00 user nova-compute[71229]: DEBUG nova.compute.manager [req-d8c23a53-dfbe-4237-823d-cf234b5f9c83 req-c551ab54-5fc2-4647-b471-170ca559eaa7 service nova] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Received event network-vif-deleted-77f40fdc-0c5e-4393-a5cd-e1ea0cc8192b {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:58:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:58:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:58:00 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:58:00 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:58:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.128s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:58:00 user nova-compute[71229]: INFO nova.scheduler.client.report [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Deleted allocations for instance 56fbe043-133f-4e43-b9db-8ed02a3ed2af
Apr 11 15:58:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-12031e9a-5f2b-48cd-9840-6bcefbb83c52 tempest-TestVolumeBootPattern-1933582504 tempest-TestVolumeBootPattern-1933582504-project-member] Lock "56fbe043-133f-4e43-b9db-8ed02a3ed2af" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.762s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:58:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:58:03 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:58:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:58:08 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:58:12 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:58:13 user nova-compute[71229]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681228678.6118762, 56fbe043-133f-4e43-b9db-8ed02a3ed2af => Stopped> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:58:13 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] VM Stopped (Lifecycle Event)
Apr 11 15:58:13 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:58:13 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a79a45f1-7edf-43b6-bb2b-cd930ef1cdae None None] [instance: 56fbe043-133f-4e43-b9db-8ed02a3ed2af] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:58:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:58:18 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:58:18 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 15:58:22 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:58:22 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 15:58:22 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Didn't find any instances for network info cache update. {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 15:58:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:58:23 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:58:26 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:58:27 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:58:27 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:58:27 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:58:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:58:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:58:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:58:27 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 15:58:27 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:58:27 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:58:27 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:58:28 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:58:28 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 15:58:28 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:58:28 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:58:28 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8782MB free_disk=25.999588012695312GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 15:58:28 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:58:28 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:58:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:58:28 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:58:28 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 15:58:28 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 15:58:28 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Refreshing inventories for resource provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 15:58:28 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Updating ProviderTree inventory for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 15:58:28 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Updating inventory in ProviderTree for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 15:58:28 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Refreshing aggregate associations for resource provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de, aggregates: None {{(pid=71229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 15:58:28 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Refreshing trait associations for resource provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de, traits: COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=71229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 15:58:28 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:58:28 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:58:28 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 15:58:28 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.480s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:58:29 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:58:29 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:58:29 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:58:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:58:33 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:58:33 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Triggering sync for uuid 0d6c5972-e53b-47e9-8f13-7df1ad86020e {{(pid=71229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 15:58:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:58:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:58:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:58:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:58:43 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:58:48 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:58:48 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:58:53 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:58:53 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:58:55 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:58:58 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:59:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:59:03 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:59:08 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:59:13 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:59:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:59:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:59:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 15:59:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 15:59:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:59:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 15:59:18 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:59:18 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 15:59:22 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:59:22 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 15:59:22 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Rebuilding the list of instances to heal {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 15:59:22 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "refresh_cache-0d6c5972-e53b-47e9-8f13-7df1ad86020e" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 15:59:22 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquired lock "refresh_cache-0d6c5972-e53b-47e9-8f13-7df1ad86020e" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 15:59:22 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Forcefully refreshing network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 15:59:22 user nova-compute[71229]: DEBUG nova.objects.instance [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lazy-loading 'info_cache' on Instance uuid 0d6c5972-e53b-47e9-8f13-7df1ad86020e {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:59:23 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Updating instance_info_cache with network_info: [{"id": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "address": "fa:16:3e:ba:60:e0", "network": {"id": "e6f9483b-53f6-4696-b451-52aeb6ec13d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822664747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa330c512f045dc8a5946be3563fdcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd17bd8-24", "ovs_interfaceid": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 15:59:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Releasing lock "refresh_cache-0d6c5972-e53b-47e9-8f13-7df1ad86020e" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 15:59:23 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Updated the network info_cache for instance {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 15:59:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:59:23 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:59:27 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:59:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:59:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:59:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 15:59:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 15:59:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 15:59:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:59:28 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:59:29 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4aef266a-2e72-4ca6-b801-f16245002098 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:59:29 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4aef266a-2e72-4ca6-b801-f16245002098 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:59:29 user nova-compute[71229]: INFO nova.compute.manager [None req-4aef266a-2e72-4ca6-b801-f16245002098 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Detaching volume 0b6dc374-b525-44a2-8e35-d4a723ae5915
Apr 11 15:59:29 user nova-compute[71229]: INFO nova.virt.block_device [None req-4aef266a-2e72-4ca6-b801-f16245002098 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Attempting to driver detach volume 0b6dc374-b525-44a2-8e35-d4a723ae5915 from mountpoint /dev/vdb
Apr 11 15:59:29 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-4aef266a-2e72-4ca6-b801-f16245002098 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Attempting to detach device vdb from instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e from the persistent domain config. {{(pid=71229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 15:59:29 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-4aef266a-2e72-4ca6-b801-f16245002098 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 15:59:29 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:59:29 user nova-compute[71229]:   <source dev="/dev/sdc"/>
Apr 11 15:59:29 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 15:59:29 user nova-compute[71229]:   <serial>0b6dc374-b525-44a2-8e35-d4a723ae5915</serial>
Apr 11 15:59:29 user nova-compute[71229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 15:59:29 user nova-compute[71229]: </disk>
Apr 11 15:59:29 user nova-compute[71229]:  {{(pid=71229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 15:59:29 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-4aef266a-2e72-4ca6-b801-f16245002098 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Successfully detached device vdb from instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e from the persistent domain config.
Apr 11 15:59:29 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-4aef266a-2e72-4ca6-b801-f16245002098 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e from the live domain config. {{(pid=71229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 15:59:29 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-4aef266a-2e72-4ca6-b801-f16245002098 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 15:59:29 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 15:59:29 user nova-compute[71229]:   <source dev="/dev/sdc"/>
Apr 11 15:59:29 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 15:59:29 user nova-compute[71229]:   <serial>0b6dc374-b525-44a2-8e35-d4a723ae5915</serial>
Apr 11 15:59:29 user nova-compute[71229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 15:59:29 user nova-compute[71229]: </disk>
Apr 11 15:59:29 user nova-compute[71229]:  {{(pid=71229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 15:59:29 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:59:29 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:59:29 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:59:29 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:59:29 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:59:29 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:59:29 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 15:59:29 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Received event <DeviceRemovedEvent: 1681228769.9910712, 0d6c5972-e53b-47e9-8f13-7df1ad86020e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71229) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 15:59:29 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-4aef266a-2e72-4ca6-b801-f16245002098 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e {{(pid=71229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 15:59:29 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-4aef266a-2e72-4ca6-b801-f16245002098 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Successfully detached device vdb from instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e from the live domain config.
Apr 11 15:59:30 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4aef266a-2e72-4ca6-b801-f16245002098 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aef266a-2e72-4ca6-b801-f16245002098 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hYDREkBL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 15:59:30 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-4aef266a-2e72-4ca6-b801-f16245002098 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 15:59:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-4aef266a-2e72-4ca6-b801-f16245002098 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-4aef266a-2e72-4ca6-b801-f16245002098 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1569c6fb-1056-4cc5-beb0-567408b1d516]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aef266a-2e72-4ca6-b801-f16245002098 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 15:59:30 user nova-compute[71229]: No targets found.
Apr 11 15:59:30 user nova-compute[71229]: iSNS:
Apr 11 15:59:30 user nova-compute[71229]: No targets found.
Apr 11 15:59:30 user nova-compute[71229]: STATIC:
Apr 11 15:59:30 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915
Apr 11 15:59:30 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 15:59:30 user nova-compute[71229]:                 Iface Name: default
Apr 11 15:59:30 user nova-compute[71229]: FIRMWARE:
Apr 11 15:59:30 user nova-compute[71229]: No targets found.
Apr 11 15:59:30 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aef266a-2e72-4ca6-b801-f16245002098 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 15:59:30 user nova-compute[71229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 15:59:30 user nova-compute[71229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71229) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aef266a-2e72-4ca6-b801-f16245002098 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915', 0)] {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e045e216-4220-4e60-b1c6-881a882a5860]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56f15d6-c6b2-491d-9e9a-cbd331982b35]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aef266a-2e72-4ca6-b801-f16245002098 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 (non-flash)
Apr 11 15:59:30 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aef266a-2e72-4ca6-b801-f16245002098 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 (non-flash)
Apr 11 15:59:30 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aef266a-2e72-4ca6-b801-f16245002098 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb286b9990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915'): ({'sdc'}, set())}) {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-4aef266a-2e72-4ca6-b801-f16245002098 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Removing single pathed devices sdc {{(pid=71229) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4658cce1-c918-49e4-99d5-72e62ead4f8b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0fa1060-0894-498c-a3af-1f8450891dc4]: (4, ('ok\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-4aef266a-2e72-4ca6-b801-f16245002098 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Flushing IO for device /dev/sdc {{(pid=71229) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[498aa412-4a31-4746-bd1c-d9d55a4bd9e7]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-4aef266a-2e72-4ca6-b801-f16245002098 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71229) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96398d8-777e-4696-81b0-3f10167c0a64]: (4, ('1', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-4aef266a-2e72-4ca6-b801-f16245002098 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-4aef266a-2e72-4ca6-b801-f16245002098 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] SCSI volumes sdc have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aef266a-2e72-4ca6-b801-f16245002098 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915')] {{(pid=71229) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e108f1a-9eed-4ff2-9051-09cffa84a843]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aef266a-2e72-4ca6-b801-f16245002098 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 -p 172.16.0.220:3260 --logout {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 -p 172.16.0.220:3260 --logout" returned: 0 in 0.098s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[466316cc-b8fe-4624-b81b-42c581f5bcb0]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aef266a-2e72-4ca6-b801-f16245002098 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915, portal: 172.16.0.220,3260]
Apr 11 15:59:30 user nova-compute[71229]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915, portal: 172.16.0.220,3260] successful.
Apr 11 15:59:30 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 -p 172.16.0.220:3260 --op delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6dc374-b525-44a2-8e35-d4a723ae5915 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[918dcb70-b684-477d-85d7-ac8c1714d44a]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aef266a-2e72-4ca6-b801-f16245002098 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-4aef266a-2e72-4ca6-b801-f16245002098 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aef266a-2e72-4ca6-b801-f16245002098 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] <== disconnect_volume: return (394ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4aef266a-2e72-4ca6-b801-f16245002098 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 15:59:30 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:59:30 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 15:59:30 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8857MB free_disk=25.997840881347656GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 15:59:30 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.150s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:59:31 user nova-compute[71229]: DEBUG nova.objects.instance [None req-4aef266a-2e72-4ca6-b801-f16245002098 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lazy-loading 'flavor' on Instance uuid 0d6c5972-e53b-47e9-8f13-7df1ad86020e {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:59:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4aef266a-2e72-4ca6-b801-f16245002098 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.761s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:59:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-18bb0ae5-261a-4d34-8967-e64b9b0a0c0e tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:59:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-18bb0ae5-261a-4d34-8967-e64b9b0a0c0e tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:59:31 user nova-compute[71229]: DEBUG nova.compute.manager [None req-18bb0ae5-261a-4d34-8967-e64b9b0a0c0e tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:59:31 user nova-compute[71229]: DEBUG nova.compute.manager [None req-18bb0ae5-261a-4d34-8967-e64b9b0a0c0e tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71229) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 11 15:59:31 user nova-compute[71229]: DEBUG nova.objects.instance [None req-18bb0ae5-261a-4d34-8967-e64b9b0a0c0e tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lazy-loading 'flavor' on Instance uuid 0d6c5972-e53b-47e9-8f13-7df1ad86020e {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 15:59:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:59:31 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:59:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:59:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:59:32 user nova-compute[71229]: DEBUG nova.compute.manager [req-7c394efa-f29f-4ddc-83c9-c5db7dcb9ca8 req-b39ebdfe-17d3-4b7d-91e2-eb4763c5c705 service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Received event network-vif-unplugged-8fd17bd8-2470-4931-8df3-b1ca41125d39 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:59:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-7c394efa-f29f-4ddc-83c9-c5db7dcb9ca8 req-b39ebdfe-17d3-4b7d-91e2-eb4763c5c705 service nova] Acquiring lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:59:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-7c394efa-f29f-4ddc-83c9-c5db7dcb9ca8 req-b39ebdfe-17d3-4b7d-91e2-eb4763c5c705 service nova] Lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:59:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-7c394efa-f29f-4ddc-83c9-c5db7dcb9ca8 req-b39ebdfe-17d3-4b7d-91e2-eb4763c5c705 service nova] Lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:59:32 user nova-compute[71229]: DEBUG nova.compute.manager [req-7c394efa-f29f-4ddc-83c9-c5db7dcb9ca8 req-b39ebdfe-17d3-4b7d-91e2-eb4763c5c705 service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] No waiting events found dispatching network-vif-unplugged-8fd17bd8-2470-4931-8df3-b1ca41125d39 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:59:32 user nova-compute[71229]: WARNING nova.compute.manager [req-7c394efa-f29f-4ddc-83c9-c5db7dcb9ca8 req-b39ebdfe-17d3-4b7d-91e2-eb4763c5c705 service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Received unexpected event network-vif-unplugged-8fd17bd8-2470-4931-8df3-b1ca41125d39 for instance with vm_state active and task_state powering-off.
Apr 11 15:59:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:59:32 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Instance destroyed successfully.
Apr 11 15:59:32 user nova-compute[71229]: DEBUG nova.compute.manager [None req-18bb0ae5-261a-4d34-8967-e64b9b0a0c0e tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:59:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-18bb0ae5-261a-4d34-8967-e64b9b0a0c0e tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.832s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:59:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:59:34 user nova-compute[71229]: DEBUG nova.compute.manager [req-26de82d3-d5bf-4bdb-9dab-e3788edd322b req-213116f9-af9c-4348-bc03-cc30b9404c62 service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Received event network-vif-plugged-8fd17bd8-2470-4931-8df3-b1ca41125d39 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 15:59:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-26de82d3-d5bf-4bdb-9dab-e3788edd322b req-213116f9-af9c-4348-bc03-cc30b9404c62 service nova] Acquiring lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 15:59:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-26de82d3-d5bf-4bdb-9dab-e3788edd322b req-213116f9-af9c-4348-bc03-cc30b9404c62 service nova] Lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 15:59:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-26de82d3-d5bf-4bdb-9dab-e3788edd322b req-213116f9-af9c-4348-bc03-cc30b9404c62 service nova] Lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 15:59:34 user nova-compute[71229]: DEBUG nova.compute.manager [req-26de82d3-d5bf-4bdb-9dab-e3788edd322b req-213116f9-af9c-4348-bc03-cc30b9404c62 service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] No waiting events found dispatching network-vif-plugged-8fd17bd8-2470-4931-8df3-b1ca41125d39 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 15:59:34 user nova-compute[71229]: WARNING nova.compute.manager [req-26de82d3-d5bf-4bdb-9dab-e3788edd322b req-213116f9-af9c-4348-bc03-cc30b9404c62 service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Received unexpected event network-vif-plugged-8fd17bd8-2470-4931-8df3-b1ca41125d39 for instance with vm_state stopped and task_state None.
Apr 11 15:59:38 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 15:59:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:59:43 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:59:43 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:59:43 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 15:59:43 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 15:59:43 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 15:59:43 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:59:47 user nova-compute[71229]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681228772.5683978, 0d6c5972-e53b-47e9-8f13-7df1ad86020e => Stopped> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 15:59:47 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] VM Stopped (Lifecycle Event)
Apr 11 15:59:47 user nova-compute[71229]: DEBUG nova.compute.manager [None req-4aa8ced5-e94c-41b1-9f00-701fb37dc115 None None] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 15:59:47 user nova-compute[71229]: DEBUG nova.compute.manager [None req-4aa8ced5-e94c-41b1-9f00-701fb37dc115 None None] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 15:59:48 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 15:59:53 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 15:59:58 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:00:03 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:00:08 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:00:13 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:00:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:00:19 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:00:19 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 16:00:23 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:00:23 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 16:00:23 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Rebuilding the list of instances to heal {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 16:00:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:00:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "refresh_cache-0d6c5972-e53b-47e9-8f13-7df1ad86020e" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 16:00:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquired lock "refresh_cache-0d6c5972-e53b-47e9-8f13-7df1ad86020e" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 16:00:23 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Forcefully refreshing network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 16:00:23 user nova-compute[71229]: DEBUG nova.objects.instance [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lazy-loading 'info_cache' on Instance uuid 0d6c5972-e53b-47e9-8f13-7df1ad86020e {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:00:24 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Updating instance_info_cache with network_info: [{"id": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "address": "fa:16:3e:ba:60:e0", "network": {"id": "e6f9483b-53f6-4696-b451-52aeb6ec13d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822664747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa330c512f045dc8a5946be3563fdcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd17bd8-24", "ovs_interfaceid": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 16:00:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Releasing lock "refresh_cache-0d6c5972-e53b-47e9-8f13-7df1ad86020e" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 16:00:24 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Updated the network info_cache for instance {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 16:00:24 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:00:27 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:00:28 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:00:29 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:00:29 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:00:30 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:00:31 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:00:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:00:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:00:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:00:31 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 16:00:31 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:00:31 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:00:31 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:00:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:00:32 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:00:32 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:00:32 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8967MB free_disk=25.997127532958984GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 16:00:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:00:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:00:32 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 16:00:32 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 16:00:32 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 16:00:32 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 16:00:32 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 16:00:32 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 16:00:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.208s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:00:33 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:00:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:00:38 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:00:43 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:00:48 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:00:53 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:00:58 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:01:03 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:01:08 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:01:13 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:01:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:01:19 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:01:19 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 16:01:22 user nova-compute[71229]: DEBUG nova.objects.instance [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lazy-loading 'flavor' on Instance uuid 0d6c5972-e53b-47e9-8f13-7df1ad86020e {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:01:22 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "refresh_cache-0d6c5972-e53b-47e9-8f13-7df1ad86020e" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 16:01:22 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquired lock "refresh_cache-0d6c5972-e53b-47e9-8f13-7df1ad86020e" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 16:01:22 user nova-compute[71229]: DEBUG nova.network.neutron [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 16:01:22 user nova-compute[71229]: DEBUG nova.objects.instance [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lazy-loading 'info_cache' on Instance uuid 0d6c5972-e53b-47e9-8f13-7df1ad86020e {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:01:23 user nova-compute[71229]: DEBUG nova.network.neutron [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Updating instance_info_cache with network_info: [{"id": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "address": "fa:16:3e:ba:60:e0", "network": {"id": "e6f9483b-53f6-4696-b451-52aeb6ec13d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822664747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa330c512f045dc8a5946be3563fdcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd17bd8-24", "ovs_interfaceid": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 16:01:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Releasing lock "refresh_cache-0d6c5972-e53b-47e9-8f13-7df1ad86020e" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 16:01:23 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Instance destroyed successfully.
Apr 11 16:01:23 user nova-compute[71229]: DEBUG nova.objects.instance [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lazy-loading 'resources' on Instance uuid 0d6c5972-e53b-47e9-8f13-7df1ad86020e {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:01:23 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:53:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-873450080',display_name='tempest-AttachVolumeTestJSON-server-873450080',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-873450080',id=39,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA++uuXe6FyaUH7+6A7LXI9JAeQOW0LGZU8i83jm7ocQcCkrPDDJFgc0QxuJD62Az+edRqtAEJw2zMA+YyRUWi6KTatWRW/2wsFjFL2TMdY96WvhmRoEL5HXtf0K6rtWuw==',key_name='tempest-keypair-1501547376',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:53:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8fa330c512f045dc8a5946be3563fdcd',ramdisk_id='',reservation_id='r-y1ru7450',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1691938977',owner_user_name='tempest-AttachVolumeTestJSON-1691938977-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:59:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa87f179b35a4d1db2336802e8f104e4',uuid=0d6c5972-e53b-47e9-8f13-7df1ad86020e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "address": "fa:16:3e:ba:60:e0", "network": {"id": "e6f9483b-53f6-4696-b451-52aeb6ec13d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822664747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa330c512f045dc8a5946be3563fdcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd17bd8-24", "ovs_interfaceid": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 16:01:23 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Converting VIF {"id": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "address": "fa:16:3e:ba:60:e0", "network": {"id": "e6f9483b-53f6-4696-b451-52aeb6ec13d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822664747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa330c512f045dc8a5946be3563fdcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd17bd8-24", "ovs_interfaceid": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 16:01:23 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:60:e0,bridge_name='br-int',has_traffic_filtering=True,id=8fd17bd8-2470-4931-8df3-b1ca41125d39,network=Network(e6f9483b-53f6-4696-b451-52aeb6ec13d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fd17bd8-24') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 16:01:23 user nova-compute[71229]: DEBUG os_vif [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:60:e0,bridge_name='br-int',has_traffic_filtering=True,id=8fd17bd8-2470-4931-8df3-b1ca41125d39,network=Network(e6f9483b-53f6-4696-b451-52aeb6ec13d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fd17bd8-24') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 16:01:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:01:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8fd17bd8-24, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 16:01:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:01:23 user nova-compute[71229]: INFO os_vif [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:60:e0,bridge_name='br-int',has_traffic_filtering=True,id=8fd17bd8-2470-4931-8df3-b1ca41125d39,network=Network(e6f9483b-53f6-4696-b451-52aeb6ec13d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fd17bd8-24')
Apr 11 16:01:23 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Start _get_guest_xml network_info=[{"id": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "address": "fa:16:3e:ba:60:e0", "network": {"id": "e6f9483b-53f6-4696-b451-52aeb6ec13d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822664747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa330c512f045dc8a5946be3563fdcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd17bd8-24", "ovs_interfaceid": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '52fe638c-5ada-47d5-b376-233bfa808a37'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 16:01:23 user nova-compute[71229]: DEBUG nova.objects.instance [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lazy-loading 'numa_topology' on Instance uuid 0d6c5972-e53b-47e9-8f13-7df1ad86020e {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:01:23 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:01:23 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:01:23 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 16:01:23 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 16:01:23 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 16:01:23 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 16:01:23 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 16:01:23 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 16:01:23 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 16:01:23 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 16:01:23 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 16:01:23 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 16:01:23 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 16:01:23 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 16:01:23 user nova-compute[71229]: DEBUG nova.objects.instance [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0d6c5972-e53b-47e9-8f13-7df1ad86020e {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:01:23 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:53:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-873450080',display_name='tempest-AttachVolumeTestJSON-server-873450080',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-873450080',id=39,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA++uuXe6FyaUH7+6A7LXI9JAeQOW0LGZU8i83jm7ocQcCkrPDDJFgc0QxuJD62Az+edRqtAEJw2zMA+YyRUWi6KTatWRW/2wsFjFL2TMdY96WvhmRoEL5HXtf0K6rtWuw==',key_name='tempest-keypair-1501547376',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:53:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8fa330c512f045dc8a5946be3563fdcd',ramdisk_id='',reservation_id='r-y1ru7450',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1691938977',owner_user_name='tempest-AttachVolumeTestJSON-1691938977-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T15:59:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa87f179b35a4d1db2336802e8f104e4',uuid=0d6c5972-e53b-47e9-8f13-7df1ad86020e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "address": "fa:16:3e:ba:60:e0", "network": {"id": "e6f9483b-53f6-4696-b451-52aeb6ec13d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822664747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa330c512f045dc8a5946be3563fdcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd17bd8-24", "ovs_interfaceid": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 16:01:23 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Converting VIF {"id": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "address": "fa:16:3e:ba:60:e0", "network": {"id": "e6f9483b-53f6-4696-b451-52aeb6ec13d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822664747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa330c512f045dc8a5946be3563fdcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd17bd8-24", "ovs_interfaceid": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 16:01:23 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:60:e0,bridge_name='br-int',has_traffic_filtering=True,id=8fd17bd8-2470-4931-8df3-b1ca41125d39,network=Network(e6f9483b-53f6-4696-b451-52aeb6ec13d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fd17bd8-24') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 16:01:23 user nova-compute[71229]: DEBUG nova.objects.instance [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d6c5972-e53b-47e9-8f13-7df1ad86020e {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:01:23 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] End _get_guest_xml xml=<domain type="kvm">
Apr 11 16:01:23 user nova-compute[71229]:   <uuid>0d6c5972-e53b-47e9-8f13-7df1ad86020e</uuid>
Apr 11 16:01:23 user nova-compute[71229]:   <name>instance-00000027</name>
Apr 11 16:01:23 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 16:01:23 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 16:01:23 user nova-compute[71229]:   <metadata>
Apr 11 16:01:23 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 16:01:23 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 16:01:23 user nova-compute[71229]:       <nova:name>tempest-AttachVolumeTestJSON-server-873450080</nova:name>
Apr 11 16:01:23 user nova-compute[71229]:       <nova:creationTime>2023-04-11 16:01:23</nova:creationTime>
Apr 11 16:01:23 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 16:01:23 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 16:01:23 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 16:01:23 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 16:01:23 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 16:01:23 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 16:01:23 user nova-compute[71229]:       </nova:flavor>
Apr 11 16:01:23 user nova-compute[71229]:       <nova:owner>
Apr 11 16:01:23 user nova-compute[71229]:         <nova:user uuid="aa87f179b35a4d1db2336802e8f104e4">tempest-AttachVolumeTestJSON-1691938977-project-member</nova:user>
Apr 11 16:01:23 user nova-compute[71229]:         <nova:project uuid="8fa330c512f045dc8a5946be3563fdcd">tempest-AttachVolumeTestJSON-1691938977</nova:project>
Apr 11 16:01:23 user nova-compute[71229]:       </nova:owner>
Apr 11 16:01:23 user nova-compute[71229]:       <nova:root type="image" uuid="52fe638c-5ada-47d5-b376-233bfa808a37"/>
Apr 11 16:01:23 user nova-compute[71229]:       <nova:ports>
Apr 11 16:01:23 user nova-compute[71229]:         <nova:port uuid="8fd17bd8-2470-4931-8df3-b1ca41125d39">
Apr 11 16:01:23 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 11 16:01:23 user nova-compute[71229]:         </nova:port>
Apr 11 16:01:23 user nova-compute[71229]:       </nova:ports>
Apr 11 16:01:23 user nova-compute[71229]:     </nova:instance>
Apr 11 16:01:23 user nova-compute[71229]:   </metadata>
Apr 11 16:01:23 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 16:01:23 user nova-compute[71229]:     <system>
Apr 11 16:01:23 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 16:01:23 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 16:01:23 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 16:01:23 user nova-compute[71229]:       <entry name="serial">0d6c5972-e53b-47e9-8f13-7df1ad86020e</entry>
Apr 11 16:01:23 user nova-compute[71229]:       <entry name="uuid">0d6c5972-e53b-47e9-8f13-7df1ad86020e</entry>
Apr 11 16:01:23 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 16:01:23 user nova-compute[71229]:     </system>
Apr 11 16:01:23 user nova-compute[71229]:   </sysinfo>
Apr 11 16:01:23 user nova-compute[71229]:   <os>
Apr 11 16:01:23 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 16:01:23 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 16:01:23 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 16:01:23 user nova-compute[71229]:   </os>
Apr 11 16:01:23 user nova-compute[71229]:   <features>
Apr 11 16:01:23 user nova-compute[71229]:     <acpi/>
Apr 11 16:01:23 user nova-compute[71229]:     <apic/>
Apr 11 16:01:23 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 16:01:23 user nova-compute[71229]:   </features>
Apr 11 16:01:23 user nova-compute[71229]:   <clock offset="utc">
Apr 11 16:01:23 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 16:01:23 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 16:01:23 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 16:01:23 user nova-compute[71229]:   </clock>
Apr 11 16:01:23 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 16:01:23 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 16:01:23 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 16:01:23 user nova-compute[71229]:   </cpu>
Apr 11 16:01:23 user nova-compute[71229]:   <devices>
Apr 11 16:01:23 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 16:01:23 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 16:01:23 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk"/>
Apr 11 16:01:23 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 16:01:23 user nova-compute[71229]:     </disk>
Apr 11 16:01:23 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 16:01:23 user nova-compute[71229]:       <mac address="fa:16:3e:ba:60:e0"/>
Apr 11 16:01:23 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 16:01:23 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 16:01:23 user nova-compute[71229]:       <target dev="tap8fd17bd8-24"/>
Apr 11 16:01:23 user nova-compute[71229]:     </interface>
Apr 11 16:01:23 user nova-compute[71229]:     <serial type="pty">
Apr 11 16:01:23 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/console.log" append="off"/>
Apr 11 16:01:23 user nova-compute[71229]:     </serial>
Apr 11 16:01:23 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 16:01:23 user nova-compute[71229]:     <video>
Apr 11 16:01:23 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 16:01:23 user nova-compute[71229]:     </video>
Apr 11 16:01:23 user nova-compute[71229]:     <rng model="virtio">
Apr 11 16:01:23 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 16:01:23 user nova-compute[71229]:     </rng>
Apr 11 16:01:23 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 16:01:23 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 16:01:23 user nova-compute[71229]:       <stats period="10"/>
Apr 11 16:01:23 user nova-compute[71229]:     </memballoon>
Apr 11 16:01:23 user nova-compute[71229]:   </devices>
Apr 11 16:01:23 user nova-compute[71229]: </domain>
Apr 11 16:01:23 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 16:01:23 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:01:23 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:01:23 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:01:23 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:01:23 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 16:01:23 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Rebuilding the list of instances to heal {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 16:01:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "refresh_cache-0d6c5972-e53b-47e9-8f13-7df1ad86020e" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 16:01:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquired lock "refresh_cache-0d6c5972-e53b-47e9-8f13-7df1ad86020e" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 16:01:23 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Forcefully refreshing network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 16:01:23 user nova-compute[71229]: DEBUG nova.objects.instance [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lazy-loading 'info_cache' on Instance uuid 0d6c5972-e53b-47e9-8f13-7df1ad86020e {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:01:23 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:01:23 user nova-compute[71229]: DEBUG nova.objects.instance [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0d6c5972-e53b-47e9-8f13-7df1ad86020e {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:01:23 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:01:23 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.135s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:01:23 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk. size=1073741824 {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 16:01:23 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:01:24 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:01:24 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Cannot resize image /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk to a smaller size. {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 16:01:24 user nova-compute[71229]: DEBUG nova.objects.instance [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lazy-loading 'migration_context' on Instance uuid 0d6c5972-e53b-47e9-8f13-7df1ad86020e {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:01:24 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:53:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-873450080',display_name='tempest-AttachVolumeTestJSON-server-873450080',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-873450080',id=39,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA++uuXe6FyaUH7+6A7LXI9JAeQOW0LGZU8i83jm7ocQcCkrPDDJFgc0QxuJD62Az+edRqtAEJw2zMA+YyRUWi6KTatWRW/2wsFjFL2TMdY96WvhmRoEL5HXtf0K6rtWuw==',key_name='tempest-keypair-1501547376',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:53:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='8fa330c512f045dc8a5946be3563fdcd',ramdisk_id='',reservation_id='r-y1ru7450',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1691938977',owner_user_name='tempest-AttachVolumeTestJSON-1691938977-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T15:59:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa87f179b35a4d1db2336802e8f104e4',uuid=0d6c5972-e53b-47e9-8f13-7df1ad86020e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "address": "fa:16:3e:ba:60:e0", "network": {"id": "e6f9483b-53f6-4696-b451-52aeb6ec13d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822664747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa330c512f045dc8a5946be3563fdcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd17bd8-24", "ovs_interfaceid": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 16:01:24 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Converting VIF {"id": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "address": "fa:16:3e:ba:60:e0", "network": {"id": "e6f9483b-53f6-4696-b451-52aeb6ec13d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822664747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa330c512f045dc8a5946be3563fdcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd17bd8-24", "ovs_interfaceid": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 16:01:24 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:60:e0,bridge_name='br-int',has_traffic_filtering=True,id=8fd17bd8-2470-4931-8df3-b1ca41125d39,network=Network(e6f9483b-53f6-4696-b451-52aeb6ec13d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fd17bd8-24') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 16:01:24 user nova-compute[71229]: DEBUG os_vif [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:60:e0,bridge_name='br-int',has_traffic_filtering=True,id=8fd17bd8-2470-4931-8df3-b1ca41125d39,network=Network(e6f9483b-53f6-4696-b451-52aeb6ec13d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fd17bd8-24') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 16:01:24 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:01:24 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 16:01:24 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 16:01:24 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:01:24 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8fd17bd8-24, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 16:01:24 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8fd17bd8-24, col_values=(('external_ids', {'iface-id': '8fd17bd8-2470-4931-8df3-b1ca41125d39', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:60:e0', 'vm-uuid': '0d6c5972-e53b-47e9-8f13-7df1ad86020e'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 16:01:24 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:01:24 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:01:24 user nova-compute[71229]: INFO os_vif [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:60:e0,bridge_name='br-int',has_traffic_filtering=True,id=8fd17bd8-2470-4931-8df3-b1ca41125d39,network=Network(e6f9483b-53f6-4696-b451-52aeb6ec13d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fd17bd8-24')
Apr 11 16:01:24 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Updating instance_info_cache with network_info: [{"id": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "address": "fa:16:3e:ba:60:e0", "network": {"id": "e6f9483b-53f6-4696-b451-52aeb6ec13d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822664747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa330c512f045dc8a5946be3563fdcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd17bd8-24", "ovs_interfaceid": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 16:01:24 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Releasing lock "refresh_cache-0d6c5972-e53b-47e9-8f13-7df1ad86020e" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 16:01:24 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Updated the network info_cache for instance {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 16:01:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:01:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:01:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:01:25 user nova-compute[71229]: DEBUG nova.compute.manager [req-6a4345ee-1935-4486-a809-e1a01707f552 req-0bdea181-80ba-4b61-bb6c-0b376f14eeeb service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Received event network-vif-plugged-8fd17bd8-2470-4931-8df3-b1ca41125d39 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:01:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-6a4345ee-1935-4486-a809-e1a01707f552 req-0bdea181-80ba-4b61-bb6c-0b376f14eeeb service nova] Acquiring lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:01:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-6a4345ee-1935-4486-a809-e1a01707f552 req-0bdea181-80ba-4b61-bb6c-0b376f14eeeb service nova] Lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:01:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-6a4345ee-1935-4486-a809-e1a01707f552 req-0bdea181-80ba-4b61-bb6c-0b376f14eeeb service nova] Lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:01:25 user nova-compute[71229]: DEBUG nova.compute.manager [req-6a4345ee-1935-4486-a809-e1a01707f552 req-0bdea181-80ba-4b61-bb6c-0b376f14eeeb service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] No waiting events found dispatching network-vif-plugged-8fd17bd8-2470-4931-8df3-b1ca41125d39 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 16:01:25 user nova-compute[71229]: WARNING nova.compute.manager [req-6a4345ee-1935-4486-a809-e1a01707f552 req-0bdea181-80ba-4b61-bb6c-0b376f14eeeb service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Received unexpected event network-vif-plugged-8fd17bd8-2470-4931-8df3-b1ca41125d39 for instance with vm_state stopped and task_state powering-on.
Apr 11 16:01:25 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:01:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:01:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:01:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:01:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:01:27 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681228887.472931, 0d6c5972-e53b-47e9-8f13-7df1ad86020e => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 16:01:27 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] VM Resumed (Lifecycle Event)
Apr 11 16:01:27 user nova-compute[71229]: DEBUG nova.compute.manager [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 16:01:27 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Instance rebooted successfully.
Apr 11 16:01:27 user nova-compute[71229]: DEBUG nova.compute.manager [None req-82e18b87-39ee-40af-ad70-f66eda8b3a96 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 16:01:27 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 16:01:27 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 16:01:27 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 11 16:01:27 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681228887.4748518, 0d6c5972-e53b-47e9-8f13-7df1ad86020e => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 16:01:27 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] VM Started (Lifecycle Event)
Apr 11 16:01:27 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 16:01:27 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 16:01:27 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:01:27 user nova-compute[71229]: DEBUG nova.compute.manager [req-5cde92a1-f990-4493-bb48-58a94d917a45 req-92a00d74-c6c4-4b4a-bb21-fdbf0f44da24 service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Received event network-vif-plugged-8fd17bd8-2470-4931-8df3-b1ca41125d39 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:01:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-5cde92a1-f990-4493-bb48-58a94d917a45 req-92a00d74-c6c4-4b4a-bb21-fdbf0f44da24 service nova] Acquiring lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:01:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-5cde92a1-f990-4493-bb48-58a94d917a45 req-92a00d74-c6c4-4b4a-bb21-fdbf0f44da24 service nova] Lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:01:27 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-5cde92a1-f990-4493-bb48-58a94d917a45 req-92a00d74-c6c4-4b4a-bb21-fdbf0f44da24 service nova] Lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:01:27 user nova-compute[71229]: DEBUG nova.compute.manager [req-5cde92a1-f990-4493-bb48-58a94d917a45 req-92a00d74-c6c4-4b4a-bb21-fdbf0f44da24 service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] No waiting events found dispatching network-vif-plugged-8fd17bd8-2470-4931-8df3-b1ca41125d39 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 16:01:27 user nova-compute[71229]: WARNING nova.compute.manager [req-5cde92a1-f990-4493-bb48-58a94d917a45 req-92a00d74-c6c4-4b4a-bb21-fdbf0f44da24 service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Received unexpected event network-vif-plugged-8fd17bd8-2470-4931-8df3-b1ca41125d39 for instance with vm_state active and task_state None.
Apr 11 16:01:29 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:01:29 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:01:29 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:01:30 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:01:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:01:32 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:01:32 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:01:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:01:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:01:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:01:32 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 16:01:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:01:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:01:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:01:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:01:33 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:01:33 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:01:33 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8817MB free_disk=25.995941162109375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 16:01:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:01:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:01:33 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 16:01:33 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 16:01:33 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 16:01:33 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 16:01:33 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 16:01:33 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 16:01:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.203s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:01:34 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:01:34 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:01:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:01:42 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:01:43 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:01:44 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:01:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:01:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:01:54 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:01:57 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:01:59 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:02:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:02:09 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:02:12 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:02:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:02:16 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:02:16 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Cleaning up deleted instances {{(pid=71229) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 16:02:16 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] There are 0 instances to clean {{(pid=71229) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 16:02:19 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:02:20 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:02:20 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 16:02:24 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:02:25 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:02:25 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 16:02:25 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Rebuilding the list of instances to heal {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 16:02:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "refresh_cache-0d6c5972-e53b-47e9-8f13-7df1ad86020e" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 16:02:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquired lock "refresh_cache-0d6c5972-e53b-47e9-8f13-7df1ad86020e" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 16:02:25 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Forcefully refreshing network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 16:02:25 user nova-compute[71229]: DEBUG nova.objects.instance [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lazy-loading 'info_cache' on Instance uuid 0d6c5972-e53b-47e9-8f13-7df1ad86020e {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:02:26 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Updating instance_info_cache with network_info: [{"id": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "address": "fa:16:3e:ba:60:e0", "network": {"id": "e6f9483b-53f6-4696-b451-52aeb6ec13d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822664747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa330c512f045dc8a5946be3563fdcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd17bd8-24", "ovs_interfaceid": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 16:02:26 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Releasing lock "refresh_cache-0d6c5972-e53b-47e9-8f13-7df1ad86020e" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 16:02:26 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Updated the network info_cache for instance {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 16:02:26 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:02:29 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:02:30 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:02:30 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:02:31 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:02:32 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:02:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:02:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:02:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:02:32 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 16:02:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:02:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:02:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:02:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:02:33 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:02:33 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:02:33 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8836MB free_disk=25.995128631591797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 16:02:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:02:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:02:33 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 16:02:33 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 16:02:33 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 16:02:33 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 16:02:33 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 16:02:33 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 16:02:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:02:34 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:02:34 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:02:35 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:02:36 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:02:36 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71229) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 16:02:38 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:02:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:02:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:02:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:02:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:02:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:02:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:02:44 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:02:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:02:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:02:54 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:02:59 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:02:59 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:02:59 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:02:59 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:02:59 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:02:59 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:03:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:03:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:03:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:03:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:03:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:03:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:03:09 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:03:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-efe6c261-c064-4f50-975d-ca8f292a3595 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:03:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-efe6c261-c064-4f50-975d-ca8f292a3595 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:03:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-efe6c261-c064-4f50-975d-ca8f292a3595 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:03:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-efe6c261-c064-4f50-975d-ca8f292a3595 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:03:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-efe6c261-c064-4f50-975d-ca8f292a3595 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:03:13 user nova-compute[71229]: INFO nova.compute.manager [None req-efe6c261-c064-4f50-975d-ca8f292a3595 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Terminating instance
Apr 11 16:03:13 user nova-compute[71229]: DEBUG nova.compute.manager [None req-efe6c261-c064-4f50-975d-ca8f292a3595 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Start destroying the instance on the hypervisor. {{(pid=71229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 16:03:13 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:03:13 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:03:13 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:03:13 user nova-compute[71229]: DEBUG nova.compute.manager [req-1bf0043a-ab40-4c38-93d1-3991dcb3ef21 req-ca21cd14-4bd0-4b7c-b867-d061b648e647 service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Received event network-vif-unplugged-8fd17bd8-2470-4931-8df3-b1ca41125d39 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:03:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-1bf0043a-ab40-4c38-93d1-3991dcb3ef21 req-ca21cd14-4bd0-4b7c-b867-d061b648e647 service nova] Acquiring lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:03:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-1bf0043a-ab40-4c38-93d1-3991dcb3ef21 req-ca21cd14-4bd0-4b7c-b867-d061b648e647 service nova] Lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:03:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-1bf0043a-ab40-4c38-93d1-3991dcb3ef21 req-ca21cd14-4bd0-4b7c-b867-d061b648e647 service nova] Lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:03:13 user nova-compute[71229]: DEBUG nova.compute.manager [req-1bf0043a-ab40-4c38-93d1-3991dcb3ef21 req-ca21cd14-4bd0-4b7c-b867-d061b648e647 service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] No waiting events found dispatching network-vif-unplugged-8fd17bd8-2470-4931-8df3-b1ca41125d39 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 16:03:13 user nova-compute[71229]: DEBUG nova.compute.manager [req-1bf0043a-ab40-4c38-93d1-3991dcb3ef21 req-ca21cd14-4bd0-4b7c-b867-d061b648e647 service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Received event network-vif-unplugged-8fd17bd8-2470-4931-8df3-b1ca41125d39 for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 16:03:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:03:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:03:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:03:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:03:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:03:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:03:14 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Instance destroyed successfully.
Apr 11 16:03:14 user nova-compute[71229]: DEBUG nova.objects.instance [None req-efe6c261-c064-4f50-975d-ca8f292a3595 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lazy-loading 'resources' on Instance uuid 0d6c5972-e53b-47e9-8f13-7df1ad86020e {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:03:14 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-efe6c261-c064-4f50-975d-ca8f292a3595 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T15:53:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-873450080',display_name='tempest-AttachVolumeTestJSON-server-873450080',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-873450080',id=39,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA++uuXe6FyaUH7+6A7LXI9JAeQOW0LGZU8i83jm7ocQcCkrPDDJFgc0QxuJD62Az+edRqtAEJw2zMA+YyRUWi6KTatWRW/2wsFjFL2TMdY96WvhmRoEL5HXtf0K6rtWuw==',key_name='tempest-keypair-1501547376',keypairs=<?>,launch_index=0,launched_at=2023-04-11T15:53:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8fa330c512f045dc8a5946be3563fdcd',ramdisk_id='',reservation_id='r-y1ru7450',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1691938977',owner_user_name='tempest-AttachVolumeTestJSON-1691938977-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T16:01:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa87f179b35a4d1db2336802e8f104e4',uuid=0d6c5972-e53b-47e9-8f13-7df1ad86020e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "address": "fa:16:3e:ba:60:e0", "network": {"id": "e6f9483b-53f6-4696-b451-52aeb6ec13d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822664747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa330c512f045dc8a5946be3563fdcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd17bd8-24", "ovs_interfaceid": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 16:03:14 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-efe6c261-c064-4f50-975d-ca8f292a3595 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Converting VIF {"id": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "address": "fa:16:3e:ba:60:e0", "network": {"id": "e6f9483b-53f6-4696-b451-52aeb6ec13d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822664747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa330c512f045dc8a5946be3563fdcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd17bd8-24", "ovs_interfaceid": "8fd17bd8-2470-4931-8df3-b1ca41125d39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 16:03:14 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-efe6c261-c064-4f50-975d-ca8f292a3595 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:60:e0,bridge_name='br-int',has_traffic_filtering=True,id=8fd17bd8-2470-4931-8df3-b1ca41125d39,network=Network(e6f9483b-53f6-4696-b451-52aeb6ec13d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fd17bd8-24') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 16:03:14 user nova-compute[71229]: DEBUG os_vif [None req-efe6c261-c064-4f50-975d-ca8f292a3595 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:60:e0,bridge_name='br-int',has_traffic_filtering=True,id=8fd17bd8-2470-4931-8df3-b1ca41125d39,network=Network(e6f9483b-53f6-4696-b451-52aeb6ec13d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fd17bd8-24') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 16:03:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:03:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8fd17bd8-24, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 16:03:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:03:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:03:14 user nova-compute[71229]: INFO os_vif [None req-efe6c261-c064-4f50-975d-ca8f292a3595 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:60:e0,bridge_name='br-int',has_traffic_filtering=True,id=8fd17bd8-2470-4931-8df3-b1ca41125d39,network=Network(e6f9483b-53f6-4696-b451-52aeb6ec13d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fd17bd8-24')
Apr 11 16:03:14 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-efe6c261-c064-4f50-975d-ca8f292a3595 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Deleting instance files /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e_del
Apr 11 16:03:14 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-efe6c261-c064-4f50-975d-ca8f292a3595 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Deletion of /opt/stack/data/nova/instances/0d6c5972-e53b-47e9-8f13-7df1ad86020e_del complete
Apr 11 16:03:14 user nova-compute[71229]: INFO nova.compute.manager [None req-efe6c261-c064-4f50-975d-ca8f292a3595 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 11 16:03:14 user nova-compute[71229]: DEBUG oslo.service.loopingcall [None req-efe6c261-c064-4f50-975d-ca8f292a3595 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71229) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 16:03:14 user nova-compute[71229]: DEBUG nova.compute.manager [-] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Deallocating network for instance {{(pid=71229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 16:03:14 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] deallocate_for_instance() {{(pid=71229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 16:03:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:03:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:03:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:03:15 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:03:15 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 16:03:15 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Took 0.86 seconds to deallocate network for instance.
Apr 11 16:03:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-efe6c261-c064-4f50-975d-ca8f292a3595 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:03:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-efe6c261-c064-4f50-975d-ca8f292a3595 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:03:15 user nova-compute[71229]: DEBUG nova.compute.manager [req-36fdfc3b-6f74-40a5-889b-2dc51cede6d6 req-6d2033da-d6bc-4d8a-b39c-780a7d3ec837 service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Received event network-vif-deleted-8fd17bd8-2470-4931-8df3-b1ca41125d39 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:03:15 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-efe6c261-c064-4f50-975d-ca8f292a3595 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 16:03:15 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-efe6c261-c064-4f50-975d-ca8f292a3595 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 16:03:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-efe6c261-c064-4f50-975d-ca8f292a3595 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.116s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:03:15 user nova-compute[71229]: INFO nova.scheduler.client.report [None req-efe6c261-c064-4f50-975d-ca8f292a3595 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Deleted allocations for instance 0d6c5972-e53b-47e9-8f13-7df1ad86020e
Apr 11 16:03:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-efe6c261-c064-4f50-975d-ca8f292a3595 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.056s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:03:15 user nova-compute[71229]: DEBUG nova.compute.manager [req-eaad2b83-3cd3-4c15-b5d2-92ab41bd3036 req-6fbb7304-4eab-431a-ad43-1cdcf0f44b51 service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Received event network-vif-plugged-8fd17bd8-2470-4931-8df3-b1ca41125d39 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:03:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-eaad2b83-3cd3-4c15-b5d2-92ab41bd3036 req-6fbb7304-4eab-431a-ad43-1cdcf0f44b51 service nova] Acquiring lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:03:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-eaad2b83-3cd3-4c15-b5d2-92ab41bd3036 req-6fbb7304-4eab-431a-ad43-1cdcf0f44b51 service nova] Lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:03:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-eaad2b83-3cd3-4c15-b5d2-92ab41bd3036 req-6fbb7304-4eab-431a-ad43-1cdcf0f44b51 service nova] Lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:03:16 user nova-compute[71229]: DEBUG nova.compute.manager [req-eaad2b83-3cd3-4c15-b5d2-92ab41bd3036 req-6fbb7304-4eab-431a-ad43-1cdcf0f44b51 service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] No waiting events found dispatching network-vif-plugged-8fd17bd8-2470-4931-8df3-b1ca41125d39 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 16:03:16 user nova-compute[71229]: WARNING nova.compute.manager [req-eaad2b83-3cd3-4c15-b5d2-92ab41bd3036 req-6fbb7304-4eab-431a-ad43-1cdcf0f44b51 service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Received unexpected event network-vif-plugged-8fd17bd8-2470-4931-8df3-b1ca41125d39 for instance with vm_state deleted and task_state None.
Apr 11 16:03:16 user nova-compute[71229]: DEBUG nova.compute.manager [req-eaad2b83-3cd3-4c15-b5d2-92ab41bd3036 req-6fbb7304-4eab-431a-ad43-1cdcf0f44b51 service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Received event network-vif-plugged-8fd17bd8-2470-4931-8df3-b1ca41125d39 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:03:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-eaad2b83-3cd3-4c15-b5d2-92ab41bd3036 req-6fbb7304-4eab-431a-ad43-1cdcf0f44b51 service nova] Acquiring lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:03:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-eaad2b83-3cd3-4c15-b5d2-92ab41bd3036 req-6fbb7304-4eab-431a-ad43-1cdcf0f44b51 service nova] Lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:03:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-eaad2b83-3cd3-4c15-b5d2-92ab41bd3036 req-6fbb7304-4eab-431a-ad43-1cdcf0f44b51 service nova] Lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:03:16 user nova-compute[71229]: DEBUG nova.compute.manager [req-eaad2b83-3cd3-4c15-b5d2-92ab41bd3036 req-6fbb7304-4eab-431a-ad43-1cdcf0f44b51 service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] No waiting events found dispatching network-vif-plugged-8fd17bd8-2470-4931-8df3-b1ca41125d39 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 16:03:16 user nova-compute[71229]: WARNING nova.compute.manager [req-eaad2b83-3cd3-4c15-b5d2-92ab41bd3036 req-6fbb7304-4eab-431a-ad43-1cdcf0f44b51 service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Received unexpected event network-vif-plugged-8fd17bd8-2470-4931-8df3-b1ca41125d39 for instance with vm_state deleted and task_state None.
Apr 11 16:03:16 user nova-compute[71229]: DEBUG nova.compute.manager [req-eaad2b83-3cd3-4c15-b5d2-92ab41bd3036 req-6fbb7304-4eab-431a-ad43-1cdcf0f44b51 service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Received event network-vif-plugged-8fd17bd8-2470-4931-8df3-b1ca41125d39 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:03:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-eaad2b83-3cd3-4c15-b5d2-92ab41bd3036 req-6fbb7304-4eab-431a-ad43-1cdcf0f44b51 service nova] Acquiring lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:03:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-eaad2b83-3cd3-4c15-b5d2-92ab41bd3036 req-6fbb7304-4eab-431a-ad43-1cdcf0f44b51 service nova] Lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:03:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-eaad2b83-3cd3-4c15-b5d2-92ab41bd3036 req-6fbb7304-4eab-431a-ad43-1cdcf0f44b51 service nova] Lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:03:16 user nova-compute[71229]: DEBUG nova.compute.manager [req-eaad2b83-3cd3-4c15-b5d2-92ab41bd3036 req-6fbb7304-4eab-431a-ad43-1cdcf0f44b51 service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] No waiting events found dispatching network-vif-plugged-8fd17bd8-2470-4931-8df3-b1ca41125d39 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 16:03:16 user nova-compute[71229]: WARNING nova.compute.manager [req-eaad2b83-3cd3-4c15-b5d2-92ab41bd3036 req-6fbb7304-4eab-431a-ad43-1cdcf0f44b51 service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Received unexpected event network-vif-plugged-8fd17bd8-2470-4931-8df3-b1ca41125d39 for instance with vm_state deleted and task_state None.
Apr 11 16:03:16 user nova-compute[71229]: DEBUG nova.compute.manager [req-eaad2b83-3cd3-4c15-b5d2-92ab41bd3036 req-6fbb7304-4eab-431a-ad43-1cdcf0f44b51 service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Received event network-vif-unplugged-8fd17bd8-2470-4931-8df3-b1ca41125d39 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:03:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-eaad2b83-3cd3-4c15-b5d2-92ab41bd3036 req-6fbb7304-4eab-431a-ad43-1cdcf0f44b51 service nova] Acquiring lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:03:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-eaad2b83-3cd3-4c15-b5d2-92ab41bd3036 req-6fbb7304-4eab-431a-ad43-1cdcf0f44b51 service nova] Lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:03:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-eaad2b83-3cd3-4c15-b5d2-92ab41bd3036 req-6fbb7304-4eab-431a-ad43-1cdcf0f44b51 service nova] Lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:03:16 user nova-compute[71229]: DEBUG nova.compute.manager [req-eaad2b83-3cd3-4c15-b5d2-92ab41bd3036 req-6fbb7304-4eab-431a-ad43-1cdcf0f44b51 service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] No waiting events found dispatching network-vif-unplugged-8fd17bd8-2470-4931-8df3-b1ca41125d39 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 16:03:16 user nova-compute[71229]: WARNING nova.compute.manager [req-eaad2b83-3cd3-4c15-b5d2-92ab41bd3036 req-6fbb7304-4eab-431a-ad43-1cdcf0f44b51 service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Received unexpected event network-vif-unplugged-8fd17bd8-2470-4931-8df3-b1ca41125d39 for instance with vm_state deleted and task_state None.
Apr 11 16:03:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:03:18 user nova-compute[71229]: DEBUG nova.compute.manager [req-5fdd380f-6d1b-4ab8-8ffb-b17c1d985b66 req-3382e328-95e4-46fb-87f9-6ea8b089beb2 service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Received event network-vif-plugged-8fd17bd8-2470-4931-8df3-b1ca41125d39 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:03:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-5fdd380f-6d1b-4ab8-8ffb-b17c1d985b66 req-3382e328-95e4-46fb-87f9-6ea8b089beb2 service nova] Acquiring lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:03:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-5fdd380f-6d1b-4ab8-8ffb-b17c1d985b66 req-3382e328-95e4-46fb-87f9-6ea8b089beb2 service nova] Lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:03:18 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-5fdd380f-6d1b-4ab8-8ffb-b17c1d985b66 req-3382e328-95e4-46fb-87f9-6ea8b089beb2 service nova] Lock "0d6c5972-e53b-47e9-8f13-7df1ad86020e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:03:18 user nova-compute[71229]: DEBUG nova.compute.manager [req-5fdd380f-6d1b-4ab8-8ffb-b17c1d985b66 req-3382e328-95e4-46fb-87f9-6ea8b089beb2 service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] No waiting events found dispatching network-vif-plugged-8fd17bd8-2470-4931-8df3-b1ca41125d39 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 16:03:18 user nova-compute[71229]: WARNING nova.compute.manager [req-5fdd380f-6d1b-4ab8-8ffb-b17c1d985b66 req-3382e328-95e4-46fb-87f9-6ea8b089beb2 service nova] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Received unexpected event network-vif-plugged-8fd17bd8-2470-4931-8df3-b1ca41125d39 for instance with vm_state deleted and task_state None.
Apr 11 16:03:19 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:03:20 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:03:20 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 16:03:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:03:24 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:03:27 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:03:27 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 16:03:27 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Rebuilding the list of instances to heal {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 16:03:27 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Didn't find any instances for network info cache update. {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 16:03:28 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:03:29 user nova-compute[71229]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681228994.4008708, 0d6c5972-e53b-47e9-8f13-7df1ad86020e => Stopped> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 16:03:29 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] VM Stopped (Lifecycle Event)
Apr 11 16:03:29 user nova-compute[71229]: DEBUG nova.compute.manager [None req-506cf6ca-9b03-4a7d-894e-611ca05006cf None None] [instance: 0d6c5972-e53b-47e9-8f13-7df1ad86020e] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 16:03:29 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:03:30 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:03:32 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:03:32 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:03:32 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:03:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:03:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:03:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:03:32 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 16:03:33 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:03:33 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:03:33 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8919MB free_disk=26.014301300048828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 16:03:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:03:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:03:33 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 16:03:33 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 16:03:33 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Refreshing inventories for resource provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 16:03:33 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Updating ProviderTree inventory for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 16:03:33 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Updating inventory in ProviderTree for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 16:03:33 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Refreshing aggregate associations for resource provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de, aggregates: None {{(pid=71229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 16:03:33 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Refreshing trait associations for resource provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de, traits: COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=71229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 16:03:33 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 16:03:33 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 16:03:33 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 16:03:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.391s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:03:34 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:03:34 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:03:34 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:03:34 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:03:34 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:03:34 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:03:34 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:03:37 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:03:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:03:43 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:03:44 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:03:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:03:54 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:03:54 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:03:54 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:03:54 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:03:54 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:03:54 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:03:59 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:04:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:04:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:04:07 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "babe1474-6141-4c29-a009-99b61e0c1a05" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:04:07 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "babe1474-6141-4c29-a009-99b61e0c1a05" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:04:07 user nova-compute[71229]: DEBUG nova.compute.manager [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Starting instance... {{(pid=71229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 16:04:07 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:04:07 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:04:07 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 16:04:07 user nova-compute[71229]: INFO nova.compute.claims [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Claim successful on node user
Apr 11 16:04:07 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 16:04:07 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 16:04:07 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.197s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:04:07 user nova-compute[71229]: DEBUG nova.compute.manager [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Start building networks asynchronously for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 16:04:07 user nova-compute[71229]: DEBUG nova.compute.manager [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Allocating IP information in the background. {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 16:04:07 user nova-compute[71229]: DEBUG nova.network.neutron [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] allocate_for_instance() {{(pid=71229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 16:04:07 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 16:04:07 user nova-compute[71229]: DEBUG nova.compute.manager [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Start building block device mappings for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 16:04:07 user nova-compute[71229]: DEBUG nova.policy [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa87f179b35a4d1db2336802e8f104e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa330c512f045dc8a5946be3563fdcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71229) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 16:04:07 user nova-compute[71229]: DEBUG nova.compute.manager [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Start spawning the instance on the hypervisor. {{(pid=71229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 16:04:07 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Creating instance directory {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 16:04:07 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Creating image(s)
Apr 11 16:04:07 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "/opt/stack/data/nova/instances/babe1474-6141-4c29-a009-99b61e0c1a05/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:04:07 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "/opt/stack/data/nova/instances/babe1474-6141-4c29-a009-99b61e0c1a05/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:04:07 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "/opt/stack/data/nova/instances/babe1474-6141-4c29-a009-99b61e0c1a05/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:04:07 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:04:08 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.147s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:04:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:04:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:04:08 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:04:08 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.142s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:04:08 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/babe1474-6141-4c29-a009-99b61e0c1a05/disk 1073741824 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:04:08 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/babe1474-6141-4c29-a009-99b61e0c1a05/disk 1073741824" returned: 0 in 0.062s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:04:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.211s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:04:08 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:04:08 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.159s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:04:08 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Checking if we can resize image /opt/stack/data/nova/instances/babe1474-6141-4c29-a009-99b61e0c1a05/disk. size=1073741824 {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 16:04:08 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/babe1474-6141-4c29-a009-99b61e0c1a05/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:04:08 user nova-compute[71229]: DEBUG nova.network.neutron [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Successfully created port: 52b531e9-3dd1-4fa2-9e5e-17127998ee74 {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 16:04:08 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/babe1474-6141-4c29-a009-99b61e0c1a05/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:04:08 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Cannot resize image /opt/stack/data/nova/instances/babe1474-6141-4c29-a009-99b61e0c1a05/disk to a smaller size. {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 16:04:08 user nova-compute[71229]: DEBUG nova.objects.instance [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lazy-loading 'migration_context' on Instance uuid babe1474-6141-4c29-a009-99b61e0c1a05 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:04:08 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Created local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 16:04:08 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Ensure instance console log exists: /opt/stack/data/nova/instances/babe1474-6141-4c29-a009-99b61e0c1a05/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 16:04:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:04:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:04:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:04:09 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:04:09 user nova-compute[71229]: DEBUG nova.network.neutron [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Successfully updated port: 52b531e9-3dd1-4fa2-9e5e-17127998ee74 {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 16:04:09 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "refresh_cache-babe1474-6141-4c29-a009-99b61e0c1a05" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 16:04:09 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquired lock "refresh_cache-babe1474-6141-4c29-a009-99b61e0c1a05" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 16:04:09 user nova-compute[71229]: DEBUG nova.network.neutron [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 16:04:09 user nova-compute[71229]: DEBUG nova.compute.manager [req-79ceaff3-114c-4558-b688-05c022b15d83 req-c4929f6e-f651-4949-b18d-b8f58b8bdb6a service nova] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Received event network-changed-52b531e9-3dd1-4fa2-9e5e-17127998ee74 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:04:09 user nova-compute[71229]: DEBUG nova.compute.manager [req-79ceaff3-114c-4558-b688-05c022b15d83 req-c4929f6e-f651-4949-b18d-b8f58b8bdb6a service nova] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Refreshing instance network info cache due to event network-changed-52b531e9-3dd1-4fa2-9e5e-17127998ee74. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 16:04:09 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-79ceaff3-114c-4558-b688-05c022b15d83 req-c4929f6e-f651-4949-b18d-b8f58b8bdb6a service nova] Acquiring lock "refresh_cache-babe1474-6141-4c29-a009-99b61e0c1a05" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 16:04:09 user nova-compute[71229]: DEBUG nova.network.neutron [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 16:04:09 user nova-compute[71229]: DEBUG nova.network.neutron [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Updating instance_info_cache with network_info: [{"id": "52b531e9-3dd1-4fa2-9e5e-17127998ee74", "address": "fa:16:3e:77:dc:ff", "network": {"id": "e6f9483b-53f6-4696-b451-52aeb6ec13d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822664747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa330c512f045dc8a5946be3563fdcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52b531e9-3d", "ovs_interfaceid": "52b531e9-3dd1-4fa2-9e5e-17127998ee74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 16:04:09 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Releasing lock "refresh_cache-babe1474-6141-4c29-a009-99b61e0c1a05" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 16:04:09 user nova-compute[71229]: DEBUG nova.compute.manager [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Instance network_info: |[{"id": "52b531e9-3dd1-4fa2-9e5e-17127998ee74", "address": "fa:16:3e:77:dc:ff", "network": {"id": "e6f9483b-53f6-4696-b451-52aeb6ec13d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822664747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa330c512f045dc8a5946be3563fdcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52b531e9-3d", "ovs_interfaceid": "52b531e9-3dd1-4fa2-9e5e-17127998ee74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 16:04:09 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-79ceaff3-114c-4558-b688-05c022b15d83 req-c4929f6e-f651-4949-b18d-b8f58b8bdb6a service nova] Acquired lock "refresh_cache-babe1474-6141-4c29-a009-99b61e0c1a05" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 16:04:09 user nova-compute[71229]: DEBUG nova.network.neutron [req-79ceaff3-114c-4558-b688-05c022b15d83 req-c4929f6e-f651-4949-b18d-b8f58b8bdb6a service nova] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Refreshing network info cache for port 52b531e9-3dd1-4fa2-9e5e-17127998ee74 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 16:04:09 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Start _get_guest_xml network_info=[{"id": "52b531e9-3dd1-4fa2-9e5e-17127998ee74", "address": "fa:16:3e:77:dc:ff", "network": {"id": "e6f9483b-53f6-4696-b451-52aeb6ec13d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822664747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa330c512f045dc8a5946be3563fdcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52b531e9-3d", "ovs_interfaceid": "52b531e9-3dd1-4fa2-9e5e-17127998ee74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '52fe638c-5ada-47d5-b376-233bfa808a37'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 16:04:09 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:04:09 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:04:09 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 16:04:09 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 16:04:09 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 16:04:09 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 16:04:09 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 16:04:09 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 16:04:09 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 16:04:09 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 16:04:09 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 16:04:09 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 16:04:09 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 16:04:09 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 16:04:09 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T16:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-710249164',display_name='tempest-AttachVolumeTestJSON-server-710249164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-710249164',id=41,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3Vd/gPFHz73t2nUBm8NxBQLIDsgPm1EYQOBLUif7Y740J+h2EGFkfTc7lHtnfvKweVN3WVhYM4TjSp+rH5npDx4XBTO229iAcUP9TXjmix55FPHQC3XqKMkif0pTVxFw==',key_name='tempest-keypair-1137335061',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8fa330c512f045dc8a5946be3563fdcd',ramdisk_id='',reservation_id='r-1fiedpl3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1691938977',owner_user_name='tempest-AttachVolumeTestJSON-1691938977-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T16:04:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa87f179b35a4d1db2336802e8f104e4',uuid=babe1474-6141-4c29-a009-99b61e0c1a05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52b531e9-3dd1-4fa2-9e5e-17127998ee74", "address": "fa:16:3e:77:dc:ff", "network": {"id": "e6f9483b-53f6-4696-b451-52aeb6ec13d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822664747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa330c512f045dc8a5946be3563fdcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52b531e9-3d", "ovs_interfaceid": "52b531e9-3dd1-4fa2-9e5e-17127998ee74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 16:04:09 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Converting VIF {"id": "52b531e9-3dd1-4fa2-9e5e-17127998ee74", "address": "fa:16:3e:77:dc:ff", "network": {"id": "e6f9483b-53f6-4696-b451-52aeb6ec13d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822664747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa330c512f045dc8a5946be3563fdcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52b531e9-3d", "ovs_interfaceid": "52b531e9-3dd1-4fa2-9e5e-17127998ee74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 16:04:09 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:dc:ff,bridge_name='br-int',has_traffic_filtering=True,id=52b531e9-3dd1-4fa2-9e5e-17127998ee74,network=Network(e6f9483b-53f6-4696-b451-52aeb6ec13d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52b531e9-3d') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 16:04:09 user nova-compute[71229]: DEBUG nova.objects.instance [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lazy-loading 'pci_devices' on Instance uuid babe1474-6141-4c29-a009-99b61e0c1a05 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:04:09 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] End _get_guest_xml xml=<domain type="kvm">
Apr 11 16:04:09 user nova-compute[71229]:   <uuid>babe1474-6141-4c29-a009-99b61e0c1a05</uuid>
Apr 11 16:04:09 user nova-compute[71229]:   <name>instance-00000029</name>
Apr 11 16:04:09 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 16:04:09 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 16:04:09 user nova-compute[71229]:   <metadata>
Apr 11 16:04:09 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 16:04:09 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 16:04:09 user nova-compute[71229]:       <nova:name>tempest-AttachVolumeTestJSON-server-710249164</nova:name>
Apr 11 16:04:09 user nova-compute[71229]:       <nova:creationTime>2023-04-11 16:04:09</nova:creationTime>
Apr 11 16:04:09 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 16:04:09 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 16:04:09 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 16:04:09 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 16:04:09 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 16:04:09 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 16:04:09 user nova-compute[71229]:       </nova:flavor>
Apr 11 16:04:09 user nova-compute[71229]:       <nova:owner>
Apr 11 16:04:09 user nova-compute[71229]:         <nova:user uuid="aa87f179b35a4d1db2336802e8f104e4">tempest-AttachVolumeTestJSON-1691938977-project-member</nova:user>
Apr 11 16:04:09 user nova-compute[71229]:         <nova:project uuid="8fa330c512f045dc8a5946be3563fdcd">tempest-AttachVolumeTestJSON-1691938977</nova:project>
Apr 11 16:04:09 user nova-compute[71229]:       </nova:owner>
Apr 11 16:04:09 user nova-compute[71229]:       <nova:root type="image" uuid="52fe638c-5ada-47d5-b376-233bfa808a37"/>
Apr 11 16:04:09 user nova-compute[71229]:       <nova:ports>
Apr 11 16:04:09 user nova-compute[71229]:         <nova:port uuid="52b531e9-3dd1-4fa2-9e5e-17127998ee74">
Apr 11 16:04:09 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 11 16:04:09 user nova-compute[71229]:         </nova:port>
Apr 11 16:04:09 user nova-compute[71229]:       </nova:ports>
Apr 11 16:04:09 user nova-compute[71229]:     </nova:instance>
Apr 11 16:04:09 user nova-compute[71229]:   </metadata>
Apr 11 16:04:09 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 16:04:09 user nova-compute[71229]:     <system>
Apr 11 16:04:09 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 16:04:09 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 16:04:09 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 16:04:09 user nova-compute[71229]:       <entry name="serial">babe1474-6141-4c29-a009-99b61e0c1a05</entry>
Apr 11 16:04:09 user nova-compute[71229]:       <entry name="uuid">babe1474-6141-4c29-a009-99b61e0c1a05</entry>
Apr 11 16:04:09 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 16:04:09 user nova-compute[71229]:     </system>
Apr 11 16:04:09 user nova-compute[71229]:   </sysinfo>
Apr 11 16:04:09 user nova-compute[71229]:   <os>
Apr 11 16:04:09 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 16:04:09 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 16:04:09 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 16:04:09 user nova-compute[71229]:   </os>
Apr 11 16:04:09 user nova-compute[71229]:   <features>
Apr 11 16:04:09 user nova-compute[71229]:     <acpi/>
Apr 11 16:04:09 user nova-compute[71229]:     <apic/>
Apr 11 16:04:09 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 16:04:09 user nova-compute[71229]:   </features>
Apr 11 16:04:09 user nova-compute[71229]:   <clock offset="utc">
Apr 11 16:04:09 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 16:04:09 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 16:04:09 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 16:04:09 user nova-compute[71229]:   </clock>
Apr 11 16:04:09 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 16:04:09 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 16:04:09 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 16:04:09 user nova-compute[71229]:   </cpu>
Apr 11 16:04:09 user nova-compute[71229]:   <devices>
Apr 11 16:04:09 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 16:04:09 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 16:04:09 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/babe1474-6141-4c29-a009-99b61e0c1a05/disk"/>
Apr 11 16:04:09 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 16:04:09 user nova-compute[71229]:     </disk>
Apr 11 16:04:09 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 16:04:09 user nova-compute[71229]:       <mac address="fa:16:3e:77:dc:ff"/>
Apr 11 16:04:09 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 16:04:09 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 16:04:09 user nova-compute[71229]:       <target dev="tap52b531e9-3d"/>
Apr 11 16:04:09 user nova-compute[71229]:     </interface>
Apr 11 16:04:09 user nova-compute[71229]:     <serial type="pty">
Apr 11 16:04:09 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/babe1474-6141-4c29-a009-99b61e0c1a05/console.log" append="off"/>
Apr 11 16:04:09 user nova-compute[71229]:     </serial>
Apr 11 16:04:09 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 16:04:09 user nova-compute[71229]:     <video>
Apr 11 16:04:09 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 16:04:09 user nova-compute[71229]:     </video>
Apr 11 16:04:09 user nova-compute[71229]:     <rng model="virtio">
Apr 11 16:04:09 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 16:04:09 user nova-compute[71229]:     </rng>
Apr 11 16:04:09 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 16:04:09 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 16:04:09 user nova-compute[71229]:       <stats period="10"/>
Apr 11 16:04:09 user nova-compute[71229]:     </memballoon>
Apr 11 16:04:09 user nova-compute[71229]:   </devices>
Apr 11 16:04:09 user nova-compute[71229]: </domain>
Apr 11 16:04:09 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 16:04:09 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T16:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-710249164',display_name='tempest-AttachVolumeTestJSON-server-710249164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-710249164',id=41,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3Vd/gPFHz73t2nUBm8NxBQLIDsgPm1EYQOBLUif7Y740J+h2EGFkfTc7lHtnfvKweVN3WVhYM4TjSp+rH5npDx4XBTO229iAcUP9TXjmix55FPHQC3XqKMkif0pTVxFw==',key_name='tempest-keypair-1137335061',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8fa330c512f045dc8a5946be3563fdcd',ramdisk_id='',reservation_id='r-1fiedpl3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1691938977',owner_user_name='tempest-AttachVolumeTestJSON-1691938977-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T16:04:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa87f179b35a4d1db2336802e8f104e4',uuid=babe1474-6141-4c29-a009-99b61e0c1a05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52b531e9-3dd1-4fa2-9e5e-17127998ee74", "address": "fa:16:3e:77:dc:ff", "network": {"id": "e6f9483b-53f6-4696-b451-52aeb6ec13d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822664747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa330c512f045dc8a5946be3563fdcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52b531e9-3d", "ovs_interfaceid": "52b531e9-3dd1-4fa2-9e5e-17127998ee74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 16:04:09 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Converting VIF {"id": "52b531e9-3dd1-4fa2-9e5e-17127998ee74", "address": "fa:16:3e:77:dc:ff", "network": {"id": "e6f9483b-53f6-4696-b451-52aeb6ec13d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822664747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa330c512f045dc8a5946be3563fdcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52b531e9-3d", "ovs_interfaceid": "52b531e9-3dd1-4fa2-9e5e-17127998ee74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 16:04:09 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:dc:ff,bridge_name='br-int',has_traffic_filtering=True,id=52b531e9-3dd1-4fa2-9e5e-17127998ee74,network=Network(e6f9483b-53f6-4696-b451-52aeb6ec13d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52b531e9-3d') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 16:04:09 user nova-compute[71229]: DEBUG os_vif [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:dc:ff,bridge_name='br-int',has_traffic_filtering=True,id=52b531e9-3dd1-4fa2-9e5e-17127998ee74,network=Network(e6f9483b-53f6-4696-b451-52aeb6ec13d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52b531e9-3d') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 16:04:09 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:04:09 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 16:04:09 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 16:04:09 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:04:09 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap52b531e9-3d, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 16:04:09 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap52b531e9-3d, col_values=(('external_ids', {'iface-id': '52b531e9-3dd1-4fa2-9e5e-17127998ee74', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:dc:ff', 'vm-uuid': 'babe1474-6141-4c29-a009-99b61e0c1a05'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 16:04:09 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:04:09 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:04:09 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:04:09 user nova-compute[71229]: INFO os_vif [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:dc:ff,bridge_name='br-int',has_traffic_filtering=True,id=52b531e9-3dd1-4fa2-9e5e-17127998ee74,network=Network(e6f9483b-53f6-4696-b451-52aeb6ec13d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52b531e9-3d')
Apr 11 16:04:10 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 16:04:10 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] No VIF found with MAC fa:16:3e:77:dc:ff, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 16:04:10 user nova-compute[71229]: DEBUG nova.network.neutron [req-79ceaff3-114c-4558-b688-05c022b15d83 req-c4929f6e-f651-4949-b18d-b8f58b8bdb6a service nova] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Updated VIF entry in instance network info cache for port 52b531e9-3dd1-4fa2-9e5e-17127998ee74. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 16:04:10 user nova-compute[71229]: DEBUG nova.network.neutron [req-79ceaff3-114c-4558-b688-05c022b15d83 req-c4929f6e-f651-4949-b18d-b8f58b8bdb6a service nova] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Updating instance_info_cache with network_info: [{"id": "52b531e9-3dd1-4fa2-9e5e-17127998ee74", "address": "fa:16:3e:77:dc:ff", "network": {"id": "e6f9483b-53f6-4696-b451-52aeb6ec13d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822664747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa330c512f045dc8a5946be3563fdcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52b531e9-3d", "ovs_interfaceid": "52b531e9-3dd1-4fa2-9e5e-17127998ee74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 16:04:10 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-79ceaff3-114c-4558-b688-05c022b15d83 req-c4929f6e-f651-4949-b18d-b8f58b8bdb6a service nova] Releasing lock "refresh_cache-babe1474-6141-4c29-a009-99b61e0c1a05" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 16:04:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:04:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:04:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:04:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:04:11 user nova-compute[71229]: DEBUG nova.compute.manager [req-7b59955f-7aaf-4a6d-8869-6fe957dcf3d1 req-30ab0b8a-6e61-4de9-9bdb-1b5adc607139 service nova] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Received event network-vif-plugged-52b531e9-3dd1-4fa2-9e5e-17127998ee74 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:04:11 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-7b59955f-7aaf-4a6d-8869-6fe957dcf3d1 req-30ab0b8a-6e61-4de9-9bdb-1b5adc607139 service nova] Acquiring lock "babe1474-6141-4c29-a009-99b61e0c1a05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:04:11 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-7b59955f-7aaf-4a6d-8869-6fe957dcf3d1 req-30ab0b8a-6e61-4de9-9bdb-1b5adc607139 service nova] Lock "babe1474-6141-4c29-a009-99b61e0c1a05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:04:11 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-7b59955f-7aaf-4a6d-8869-6fe957dcf3d1 req-30ab0b8a-6e61-4de9-9bdb-1b5adc607139 service nova] Lock "babe1474-6141-4c29-a009-99b61e0c1a05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:04:11 user nova-compute[71229]: DEBUG nova.compute.manager [req-7b59955f-7aaf-4a6d-8869-6fe957dcf3d1 req-30ab0b8a-6e61-4de9-9bdb-1b5adc607139 service nova] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] No waiting events found dispatching network-vif-plugged-52b531e9-3dd1-4fa2-9e5e-17127998ee74 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 16:04:11 user nova-compute[71229]: WARNING nova.compute.manager [req-7b59955f-7aaf-4a6d-8869-6fe957dcf3d1 req-30ab0b8a-6e61-4de9-9bdb-1b5adc607139 service nova] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Received unexpected event network-vif-plugged-52b531e9-3dd1-4fa2-9e5e-17127998ee74 for instance with vm_state building and task_state spawning.
Apr 11 16:04:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:04:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:04:12 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:04:13 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681229053.4357145, babe1474-6141-4c29-a009-99b61e0c1a05 => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 16:04:13 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] VM Resumed (Lifecycle Event)
Apr 11 16:04:13 user nova-compute[71229]: DEBUG nova.compute.manager [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 16:04:13 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Guest created on hypervisor {{(pid=71229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 16:04:13 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Instance spawned successfully.
Apr 11 16:04:13 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 16:04:13 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 16:04:13 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 16:04:13 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Found default for hw_cdrom_bus of ide {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 16:04:13 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Found default for hw_disk_bus of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 16:04:13 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Found default for hw_input_bus of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 16:04:13 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Found default for hw_pointer_model of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 16:04:13 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Found default for hw_video_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 16:04:13 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Found default for hw_vif_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 16:04:13 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 16:04:13 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681229053.4375687, babe1474-6141-4c29-a009-99b61e0c1a05 => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 16:04:13 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] VM Started (Lifecycle Event)
Apr 11 16:04:13 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 16:04:13 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 16:04:13 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 16:04:13 user nova-compute[71229]: INFO nova.compute.manager [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Took 5.68 seconds to spawn the instance on the hypervisor.
Apr 11 16:04:13 user nova-compute[71229]: DEBUG nova.compute.manager [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 16:04:13 user nova-compute[71229]: DEBUG nova.compute.manager [req-4f2c5cb1-d643-408f-a162-64a100bd7d95 req-dd24ab22-8f2f-4549-8601-272f3c196993 service nova] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Received event network-vif-plugged-52b531e9-3dd1-4fa2-9e5e-17127998ee74 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:04:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4f2c5cb1-d643-408f-a162-64a100bd7d95 req-dd24ab22-8f2f-4549-8601-272f3c196993 service nova] Acquiring lock "babe1474-6141-4c29-a009-99b61e0c1a05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:04:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4f2c5cb1-d643-408f-a162-64a100bd7d95 req-dd24ab22-8f2f-4549-8601-272f3c196993 service nova] Lock "babe1474-6141-4c29-a009-99b61e0c1a05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:04:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-4f2c5cb1-d643-408f-a162-64a100bd7d95 req-dd24ab22-8f2f-4549-8601-272f3c196993 service nova] Lock "babe1474-6141-4c29-a009-99b61e0c1a05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:04:13 user nova-compute[71229]: DEBUG nova.compute.manager [req-4f2c5cb1-d643-408f-a162-64a100bd7d95 req-dd24ab22-8f2f-4549-8601-272f3c196993 service nova] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] No waiting events found dispatching network-vif-plugged-52b531e9-3dd1-4fa2-9e5e-17127998ee74 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 16:04:13 user nova-compute[71229]: WARNING nova.compute.manager [req-4f2c5cb1-d643-408f-a162-64a100bd7d95 req-dd24ab22-8f2f-4549-8601-272f3c196993 service nova] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Received unexpected event network-vif-plugged-52b531e9-3dd1-4fa2-9e5e-17127998ee74 for instance with vm_state building and task_state spawning.
Apr 11 16:04:13 user nova-compute[71229]: INFO nova.compute.manager [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Took 6.21 seconds to build instance.
Apr 11 16:04:13 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-cb84ff75-5c22-45fd-87ca-51d797056832 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "babe1474-6141-4c29-a009-99b61e0c1a05" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.306s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:04:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:04:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:04:19 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:04:22 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:04:22 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 16:04:24 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:04:27 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:04:28 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:04:28 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 16:04:28 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Rebuilding the list of instances to heal {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 16:04:28 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "refresh_cache-babe1474-6141-4c29-a009-99b61e0c1a05" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 16:04:28 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquired lock "refresh_cache-babe1474-6141-4c29-a009-99b61e0c1a05" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 16:04:28 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Forcefully refreshing network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 16:04:28 user nova-compute[71229]: DEBUG nova.objects.instance [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lazy-loading 'info_cache' on Instance uuid babe1474-6141-4c29-a009-99b61e0c1a05 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:04:29 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Updating instance_info_cache with network_info: [{"id": "52b531e9-3dd1-4fa2-9e5e-17127998ee74", "address": "fa:16:3e:77:dc:ff", "network": {"id": "e6f9483b-53f6-4696-b451-52aeb6ec13d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822664747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa330c512f045dc8a5946be3563fdcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52b531e9-3d", "ovs_interfaceid": "52b531e9-3dd1-4fa2-9e5e-17127998ee74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 16:04:29 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Releasing lock "refresh_cache-babe1474-6141-4c29-a009-99b61e0c1a05" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 16:04:29 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Updated the network info_cache for instance {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 16:04:29 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:04:29 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:04:30 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:04:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:04:32 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:04:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:04:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:04:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:04:32 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 16:04:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/babe1474-6141-4c29-a009-99b61e0c1a05/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:04:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/babe1474-6141-4c29-a009-99b61e0c1a05/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:04:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/babe1474-6141-4c29-a009-99b61e0c1a05/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:04:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/babe1474-6141-4c29-a009-99b61e0c1a05/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:04:33 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:04:33 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:04:33 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8791MB free_disk=25.97710418701172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 16:04:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:04:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:04:33 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance babe1474-6141-4c29-a009-99b61e0c1a05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 16:04:33 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 16:04:33 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 16:04:33 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 16:04:33 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 16:04:33 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 16:04:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.183s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:04:34 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:04:34 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:04:34 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:04:35 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:04:38 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:04:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:04:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:04:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:04:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:04:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:04:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:04:42 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:04:45 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:04:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:04:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:04:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:04:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:04:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:04:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:04:54 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:04:54 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:04:54 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:04:54 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:04:54 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:04:54 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:04:57 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:04:59 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:05:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:05:10 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:05:10 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:05:10 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:05:10 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:05:10 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:05:10 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:05:15 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:05:20 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:05:20 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:05:20 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:05:20 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:05:20 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:05:20 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:05:24 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:05:24 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 16:05:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:05:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:05:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:05:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:05:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:05:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:05:29 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:05:29 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 16:05:29 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Rebuilding the list of instances to heal {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 16:05:29 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "refresh_cache-babe1474-6141-4c29-a009-99b61e0c1a05" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 16:05:29 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquired lock "refresh_cache-babe1474-6141-4c29-a009-99b61e0c1a05" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 16:05:29 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Forcefully refreshing network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 16:05:29 user nova-compute[71229]: DEBUG nova.objects.instance [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lazy-loading 'info_cache' on Instance uuid babe1474-6141-4c29-a009-99b61e0c1a05 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:05:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:05:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:05:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:05:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:05:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:05:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:05:30 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Updating instance_info_cache with network_info: [{"id": "52b531e9-3dd1-4fa2-9e5e-17127998ee74", "address": "fa:16:3e:77:dc:ff", "network": {"id": "e6f9483b-53f6-4696-b451-52aeb6ec13d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822664747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa330c512f045dc8a5946be3563fdcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52b531e9-3d", "ovs_interfaceid": "52b531e9-3dd1-4fa2-9e5e-17127998ee74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 16:05:30 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Releasing lock "refresh_cache-babe1474-6141-4c29-a009-99b61e0c1a05" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 16:05:30 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Updated the network info_cache for instance {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 16:05:30 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:05:31 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:05:32 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:05:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:05:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:05:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:05:32 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 16:05:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/babe1474-6141-4c29-a009-99b61e0c1a05/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:05:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/babe1474-6141-4c29-a009-99b61e0c1a05/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:05:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/babe1474-6141-4c29-a009-99b61e0c1a05/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:05:33 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/babe1474-6141-4c29-a009-99b61e0c1a05/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:05:33 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:05:33 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:05:33 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8868MB free_disk=25.97650909423828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 16:05:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:05:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:05:33 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance babe1474-6141-4c29-a009-99b61e0c1a05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 16:05:33 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 16:05:33 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 16:05:33 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 16:05:33 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 16:05:33 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 16:05:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.161s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:05:35 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:05:35 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:05:35 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:05:35 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:05:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:05:39 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:05:40 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:05:45 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:05:46 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:05:50 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:05:55 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:05:58 user nova-compute[71229]: DEBUG nova.compute.manager [req-3ed3e4ab-5dc5-4be0-b75f-ba87dcc27544 req-bee5de59-44e5-46f4-bdaf-d7493af5f17d service nova] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Received event network-changed-52b531e9-3dd1-4fa2-9e5e-17127998ee74 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:05:58 user nova-compute[71229]: DEBUG nova.compute.manager [req-3ed3e4ab-5dc5-4be0-b75f-ba87dcc27544 req-bee5de59-44e5-46f4-bdaf-d7493af5f17d service nova] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Refreshing instance network info cache due to event network-changed-52b531e9-3dd1-4fa2-9e5e-17127998ee74. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 16:05:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3ed3e4ab-5dc5-4be0-b75f-ba87dcc27544 req-bee5de59-44e5-46f4-bdaf-d7493af5f17d service nova] Acquiring lock "refresh_cache-babe1474-6141-4c29-a009-99b61e0c1a05" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 16:05:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3ed3e4ab-5dc5-4be0-b75f-ba87dcc27544 req-bee5de59-44e5-46f4-bdaf-d7493af5f17d service nova] Acquired lock "refresh_cache-babe1474-6141-4c29-a009-99b61e0c1a05" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 16:05:58 user nova-compute[71229]: DEBUG nova.network.neutron [req-3ed3e4ab-5dc5-4be0-b75f-ba87dcc27544 req-bee5de59-44e5-46f4-bdaf-d7493af5f17d service nova] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Refreshing network info cache for port 52b531e9-3dd1-4fa2-9e5e-17127998ee74 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 16:05:58 user nova-compute[71229]: DEBUG nova.network.neutron [req-3ed3e4ab-5dc5-4be0-b75f-ba87dcc27544 req-bee5de59-44e5-46f4-bdaf-d7493af5f17d service nova] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Updated VIF entry in instance network info cache for port 52b531e9-3dd1-4fa2-9e5e-17127998ee74. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 16:05:58 user nova-compute[71229]: DEBUG nova.network.neutron [req-3ed3e4ab-5dc5-4be0-b75f-ba87dcc27544 req-bee5de59-44e5-46f4-bdaf-d7493af5f17d service nova] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Updating instance_info_cache with network_info: [{"id": "52b531e9-3dd1-4fa2-9e5e-17127998ee74", "address": "fa:16:3e:77:dc:ff", "network": {"id": "e6f9483b-53f6-4696-b451-52aeb6ec13d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822664747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa330c512f045dc8a5946be3563fdcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52b531e9-3d", "ovs_interfaceid": "52b531e9-3dd1-4fa2-9e5e-17127998ee74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 16:05:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3ed3e4ab-5dc5-4be0-b75f-ba87dcc27544 req-bee5de59-44e5-46f4-bdaf-d7493af5f17d service nova] Releasing lock "refresh_cache-babe1474-6141-4c29-a009-99b61e0c1a05" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 16:05:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "babe1474-6141-4c29-a009-99b61e0c1a05" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:05:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "babe1474-6141-4c29-a009-99b61e0c1a05" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:05:59 user nova-compute[71229]: DEBUG nova.objects.instance [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lazy-loading 'flavor' on Instance uuid babe1474-6141-4c29-a009-99b61e0c1a05 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:05:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "babe1474-6141-4c29-a009-99b61e0c1a05" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:06:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:06:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:06:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:06:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:06:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:06:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:06:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "babe1474-6141-4c29-a009-99b61e0c1a05" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:06:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "babe1474-6141-4c29-a009-99b61e0c1a05" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:06:00 user nova-compute[71229]: INFO nova.compute.manager [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Attaching volume c3ad4959-12c1-4df7-8c6a-c124bf81483b to /dev/vdb
Apr 11 16:06:00 user nova-compute[71229]: DEBUG os_brick.utils [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 16:06:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:06:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:06:00 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdb0817-f4d9-4130-84a8-097139125298]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d55e24a97c90\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:06:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:06:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:06:00 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d3b3fd-f83c-48b5-99a7-222c77500a16]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:06:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:06:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:06:00 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbe267c-2f8f-49d1-8b2f-6e63189772ec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:06:00 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e806689-7bc1-45b9-bf8f-014d8de70ed4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:06:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Running cmd (subprocess): nvme version {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:06:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 'nvme version' failed. Not Retrying. {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 16:06:00 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] nvme not present on system {{(pid=71229) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 16:06:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:06:00 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 16:06:00 user nova-compute[71229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 16:06:00 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ee10fb-ec0e-4d3f-824e-e0efe79454a6]: (4, '') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:06:00 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71229) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 16:06:00 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 16:06:00 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] LIGHTOS: no hostnqn found. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 16:06:00 user nova-compute[71229]: DEBUG os_brick.utils [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d55e24a97c90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 16:06:00 user nova-compute[71229]: DEBUG nova.virt.block_device [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Updating existing volume attachment record: 387303ec-5dc1-4d4c-b235-cdf5bec74b26 {{(pid=71229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 16:06:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:06:04 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 16:06:04 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YymTIhNF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 16:06:04 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 16:06:04 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 16:06:04 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 16:06:04 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 16:06:04 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 16:06:04 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 16:06:04 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 16:06:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:06:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:06:04 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[02da7c4c-fcd2-48c5-91ae-25a57c25f6c2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:06:04 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 16:06:04 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:06:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b -p 172.16.0.220:3260 --interface default --op new {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:06:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:06:04 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eab9949-de3f-413c-b974-b1801007951c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b] added\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:06:04 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b] added
Apr 11 16:06:04 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:06:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:06:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:06:04 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[af71e88b-21b2-4fb0-b719-6eab9f47d757]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:06:04 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:06:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:06:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:06:04 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4eafd3-fcd6-42ac-a480-d3112d9833b7]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:06:04 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:06:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YymTIhNF {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:06:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YymTIhNF" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:06:04 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e883f6-826e-4fec-bc42-84d03ef0ced9]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:06:04 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YymTIhNF'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:06:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:06:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:06:04 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0312a4d9-55fe-4891-b837-9f8bfe80bff0]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:06:04 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:06:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:06:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:06:04 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe306ef-5b58-4539-a362-de1282861bbd]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:06:04 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 11 16:06:04 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 16:06:04 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 11 16:06:04 user nova-compute[71229]:  {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 16:06:04 user nova-compute[71229]: WARNING os_brick.initiator.connectors.iscsi [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 11 16:06:04 user nova-compute[71229]: 
Apr 11 16:06:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b -p 172.16.0.220:3260 --login {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:06:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:06:04 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d88b7e-1a62-4b81-b7f6-59976dc867ed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:06:04 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b, portal: 172.16.0.220,3260]
Apr 11 16:06:04 user nova-compute[71229]: Login to [iface: default, target: iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b, portal: 172.16.0.220,3260] successful.
Apr 11 16:06:04 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:06:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:06:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:06:04 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fba773-6819-4d3b-9902-7300ebc1b03e]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:06:04 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:06:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:06:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:06:04 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c690c02a-9c90-4697-83b5-3f388330d6e1]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:06:04 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b (non-flash)
Apr 11 16:06:04 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 16:06:04 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b (non-flash)
Apr 11 16:06:04 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 16:06:04 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.241s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 16:06:04 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 16:06:04 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 16:06:04 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 16:06:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:06:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:06:04 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75d1e51-2c20-4727-b57a-1427dc486d70]: (4, ('- - 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:06:04 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: None {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 16:06:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:06:05 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 16:06:05 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YymTIhNF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 16:06:05 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.275s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 16:06:05 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] <== connect_volume: return (1277ms) {'type': 'block', 'scsi_wwn': '26361626231646633', 'path': '/dev/sdb'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 16:06:05 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361626231646633', 'path': '/dev/sdb'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 16:06:05 user nova-compute[71229]: DEBUG nova.objects.instance [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lazy-loading 'flavor' on Instance uuid babe1474-6141-4c29-a009-99b61e0c1a05 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:06:05 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 16:06:05 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 16:06:05 user nova-compute[71229]:   <source dev="/dev/sdb"/>
Apr 11 16:06:05 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 16:06:05 user nova-compute[71229]:   <serial>c3ad4959-12c1-4df7-8c6a-c124bf81483b</serial>
Apr 11 16:06:05 user nova-compute[71229]: </disk>
Apr 11 16:06:05 user nova-compute[71229]:  {{(pid=71229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 16:06:05 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 16:06:05 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 16:06:05 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] No VIF found with MAC fa:16:3e:77:dc:ff, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 16:06:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-078f9c53-1921-4bcb-a7e4-82e99a55f9b1 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "babe1474-6141-4c29-a009-99b61e0c1a05" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 5.967s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:06:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:06:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "babe1474-6141-4c29-a009-99b61e0c1a05" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:06:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "babe1474-6141-4c29-a009-99b61e0c1a05" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:06:08 user nova-compute[71229]: DEBUG nova.objects.instance [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lazy-loading 'flavor' on Instance uuid babe1474-6141-4c29-a009-99b61e0c1a05 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:06:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "babe1474-6141-4c29-a009-99b61e0c1a05" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:06:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "babe1474-6141-4c29-a009-99b61e0c1a05" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:06:08 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "babe1474-6141-4c29-a009-99b61e0c1a05" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:06:08 user nova-compute[71229]: INFO nova.compute.manager [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Attaching volume ab44220b-9867-4d21-a0d5-01e6f22f21b3 to /dev/vdc
Apr 11 16:06:08 user nova-compute[71229]: DEBUG os_brick.utils [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 16:06:08 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:06:08 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:06:08 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ecb0bbd-bd4d-46b2-9f50-7acaeb94e66e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d55e24a97c90\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:06:08 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:06:08 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:06:08 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea4ee1d-2cd5-41a7-9dfa-d47505affe9b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:06:08 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:06:08 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:06:08 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9cd096-cd18-4bc9-935b-3d9abfff456c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:06:08 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7a2aea-4b79-4bdf-a3d8-44d849efd511]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:06:08 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Running cmd (subprocess): nvme version {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:06:08 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] 'nvme version' failed. Not Retrying. {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 16:06:08 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] nvme not present on system {{(pid=71229) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 16:06:08 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:06:08 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 16:06:08 user nova-compute[71229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 16:06:08 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c08f0b-50c1-42e1-97c8-ac719da4cc47]: (4, '') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:06:08 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71229) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 16:06:08 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 16:06:08 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] LIGHTOS: no hostnqn found. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 16:06:08 user nova-compute[71229]: DEBUG os_brick.utils [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d55e24a97c90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 16:06:08 user nova-compute[71229]: DEBUG nova.virt.block_device [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Updating existing volume attachment record: 623cbd5a-8f12-40b5-876b-eb3315c97005 {{(pid=71229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 16:06:10 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rWqSBOCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 16:06:12 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 16:06:12 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 16:06:12 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 16:06:12 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 16:06:12 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 16:06:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3 -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[848d09a0-9fd8-4476-b66b-c4dd2e8a6f8a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 16:06:12 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3 -p 172.16.0.220:3260 --interface default --op new {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db614f0-29de-488c-b7d9-0d0990334da4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3] added\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3] added
Apr 11 16:06:12 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[72894042-1940-4771-815a-5b274d065ffd]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3a0e17-dd6f-4f4b-a2eb-0d1c656cf5f4]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rWqSBOCb {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rWqSBOCb" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85806c6-7934-44e8-a6ac-93f3396359db]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rWqSBOCb'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[223377cf-f861-4192-9b13-5e599a5064ce]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf4dc0e-16c9-47e3-9905-a6fc6a27e631]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b (non-flash)
Apr 11 16:06:12 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b (non-flash)
Apr 11 16:06:12 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3 -p 172.16.0.220:3260 --login {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[057d32e3-ebfc-4c25-b9e8-b8a69d5464e7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3, portal: 172.16.0.220,3260]
Apr 11 16:06:12 user nova-compute[71229]: Login to [iface: default, target: iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3, portal: 172.16.0.220,3260] successful.
Apr 11 16:06:12 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5525a9c4-0476-4679-96a0-66f928bbe66a]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b708be12-5eaf-4ad0-ba73-57285a16184d]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b (non-flash)
Apr 11 16:06:12 user nova-compute[71229]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3 (non-flash)
Apr 11 16:06:12 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b (non-flash)
Apr 11 16:06:12 user nova-compute[71229]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3 (non-flash)
Apr 11 16:06:12 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fec4a1b-7c00-43c8-9f94-fde51da63310]: (4, ('- - 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 16:06:12 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rWqSBOCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 16:06:13 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 16:06:13 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23639663266363164', 'path': '/dev/sdc'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 16:06:13 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639663266363164', 'path': '/dev/sdc'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 16:06:13 user nova-compute[71229]: DEBUG nova.objects.instance [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lazy-loading 'flavor' on Instance uuid babe1474-6141-4c29-a009-99b61e0c1a05 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:06:13 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 16:06:13 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 16:06:13 user nova-compute[71229]:   <source dev="/dev/sdc"/>
Apr 11 16:06:13 user nova-compute[71229]:   <target dev="vdc" bus="virtio"/>
Apr 11 16:06:13 user nova-compute[71229]:   <serial>ab44220b-9867-4d21-a0d5-01e6f22f21b3</serial>
Apr 11 16:06:13 user nova-compute[71229]: </disk>
Apr 11 16:06:13 user nova-compute[71229]:  {{(pid=71229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 16:06:14 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 16:06:14 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 16:06:14 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 16:06:14 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] No VIF found with MAC fa:16:3e:77:dc:ff, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 16:06:14 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-36858b0e-f795-4d90-add9-03461e5bcc29 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "babe1474-6141-4c29-a009-99b61e0c1a05" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.019s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:06:15 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:06:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c0b2b29e-f862-4d0c-a173-622e449db565 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "babe1474-6141-4c29-a009-99b61e0c1a05" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:06:15 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c0b2b29e-f862-4d0c-a173-622e449db565 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "babe1474-6141-4c29-a009-99b61e0c1a05" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:06:15 user nova-compute[71229]: INFO nova.compute.manager [None req-c0b2b29e-f862-4d0c-a173-622e449db565 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Detaching volume c3ad4959-12c1-4df7-8c6a-c124bf81483b
Apr 11 16:06:15 user nova-compute[71229]: INFO nova.virt.block_device [None req-c0b2b29e-f862-4d0c-a173-622e449db565 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Attempting to driver detach volume c3ad4959-12c1-4df7-8c6a-c124bf81483b from mountpoint /dev/vdb
Apr 11 16:06:15 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c0b2b29e-f862-4d0c-a173-622e449db565 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Attempting to detach device vdb from instance babe1474-6141-4c29-a009-99b61e0c1a05 from the persistent domain config. {{(pid=71229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 16:06:15 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-c0b2b29e-f862-4d0c-a173-622e449db565 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 16:06:15 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 16:06:15 user nova-compute[71229]:   <source dev="/dev/sdb"/>
Apr 11 16:06:15 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 16:06:15 user nova-compute[71229]:   <serial>c3ad4959-12c1-4df7-8c6a-c124bf81483b</serial>
Apr 11 16:06:15 user nova-compute[71229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 16:06:15 user nova-compute[71229]: </disk>
Apr 11 16:06:15 user nova-compute[71229]:  {{(pid=71229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 16:06:15 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-c0b2b29e-f862-4d0c-a173-622e449db565 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Successfully detached device vdb from instance babe1474-6141-4c29-a009-99b61e0c1a05 from the persistent domain config.
Apr 11 16:06:15 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c0b2b29e-f862-4d0c-a173-622e449db565 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance babe1474-6141-4c29-a009-99b61e0c1a05 from the live domain config. {{(pid=71229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 16:06:15 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-c0b2b29e-f862-4d0c-a173-622e449db565 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 16:06:15 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 16:06:15 user nova-compute[71229]:   <source dev="/dev/sdb"/>
Apr 11 16:06:15 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 16:06:15 user nova-compute[71229]:   <serial>c3ad4959-12c1-4df7-8c6a-c124bf81483b</serial>
Apr 11 16:06:15 user nova-compute[71229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 16:06:15 user nova-compute[71229]: </disk>
Apr 11 16:06:15 user nova-compute[71229]:  {{(pid=71229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 16:06:15 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Received event <DeviceRemovedEvent: 1681229175.8004692, babe1474-6141-4c29-a009-99b61e0c1a05 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71229) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 16:06:15 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-c0b2b29e-f862-4d0c-a173-622e449db565 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance babe1474-6141-4c29-a009-99b61e0c1a05 {{(pid=71229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 16:06:15 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-c0b2b29e-f862-4d0c-a173-622e449db565 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Successfully detached device vdb from instance babe1474-6141-4c29-a009-99b61e0c1a05 from the live domain config.
Apr 11 16:06:15 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0b2b29e-f862-4d0c-a173-622e449db565 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 16:06:15 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b2b29e-f862-4d0c-a173-622e449db565 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YymTIhNF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 16:06:15 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-c0b2b29e-f862-4d0c-a173-622e449db565 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 16:06:15 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-c0b2b29e-f862-4d0c-a173-622e449db565 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 16:06:15 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-c0b2b29e-f862-4d0c-a173-622e449db565 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 16:06:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:06:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:06:15 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd202658-82f9-4af9-a221-190c3c1905a4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:06:15 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b2b29e-f862-4d0c-a173-622e449db565 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 16:06:15 user nova-compute[71229]: No targets found.
Apr 11 16:06:15 user nova-compute[71229]: iSNS:
Apr 11 16:06:15 user nova-compute[71229]: No targets found.
Apr 11 16:06:15 user nova-compute[71229]: STATIC:
Apr 11 16:06:15 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b
Apr 11 16:06:15 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 16:06:15 user nova-compute[71229]:                 Iface Name: default
Apr 11 16:06:15 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3
Apr 11 16:06:15 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 16:06:15 user nova-compute[71229]:                 Iface Name: default
Apr 11 16:06:15 user nova-compute[71229]: FIRMWARE:
Apr 11 16:06:15 user nova-compute[71229]: No targets found.
Apr 11 16:06:15 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 16:06:15 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b2b29e-f862-4d0c-a173-622e449db565 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 16:06:15 user nova-compute[71229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 16:06:15 user nova-compute[71229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71229) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 16:06:15 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b2b29e-f862-4d0c-a173-622e449db565 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b', 0)] {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 16:06:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:06:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:06:15 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4a5c35-a835-43bc-b268-dfd5ebb7a121]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:06:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:06:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:06:15 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66615e7-2976-4aee-95df-6f3d4b59c895]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:06:15 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b2b29e-f862-4d0c-a173-622e449db565 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b (non-flash)
Apr 11 16:06:15 user nova-compute[71229]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3 (non-flash)
Apr 11 16:06:15 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 16:06:15 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b2b29e-f862-4d0c-a173-622e449db565 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b (non-flash)
Apr 11 16:06:15 user nova-compute[71229]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3 (non-flash)
Apr 11 16:06:15 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 16:06:15 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b2b29e-f862-4d0c-a173-622e449db565 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb641c88b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b'): ({'sdb'}, set())}) {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 16:06:15 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-c0b2b29e-f862-4d0c-a173-622e449db565 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Removing single pathed devices sdb {{(pid=71229) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 16:06:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:06:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:06:15 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[58543d44-9536-4bb2-bf3f-04fa92a42dec]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:06:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:06:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:06:15 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9333ecb-8c03-426e-bfd1-89203718e17a]: (4, ('ok\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:06:15 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-c0b2b29e-f862-4d0c-a173-622e449db565 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Flushing IO for device /dev/sdb {{(pid=71229) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 16:06:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:06:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:06:15 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf1e81b-2d6b-49f8-aba2-4c27bd8afbee]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:06:15 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-c0b2b29e-f862-4d0c-a173-622e449db565 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71229) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 16:06:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:06:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:06:15 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[315dbe01-e8d4-4bba-946d-b40fb7d6b18d]: (4, ('1', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:06:15 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-c0b2b29e-f862-4d0c-a173-622e449db565 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 16:06:15 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-c0b2b29e-f862-4d0c-a173-622e449db565 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] SCSI volumes sdb have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 16:06:15 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b2b29e-f862-4d0c-a173-622e449db565 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b')] {{(pid=71229) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 16:06:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:06:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:06:16 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a013652b-64e8-4e41-9a88-883a846e2e0d]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:06:16 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b2b29e-f862-4d0c-a173-622e449db565 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:06:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b -p 172.16.0.220:3260 --logout {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:06:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:06:16 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[872ea404-04c6-4a67-a78b-e9742f012c6b]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:06:16 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b2b29e-f862-4d0c-a173-622e449db565 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b, portal: 172.16.0.220,3260]
Apr 11 16:06:16 user nova-compute[71229]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b, portal: 172.16.0.220,3260] successful.
Apr 11 16:06:16 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:06:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b -p 172.16.0.220:3260 --op delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:06:16 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3ad4959-12c1-4df7-8c6a-c124bf81483b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:06:16 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d886f57c-2885-425f-aac6-1190880e7926]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:06:16 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b2b29e-f862-4d0c-a173-622e449db565 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:06:16 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-c0b2b29e-f862-4d0c-a173-622e449db565 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 16:06:16 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b2b29e-f862-4d0c-a173-622e449db565 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] <== disconnect_volume: return (281ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 16:06:16 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0b2b29e-f862-4d0c-a173-622e449db565 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 16:06:16 user nova-compute[71229]: DEBUG nova.objects.instance [None req-c0b2b29e-f862-4d0c-a173-622e449db565 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lazy-loading 'flavor' on Instance uuid babe1474-6141-4c29-a009-99b61e0c1a05 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:06:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-c0b2b29e-f862-4d0c-a173-622e449db565 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "babe1474-6141-4c29-a009-99b61e0c1a05" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.619s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:06:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:06:17 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4aa1b657-a6ac-4b15-b60e-097b5686d368 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "babe1474-6141-4c29-a009-99b61e0c1a05" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:06:17 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4aa1b657-a6ac-4b15-b60e-097b5686d368 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "babe1474-6141-4c29-a009-99b61e0c1a05" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:06:17 user nova-compute[71229]: INFO nova.compute.manager [None req-4aa1b657-a6ac-4b15-b60e-097b5686d368 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Detaching volume ab44220b-9867-4d21-a0d5-01e6f22f21b3
Apr 11 16:06:17 user nova-compute[71229]: INFO nova.virt.block_device [None req-4aa1b657-a6ac-4b15-b60e-097b5686d368 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Attempting to driver detach volume ab44220b-9867-4d21-a0d5-01e6f22f21b3 from mountpoint /dev/vdc
Apr 11 16:06:17 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-4aa1b657-a6ac-4b15-b60e-097b5686d368 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Attempting to detach device vdc from instance babe1474-6141-4c29-a009-99b61e0c1a05 from the persistent domain config. {{(pid=71229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 16:06:17 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-4aa1b657-a6ac-4b15-b60e-097b5686d368 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 16:06:17 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 16:06:17 user nova-compute[71229]:   <source dev="/dev/sdc"/>
Apr 11 16:06:17 user nova-compute[71229]:   <target dev="vdc" bus="virtio"/>
Apr 11 16:06:17 user nova-compute[71229]:   <serial>ab44220b-9867-4d21-a0d5-01e6f22f21b3</serial>
Apr 11 16:06:17 user nova-compute[71229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 11 16:06:17 user nova-compute[71229]: </disk>
Apr 11 16:06:17 user nova-compute[71229]:  {{(pid=71229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 16:06:17 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-4aa1b657-a6ac-4b15-b60e-097b5686d368 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Successfully detached device vdc from instance babe1474-6141-4c29-a009-99b61e0c1a05 from the persistent domain config.
Apr 11 16:06:17 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-4aa1b657-a6ac-4b15-b60e-097b5686d368 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance babe1474-6141-4c29-a009-99b61e0c1a05 from the live domain config. {{(pid=71229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 16:06:17 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-4aa1b657-a6ac-4b15-b60e-097b5686d368 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 16:06:17 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 16:06:17 user nova-compute[71229]:   <source dev="/dev/sdc"/>
Apr 11 16:06:17 user nova-compute[71229]:   <target dev="vdc" bus="virtio"/>
Apr 11 16:06:17 user nova-compute[71229]:   <serial>ab44220b-9867-4d21-a0d5-01e6f22f21b3</serial>
Apr 11 16:06:17 user nova-compute[71229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 11 16:06:17 user nova-compute[71229]: </disk>
Apr 11 16:06:17 user nova-compute[71229]:  {{(pid=71229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 16:06:18 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Received event <DeviceRemovedEvent: 1681229178.158809, babe1474-6141-4c29-a009-99b61e0c1a05 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71229) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 16:06:18 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-4aa1b657-a6ac-4b15-b60e-097b5686d368 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance babe1474-6141-4c29-a009-99b61e0c1a05 {{(pid=71229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 16:06:18 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-4aa1b657-a6ac-4b15-b60e-097b5686d368 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Successfully detached device vdc from instance babe1474-6141-4c29-a009-99b61e0c1a05 from the live domain config.
Apr 11 16:06:18 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4aa1b657-a6ac-4b15-b60e-097b5686d368 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 16:06:18 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa1b657-a6ac-4b15-b60e-097b5686d368 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rWqSBOCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 16:06:18 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-4aa1b657-a6ac-4b15-b60e-097b5686d368 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 16:06:18 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-4aa1b657-a6ac-4b15-b60e-097b5686d368 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 16:06:18 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-4aa1b657-a6ac-4b15-b60e-097b5686d368 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 16:06:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:06:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:06:18 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9514b56f-bea1-4bbb-bd0d-c2e6dc0a7a80]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:06:18 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa1b657-a6ac-4b15-b60e-097b5686d368 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 16:06:18 user nova-compute[71229]: No targets found.
Apr 11 16:06:18 user nova-compute[71229]: iSNS:
Apr 11 16:06:18 user nova-compute[71229]: No targets found.
Apr 11 16:06:18 user nova-compute[71229]: STATIC:
Apr 11 16:06:18 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3
Apr 11 16:06:18 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 16:06:18 user nova-compute[71229]:                 Iface Name: default
Apr 11 16:06:18 user nova-compute[71229]: FIRMWARE:
Apr 11 16:06:18 user nova-compute[71229]: No targets found.
Apr 11 16:06:18 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 16:06:18 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa1b657-a6ac-4b15-b60e-097b5686d368 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 16:06:18 user nova-compute[71229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 16:06:18 user nova-compute[71229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71229) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 16:06:18 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa1b657-a6ac-4b15-b60e-097b5686d368 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3', 0)] {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 16:06:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:06:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:06:18 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6521592-336f-4c37-b2b6-2e866193c8e9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:06:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:06:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:06:18 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4855a0-d0b3-4f68-9b07-f1a0105a9955]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:06:18 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa1b657-a6ac-4b15-b60e-097b5686d368 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3 (non-flash)
Apr 11 16:06:18 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 16:06:18 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa1b657-a6ac-4b15-b60e-097b5686d368 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3 (non-flash)
Apr 11 16:06:18 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 16:06:18 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa1b657-a6ac-4b15-b60e-097b5686d368 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb5c2397e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3'): ({'sdc'}, set())}) {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 16:06:18 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-4aa1b657-a6ac-4b15-b60e-097b5686d368 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Removing single pathed devices sdc {{(pid=71229) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 16:06:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:06:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:06:18 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[df572cd6-c916-4542-8de8-ebc3fc0819bb]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:06:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:06:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:06:18 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e992819-e42a-4821-af1f-457b0572f471]: (4, ('ok\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:06:18 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-4aa1b657-a6ac-4b15-b60e-097b5686d368 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Flushing IO for device /dev/sdc {{(pid=71229) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 16:06:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:06:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:06:18 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[485f54c4-9346-4ac9-97b1-5a6b38f58b27]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:06:18 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-4aa1b657-a6ac-4b15-b60e-097b5686d368 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71229) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 16:06:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:06:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:06:18 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed98bd1-1086-44b3-bb30-e91255fcf701]: (4, ('1', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:06:18 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-4aa1b657-a6ac-4b15-b60e-097b5686d368 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 16:06:18 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-4aa1b657-a6ac-4b15-b60e-097b5686d368 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] SCSI volumes sdc have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 16:06:18 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa1b657-a6ac-4b15-b60e-097b5686d368 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3')] {{(pid=71229) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 16:06:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:06:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:06:18 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[47342df3-b386-4e22-bff8-35a21b394418]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:06:18 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa1b657-a6ac-4b15-b60e-097b5686d368 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:06:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3 -p 172.16.0.220:3260 --logout {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:06:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:06:18 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[819a3f1b-747b-4fcd-83ec-803d075d2064]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:06:18 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa1b657-a6ac-4b15-b60e-097b5686d368 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3, portal: 172.16.0.220,3260]
Apr 11 16:06:18 user nova-compute[71229]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3, portal: 172.16.0.220,3260] successful.
Apr 11 16:06:18 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:06:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3 -p 172.16.0.220:3260 --op delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:06:18 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab44220b-9867-4d21-a0d5-01e6f22f21b3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:06:18 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be12891-af18-4bd3-8e0e-e8cce387f3ef]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:06:18 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa1b657-a6ac-4b15-b60e-097b5686d368 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:06:18 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-4aa1b657-a6ac-4b15-b60e-097b5686d368 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.265s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 16:06:18 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa1b657-a6ac-4b15-b60e-097b5686d368 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] <== disconnect_volume: return (267ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 16:06:18 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4aa1b657-a6ac-4b15-b60e-097b5686d368 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 16:06:19 user nova-compute[71229]: DEBUG nova.objects.instance [None req-4aa1b657-a6ac-4b15-b60e-097b5686d368 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lazy-loading 'flavor' on Instance uuid babe1474-6141-4c29-a009-99b61e0c1a05 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:06:19 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4aa1b657-a6ac-4b15-b60e-097b5686d368 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "babe1474-6141-4c29-a009-99b61e0c1a05" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.544s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:06:20 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:06:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-7bd1234e-7ad9-46d5-809d-c5a6f7e4c8d2 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "babe1474-6141-4c29-a009-99b61e0c1a05" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:06:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-7bd1234e-7ad9-46d5-809d-c5a6f7e4c8d2 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "babe1474-6141-4c29-a009-99b61e0c1a05" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:06:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-7bd1234e-7ad9-46d5-809d-c5a6f7e4c8d2 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "babe1474-6141-4c29-a009-99b61e0c1a05-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:06:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-7bd1234e-7ad9-46d5-809d-c5a6f7e4c8d2 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "babe1474-6141-4c29-a009-99b61e0c1a05-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:06:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-7bd1234e-7ad9-46d5-809d-c5a6f7e4c8d2 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "babe1474-6141-4c29-a009-99b61e0c1a05-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:06:20 user nova-compute[71229]: INFO nova.compute.manager [None req-7bd1234e-7ad9-46d5-809d-c5a6f7e4c8d2 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Terminating instance
Apr 11 16:06:20 user nova-compute[71229]: DEBUG nova.compute.manager [None req-7bd1234e-7ad9-46d5-809d-c5a6f7e4c8d2 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Start destroying the instance on the hypervisor. {{(pid=71229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 16:06:20 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:06:20 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:06:20 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:06:20 user nova-compute[71229]: DEBUG nova.compute.manager [req-8199ef75-9ca8-4f97-bb87-148b0778b532 req-5fa6083f-533f-4c5a-ac0b-e32261766fe3 service nova] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Received event network-vif-unplugged-52b531e9-3dd1-4fa2-9e5e-17127998ee74 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:06:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-8199ef75-9ca8-4f97-bb87-148b0778b532 req-5fa6083f-533f-4c5a-ac0b-e32261766fe3 service nova] Acquiring lock "babe1474-6141-4c29-a009-99b61e0c1a05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:06:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-8199ef75-9ca8-4f97-bb87-148b0778b532 req-5fa6083f-533f-4c5a-ac0b-e32261766fe3 service nova] Lock "babe1474-6141-4c29-a009-99b61e0c1a05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:06:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-8199ef75-9ca8-4f97-bb87-148b0778b532 req-5fa6083f-533f-4c5a-ac0b-e32261766fe3 service nova] Lock "babe1474-6141-4c29-a009-99b61e0c1a05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:06:20 user nova-compute[71229]: DEBUG nova.compute.manager [req-8199ef75-9ca8-4f97-bb87-148b0778b532 req-5fa6083f-533f-4c5a-ac0b-e32261766fe3 service nova] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] No waiting events found dispatching network-vif-unplugged-52b531e9-3dd1-4fa2-9e5e-17127998ee74 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 16:06:20 user nova-compute[71229]: DEBUG nova.compute.manager [req-8199ef75-9ca8-4f97-bb87-148b0778b532 req-5fa6083f-533f-4c5a-ac0b-e32261766fe3 service nova] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Received event network-vif-unplugged-52b531e9-3dd1-4fa2-9e5e-17127998ee74 for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 16:06:20 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:06:21 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Instance destroyed successfully.
Apr 11 16:06:21 user nova-compute[71229]: DEBUG nova.objects.instance [None req-7bd1234e-7ad9-46d5-809d-c5a6f7e4c8d2 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lazy-loading 'resources' on Instance uuid babe1474-6141-4c29-a009-99b61e0c1a05 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:06:21 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-7bd1234e-7ad9-46d5-809d-c5a6f7e4c8d2 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T16:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-710249164',display_name='tempest-AttachVolumeTestJSON-server-710249164',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-710249164',id=41,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3Vd/gPFHz73t2nUBm8NxBQLIDsgPm1EYQOBLUif7Y740J+h2EGFkfTc7lHtnfvKweVN3WVhYM4TjSp+rH5npDx4XBTO229iAcUP9TXjmix55FPHQC3XqKMkif0pTVxFw==',key_name='tempest-keypair-1137335061',keypairs=<?>,launch_index=0,launched_at=2023-04-11T16:04:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8fa330c512f045dc8a5946be3563fdcd',ramdisk_id='',reservation_id='r-1fiedpl3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1691938977',owner_user_name='tempest-AttachVolumeTestJSON-1691938977-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T16:04:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa87f179b35a4d1db2336802e8f104e4',uuid=babe1474-6141-4c29-a009-99b61e0c1a05,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "52b531e9-3dd1-4fa2-9e5e-17127998ee74", "address": "fa:16:3e:77:dc:ff", "network": {"id": "e6f9483b-53f6-4696-b451-52aeb6ec13d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822664747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa330c512f045dc8a5946be3563fdcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52b531e9-3d", "ovs_interfaceid": "52b531e9-3dd1-4fa2-9e5e-17127998ee74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 16:06:21 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-7bd1234e-7ad9-46d5-809d-c5a6f7e4c8d2 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Converting VIF {"id": "52b531e9-3dd1-4fa2-9e5e-17127998ee74", "address": "fa:16:3e:77:dc:ff", "network": {"id": "e6f9483b-53f6-4696-b451-52aeb6ec13d3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1822664747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa330c512f045dc8a5946be3563fdcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52b531e9-3d", "ovs_interfaceid": "52b531e9-3dd1-4fa2-9e5e-17127998ee74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 16:06:21 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-7bd1234e-7ad9-46d5-809d-c5a6f7e4c8d2 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:dc:ff,bridge_name='br-int',has_traffic_filtering=True,id=52b531e9-3dd1-4fa2-9e5e-17127998ee74,network=Network(e6f9483b-53f6-4696-b451-52aeb6ec13d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52b531e9-3d') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 16:06:21 user nova-compute[71229]: DEBUG os_vif [None req-7bd1234e-7ad9-46d5-809d-c5a6f7e4c8d2 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:dc:ff,bridge_name='br-int',has_traffic_filtering=True,id=52b531e9-3dd1-4fa2-9e5e-17127998ee74,network=Network(e6f9483b-53f6-4696-b451-52aeb6ec13d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52b531e9-3d') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 16:06:21 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:06:21 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap52b531e9-3d, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 16:06:21 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:06:21 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:06:21 user nova-compute[71229]: INFO os_vif [None req-7bd1234e-7ad9-46d5-809d-c5a6f7e4c8d2 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:dc:ff,bridge_name='br-int',has_traffic_filtering=True,id=52b531e9-3dd1-4fa2-9e5e-17127998ee74,network=Network(e6f9483b-53f6-4696-b451-52aeb6ec13d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52b531e9-3d')
Apr 11 16:06:21 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-7bd1234e-7ad9-46d5-809d-c5a6f7e4c8d2 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Deleting instance files /opt/stack/data/nova/instances/babe1474-6141-4c29-a009-99b61e0c1a05_del
Apr 11 16:06:21 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-7bd1234e-7ad9-46d5-809d-c5a6f7e4c8d2 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Deletion of /opt/stack/data/nova/instances/babe1474-6141-4c29-a009-99b61e0c1a05_del complete
Apr 11 16:06:21 user nova-compute[71229]: INFO nova.compute.manager [None req-7bd1234e-7ad9-46d5-809d-c5a6f7e4c8d2 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 11 16:06:21 user nova-compute[71229]: DEBUG oslo.service.loopingcall [None req-7bd1234e-7ad9-46d5-809d-c5a6f7e4c8d2 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71229) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 16:06:21 user nova-compute[71229]: DEBUG nova.compute.manager [-] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Deallocating network for instance {{(pid=71229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 16:06:21 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] deallocate_for_instance() {{(pid=71229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 16:06:22 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 16:06:22 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Took 0.96 seconds to deallocate network for instance.
Apr 11 16:06:22 user nova-compute[71229]: DEBUG nova.compute.manager [req-1520238e-bb29-4645-ad05-92c2fd63d347 req-f810c3fd-4c5b-4faf-a719-01f3d4deca9f service nova] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Received event network-vif-deleted-52b531e9-3dd1-4fa2-9e5e-17127998ee74 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:06:22 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-7bd1234e-7ad9-46d5-809d-c5a6f7e4c8d2 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:06:22 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-7bd1234e-7ad9-46d5-809d-c5a6f7e4c8d2 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:06:22 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-7bd1234e-7ad9-46d5-809d-c5a6f7e4c8d2 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 16:06:22 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-7bd1234e-7ad9-46d5-809d-c5a6f7e4c8d2 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 16:06:22 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-7bd1234e-7ad9-46d5-809d-c5a6f7e4c8d2 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.114s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:06:22 user nova-compute[71229]: INFO nova.scheduler.client.report [None req-7bd1234e-7ad9-46d5-809d-c5a6f7e4c8d2 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Deleted allocations for instance babe1474-6141-4c29-a009-99b61e0c1a05
Apr 11 16:06:22 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-7bd1234e-7ad9-46d5-809d-c5a6f7e4c8d2 tempest-AttachVolumeTestJSON-1691938977 tempest-AttachVolumeTestJSON-1691938977-project-member] Lock "babe1474-6141-4c29-a009-99b61e0c1a05" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.220s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:06:22 user nova-compute[71229]: DEBUG nova.compute.manager [req-f7fcbbcf-269a-48c0-8c4f-202d277a7ee8 req-26842d9e-685b-428d-98d4-ded3f3f6c743 service nova] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Received event network-vif-plugged-52b531e9-3dd1-4fa2-9e5e-17127998ee74 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:06:22 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-f7fcbbcf-269a-48c0-8c4f-202d277a7ee8 req-26842d9e-685b-428d-98d4-ded3f3f6c743 service nova] Acquiring lock "babe1474-6141-4c29-a009-99b61e0c1a05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:06:22 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-f7fcbbcf-269a-48c0-8c4f-202d277a7ee8 req-26842d9e-685b-428d-98d4-ded3f3f6c743 service nova] Lock "babe1474-6141-4c29-a009-99b61e0c1a05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:06:22 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-f7fcbbcf-269a-48c0-8c4f-202d277a7ee8 req-26842d9e-685b-428d-98d4-ded3f3f6c743 service nova] Lock "babe1474-6141-4c29-a009-99b61e0c1a05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:06:22 user nova-compute[71229]: DEBUG nova.compute.manager [req-f7fcbbcf-269a-48c0-8c4f-202d277a7ee8 req-26842d9e-685b-428d-98d4-ded3f3f6c743 service nova] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] No waiting events found dispatching network-vif-plugged-52b531e9-3dd1-4fa2-9e5e-17127998ee74 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 16:06:22 user nova-compute[71229]: WARNING nova.compute.manager [req-f7fcbbcf-269a-48c0-8c4f-202d277a7ee8 req-26842d9e-685b-428d-98d4-ded3f3f6c743 service nova] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Received unexpected event network-vif-plugged-52b531e9-3dd1-4fa2-9e5e-17127998ee74 for instance with vm_state deleted and task_state None.
Apr 11 16:06:24 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:06:24 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 16:06:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:06:30 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:06:30 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 16:06:30 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Rebuilding the list of instances to heal {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 16:06:30 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Didn't find any instances for network info cache update. {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 16:06:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:06:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:06:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:06:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:06:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:06:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:06:32 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:06:32 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:06:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:06:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:06:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:06:32 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 16:06:33 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:06:33 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:06:33 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8938MB free_disk=25.99468231201172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 16:06:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:06:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:06:33 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 16:06:33 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 16:06:33 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 16:06:33 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 16:06:33 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 16:06:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:06:34 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:06:35 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:06:35 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:06:36 user nova-compute[71229]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681229181.0734055, babe1474-6141-4c29-a009-99b61e0c1a05 => Stopped> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 16:06:36 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] VM Stopped (Lifecycle Event)
Apr 11 16:06:36 user nova-compute[71229]: DEBUG nova.compute.manager [None req-adff5542-963d-4c40-a6c0-fa5c3bb613a1 None None] [instance: babe1474-6141-4c29-a009-99b61e0c1a05] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 16:06:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:06:36 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:06:39 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:06:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:06:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:06:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:06:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:06:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:06:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:06:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:06:51 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:06:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:06:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:06:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:06:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:06:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:06:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:07:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:07:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:07:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:07:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:07:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:07:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:07:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:07:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:07:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:07:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:07:18 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:07:21 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:07:24 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:07:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:07:26 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:07:26 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 16:07:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:07:27 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:07:28 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:07:28 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Cleaning up deleted instances {{(pid=71229) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 16:07:28 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] There are 0 instances to clean {{(pid=71229) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 16:07:29 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "9f0473cd-bfe6-4b1c-83d0-6ede26811743" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:07:29 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "9f0473cd-bfe6-4b1c-83d0-6ede26811743" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:07:29 user nova-compute[71229]: DEBUG nova.compute.manager [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Starting instance... {{(pid=71229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 16:07:29 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:07:29 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:07:29 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 16:07:29 user nova-compute[71229]: INFO nova.compute.claims [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Claim successful on node user
Apr 11 16:07:29 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 16:07:29 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 16:07:29 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.176s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:07:29 user nova-compute[71229]: DEBUG nova.compute.manager [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Start building networks asynchronously for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 16:07:29 user nova-compute[71229]: DEBUG nova.compute.manager [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Allocating IP information in the background. {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 16:07:29 user nova-compute[71229]: DEBUG nova.network.neutron [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] allocate_for_instance() {{(pid=71229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 16:07:30 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 16:07:30 user nova-compute[71229]: DEBUG nova.compute.manager [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Start building block device mappings for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 16:07:30 user nova-compute[71229]: DEBUG nova.policy [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1332668b568e41a98bb68f6c28c92db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6241b8bab90c4f1991413b84c5241baf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71229) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 16:07:30 user nova-compute[71229]: DEBUG nova.compute.manager [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Start spawning the instance on the hypervisor. {{(pid=71229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 16:07:30 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Creating instance directory {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 16:07:30 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Creating image(s)
Apr 11 16:07:30 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "/opt/stack/data/nova/instances/9f0473cd-bfe6-4b1c-83d0-6ede26811743/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:07:30 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "/opt/stack/data/nova/instances/9f0473cd-bfe6-4b1c-83d0-6ede26811743/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:07:30 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "/opt/stack/data/nova/instances/9f0473cd-bfe6-4b1c-83d0-6ede26811743/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:07:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:07:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.150s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:07:30 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:07:30 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:07:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:07:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.142s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:07:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/9f0473cd-bfe6-4b1c-83d0-6ede26811743/disk 1073741824 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:07:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/9f0473cd-bfe6-4b1c-83d0-6ede26811743/disk 1073741824" returned: 0 in 0.054s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:07:30 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:07:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:07:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.129s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:07:30 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9f0473cd-bfe6-4b1c-83d0-6ede26811743/disk. size=1073741824 {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 16:07:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0473cd-bfe6-4b1c-83d0-6ede26811743/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:07:30 user nova-compute[71229]: DEBUG nova.network.neutron [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Successfully created port: 44472973-4f12-49d0-bab1-930a57c5a234 {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 16:07:30 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0473cd-bfe6-4b1c-83d0-6ede26811743/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:07:30 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Cannot resize image /opt/stack/data/nova/instances/9f0473cd-bfe6-4b1c-83d0-6ede26811743/disk to a smaller size. {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 16:07:30 user nova-compute[71229]: DEBUG nova.objects.instance [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lazy-loading 'migration_context' on Instance uuid 9f0473cd-bfe6-4b1c-83d0-6ede26811743 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:07:30 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Created local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 16:07:30 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Ensure instance console log exists: /opt/stack/data/nova/instances/9f0473cd-bfe6-4b1c-83d0-6ede26811743/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 16:07:30 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:07:30 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:07:30 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:07:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:07:31 user nova-compute[71229]: DEBUG nova.network.neutron [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Successfully updated port: 44472973-4f12-49d0-bab1-930a57c5a234 {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 16:07:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "refresh_cache-9f0473cd-bfe6-4b1c-83d0-6ede26811743" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 16:07:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquired lock "refresh_cache-9f0473cd-bfe6-4b1c-83d0-6ede26811743" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 16:07:31 user nova-compute[71229]: DEBUG nova.network.neutron [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 16:07:31 user nova-compute[71229]: DEBUG nova.compute.manager [req-8fe54422-666d-4e3a-a866-44c013814d52 req-2ebb8a1f-33da-4b30-9ece-6f435513a367 service nova] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Received event network-changed-44472973-4f12-49d0-bab1-930a57c5a234 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:07:31 user nova-compute[71229]: DEBUG nova.compute.manager [req-8fe54422-666d-4e3a-a866-44c013814d52 req-2ebb8a1f-33da-4b30-9ece-6f435513a367 service nova] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Refreshing instance network info cache due to event network-changed-44472973-4f12-49d0-bab1-930a57c5a234. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 16:07:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-8fe54422-666d-4e3a-a866-44c013814d52 req-2ebb8a1f-33da-4b30-9ece-6f435513a367 service nova] Acquiring lock "refresh_cache-9f0473cd-bfe6-4b1c-83d0-6ede26811743" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 16:07:31 user nova-compute[71229]: DEBUG nova.network.neutron [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 16:07:31 user nova-compute[71229]: DEBUG nova.network.neutron [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Updating instance_info_cache with network_info: [{"id": "44472973-4f12-49d0-bab1-930a57c5a234", "address": "fa:16:3e:57:d2:ab", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44472973-4f", "ovs_interfaceid": "44472973-4f12-49d0-bab1-930a57c5a234", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 16:07:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Releasing lock "refresh_cache-9f0473cd-bfe6-4b1c-83d0-6ede26811743" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 16:07:31 user nova-compute[71229]: DEBUG nova.compute.manager [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Instance network_info: |[{"id": "44472973-4f12-49d0-bab1-930a57c5a234", "address": "fa:16:3e:57:d2:ab", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44472973-4f", "ovs_interfaceid": "44472973-4f12-49d0-bab1-930a57c5a234", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 16:07:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-8fe54422-666d-4e3a-a866-44c013814d52 req-2ebb8a1f-33da-4b30-9ece-6f435513a367 service nova] Acquired lock "refresh_cache-9f0473cd-bfe6-4b1c-83d0-6ede26811743" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 16:07:31 user nova-compute[71229]: DEBUG nova.network.neutron [req-8fe54422-666d-4e3a-a866-44c013814d52 req-2ebb8a1f-33da-4b30-9ece-6f435513a367 service nova] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Refreshing network info cache for port 44472973-4f12-49d0-bab1-930a57c5a234 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 16:07:31 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Start _get_guest_xml network_info=[{"id": "44472973-4f12-49d0-bab1-930a57c5a234", "address": "fa:16:3e:57:d2:ab", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44472973-4f", "ovs_interfaceid": "44472973-4f12-49d0-bab1-930a57c5a234", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '52fe638c-5ada-47d5-b376-233bfa808a37'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 16:07:31 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:07:31 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:07:31 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 16:07:31 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 16:07:31 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 16:07:31 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 16:07:31 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 16:07:31 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 16:07:31 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 16:07:31 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 16:07:31 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 16:07:31 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 16:07:31 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 16:07:31 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 16:07:31 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T16:07:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1014812344',display_name='tempest-AttachVolumeNegativeTest-server-1014812344',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1014812344',id=42,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZlx+pLUniXvWrJxlxiw5Q+BoJuFNLs4p2kBVBWKeduQ8+tLSOSPSY9wKUYy0gnOh+MHugFjOkVfE6Zpf/rtzSv/FPhR8I4RBXImWMlF3W7sSu4IRSYaCGk6aSma3hmjA==',key_name='tempest-keypair-1339074440',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6241b8bab90c4f1991413b84c5241baf',ramdisk_id='',reservation_id='r-jk80mvfn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-537147684',owner_user_name='tempest-AttachVolumeNegativeTest-537147684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T16:07:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1332668b568e41a98bb68f6c28c92db9',uuid=9f0473cd-bfe6-4b1c-83d0-6ede26811743,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44472973-4f12-49d0-bab1-930a57c5a234", "address": "fa:16:3e:57:d2:ab", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44472973-4f", "ovs_interfaceid": "44472973-4f12-49d0-bab1-930a57c5a234", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 16:07:31 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Converting VIF {"id": "44472973-4f12-49d0-bab1-930a57c5a234", "address": "fa:16:3e:57:d2:ab", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44472973-4f", "ovs_interfaceid": "44472973-4f12-49d0-bab1-930a57c5a234", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 16:07:31 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:d2:ab,bridge_name='br-int',has_traffic_filtering=True,id=44472973-4f12-49d0-bab1-930a57c5a234,network=Network(c3def4c9-33a3-48eb-ad5c-45bb499758ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44472973-4f') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 16:07:31 user nova-compute[71229]: DEBUG nova.objects.instance [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lazy-loading 'pci_devices' on Instance uuid 9f0473cd-bfe6-4b1c-83d0-6ede26811743 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:07:31 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] End _get_guest_xml xml=<domain type="kvm">
Apr 11 16:07:31 user nova-compute[71229]:   <uuid>9f0473cd-bfe6-4b1c-83d0-6ede26811743</uuid>
Apr 11 16:07:31 user nova-compute[71229]:   <name>instance-0000002a</name>
Apr 11 16:07:31 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 16:07:31 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 16:07:31 user nova-compute[71229]:   <metadata>
Apr 11 16:07:31 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 16:07:31 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 16:07:31 user nova-compute[71229]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1014812344</nova:name>
Apr 11 16:07:31 user nova-compute[71229]:       <nova:creationTime>2023-04-11 16:07:31</nova:creationTime>
Apr 11 16:07:31 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 16:07:31 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 16:07:31 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 16:07:31 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 16:07:31 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 16:07:31 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 16:07:31 user nova-compute[71229]:       </nova:flavor>
Apr 11 16:07:31 user nova-compute[71229]:       <nova:owner>
Apr 11 16:07:31 user nova-compute[71229]:         <nova:user uuid="1332668b568e41a98bb68f6c28c92db9">tempest-AttachVolumeNegativeTest-537147684-project-member</nova:user>
Apr 11 16:07:31 user nova-compute[71229]:         <nova:project uuid="6241b8bab90c4f1991413b84c5241baf">tempest-AttachVolumeNegativeTest-537147684</nova:project>
Apr 11 16:07:31 user nova-compute[71229]:       </nova:owner>
Apr 11 16:07:31 user nova-compute[71229]:       <nova:root type="image" uuid="52fe638c-5ada-47d5-b376-233bfa808a37"/>
Apr 11 16:07:31 user nova-compute[71229]:       <nova:ports>
Apr 11 16:07:31 user nova-compute[71229]:         <nova:port uuid="44472973-4f12-49d0-bab1-930a57c5a234">
Apr 11 16:07:31 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 11 16:07:31 user nova-compute[71229]:         </nova:port>
Apr 11 16:07:31 user nova-compute[71229]:       </nova:ports>
Apr 11 16:07:31 user nova-compute[71229]:     </nova:instance>
Apr 11 16:07:31 user nova-compute[71229]:   </metadata>
Apr 11 16:07:31 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 16:07:31 user nova-compute[71229]:     <system>
Apr 11 16:07:31 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 16:07:31 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 16:07:31 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 16:07:31 user nova-compute[71229]:       <entry name="serial">9f0473cd-bfe6-4b1c-83d0-6ede26811743</entry>
Apr 11 16:07:31 user nova-compute[71229]:       <entry name="uuid">9f0473cd-bfe6-4b1c-83d0-6ede26811743</entry>
Apr 11 16:07:31 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 16:07:31 user nova-compute[71229]:     </system>
Apr 11 16:07:31 user nova-compute[71229]:   </sysinfo>
Apr 11 16:07:31 user nova-compute[71229]:   <os>
Apr 11 16:07:31 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 16:07:31 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 16:07:31 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 16:07:31 user nova-compute[71229]:   </os>
Apr 11 16:07:31 user nova-compute[71229]:   <features>
Apr 11 16:07:31 user nova-compute[71229]:     <acpi/>
Apr 11 16:07:31 user nova-compute[71229]:     <apic/>
Apr 11 16:07:31 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 16:07:31 user nova-compute[71229]:   </features>
Apr 11 16:07:31 user nova-compute[71229]:   <clock offset="utc">
Apr 11 16:07:31 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 16:07:31 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 16:07:31 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 16:07:31 user nova-compute[71229]:   </clock>
Apr 11 16:07:31 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 16:07:31 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 16:07:31 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 16:07:31 user nova-compute[71229]:   </cpu>
Apr 11 16:07:31 user nova-compute[71229]:   <devices>
Apr 11 16:07:31 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 16:07:31 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 16:07:31 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/9f0473cd-bfe6-4b1c-83d0-6ede26811743/disk"/>
Apr 11 16:07:31 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 16:07:31 user nova-compute[71229]:     </disk>
Apr 11 16:07:31 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 16:07:31 user nova-compute[71229]:       <mac address="fa:16:3e:57:d2:ab"/>
Apr 11 16:07:31 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 16:07:31 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 16:07:31 user nova-compute[71229]:       <target dev="tap44472973-4f"/>
Apr 11 16:07:31 user nova-compute[71229]:     </interface>
Apr 11 16:07:31 user nova-compute[71229]:     <serial type="pty">
Apr 11 16:07:31 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/9f0473cd-bfe6-4b1c-83d0-6ede26811743/console.log" append="off"/>
Apr 11 16:07:31 user nova-compute[71229]:     </serial>
Apr 11 16:07:31 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 16:07:31 user nova-compute[71229]:     <video>
Apr 11 16:07:31 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 16:07:31 user nova-compute[71229]:     </video>
Apr 11 16:07:31 user nova-compute[71229]:     <rng model="virtio">
Apr 11 16:07:31 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 16:07:31 user nova-compute[71229]:     </rng>
Apr 11 16:07:31 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 16:07:31 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 16:07:31 user nova-compute[71229]:       <stats period="10"/>
Apr 11 16:07:31 user nova-compute[71229]:     </memballoon>
Apr 11 16:07:31 user nova-compute[71229]:   </devices>
Apr 11 16:07:31 user nova-compute[71229]: </domain>
Apr 11 16:07:31 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 16:07:31 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T16:07:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1014812344',display_name='tempest-AttachVolumeNegativeTest-server-1014812344',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1014812344',id=42,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZlx+pLUniXvWrJxlxiw5Q+BoJuFNLs4p2kBVBWKeduQ8+tLSOSPSY9wKUYy0gnOh+MHugFjOkVfE6Zpf/rtzSv/FPhR8I4RBXImWMlF3W7sSu4IRSYaCGk6aSma3hmjA==',key_name='tempest-keypair-1339074440',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6241b8bab90c4f1991413b84c5241baf',ramdisk_id='',reservation_id='r-jk80mvfn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-537147684',owner_user_name='tempest-AttachVolumeNegativeTest-537147684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T16:07:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1332668b568e41a98bb68f6c28c92db9',uuid=9f0473cd-bfe6-4b1c-83d0-6ede26811743,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44472973-4f12-49d0-bab1-930a57c5a234", "address": "fa:16:3e:57:d2:ab", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44472973-4f", "ovs_interfaceid": "44472973-4f12-49d0-bab1-930a57c5a234", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 16:07:31 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Converting VIF {"id": "44472973-4f12-49d0-bab1-930a57c5a234", "address": "fa:16:3e:57:d2:ab", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44472973-4f", "ovs_interfaceid": "44472973-4f12-49d0-bab1-930a57c5a234", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 16:07:31 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:d2:ab,bridge_name='br-int',has_traffic_filtering=True,id=44472973-4f12-49d0-bab1-930a57c5a234,network=Network(c3def4c9-33a3-48eb-ad5c-45bb499758ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44472973-4f') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 16:07:31 user nova-compute[71229]: DEBUG os_vif [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:d2:ab,bridge_name='br-int',has_traffic_filtering=True,id=44472973-4f12-49d0-bab1-930a57c5a234,network=Network(c3def4c9-33a3-48eb-ad5c-45bb499758ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44472973-4f') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 16:07:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:07:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 16:07:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 16:07:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:07:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap44472973-4f, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 16:07:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap44472973-4f, col_values=(('external_ids', {'iface-id': '44472973-4f12-49d0-bab1-930a57c5a234', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:d2:ab', 'vm-uuid': '9f0473cd-bfe6-4b1c-83d0-6ede26811743'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 16:07:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:07:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:07:31 user nova-compute[71229]: INFO os_vif [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:d2:ab,bridge_name='br-int',has_traffic_filtering=True,id=44472973-4f12-49d0-bab1-930a57c5a234,network=Network(c3def4c9-33a3-48eb-ad5c-45bb499758ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44472973-4f')
Apr 11 16:07:31 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 16:07:31 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] No VIF found with MAC fa:16:3e:57:d2:ab, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 16:07:32 user nova-compute[71229]: DEBUG nova.network.neutron [req-8fe54422-666d-4e3a-a866-44c013814d52 req-2ebb8a1f-33da-4b30-9ece-6f435513a367 service nova] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Updated VIF entry in instance network info cache for port 44472973-4f12-49d0-bab1-930a57c5a234. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 16:07:32 user nova-compute[71229]: DEBUG nova.network.neutron [req-8fe54422-666d-4e3a-a866-44c013814d52 req-2ebb8a1f-33da-4b30-9ece-6f435513a367 service nova] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Updating instance_info_cache with network_info: [{"id": "44472973-4f12-49d0-bab1-930a57c5a234", "address": "fa:16:3e:57:d2:ab", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44472973-4f", "ovs_interfaceid": "44472973-4f12-49d0-bab1-930a57c5a234", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 16:07:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-8fe54422-666d-4e3a-a866-44c013814d52 req-2ebb8a1f-33da-4b30-9ece-6f435513a367 service nova] Releasing lock "refresh_cache-9f0473cd-bfe6-4b1c-83d0-6ede26811743" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 16:07:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:07:32 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:07:32 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 16:07:32 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Rebuilding the list of instances to heal {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 16:07:32 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Skipping network cache update for instance because it is Building. {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 11 16:07:32 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Didn't find any instances for network info cache update. {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 16:07:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:07:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:07:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:07:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:07:33 user nova-compute[71229]: DEBUG nova.compute.manager [req-e18411cf-b91c-4645-8db3-db1b72b69a26 req-6b51e081-15cc-407c-8917-b0e90d2cdc53 service nova] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Received event network-vif-plugged-44472973-4f12-49d0-bab1-930a57c5a234 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:07:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e18411cf-b91c-4645-8db3-db1b72b69a26 req-6b51e081-15cc-407c-8917-b0e90d2cdc53 service nova] Acquiring lock "9f0473cd-bfe6-4b1c-83d0-6ede26811743-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:07:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e18411cf-b91c-4645-8db3-db1b72b69a26 req-6b51e081-15cc-407c-8917-b0e90d2cdc53 service nova] Lock "9f0473cd-bfe6-4b1c-83d0-6ede26811743-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:07:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e18411cf-b91c-4645-8db3-db1b72b69a26 req-6b51e081-15cc-407c-8917-b0e90d2cdc53 service nova] Lock "9f0473cd-bfe6-4b1c-83d0-6ede26811743-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:07:33 user nova-compute[71229]: DEBUG nova.compute.manager [req-e18411cf-b91c-4645-8db3-db1b72b69a26 req-6b51e081-15cc-407c-8917-b0e90d2cdc53 service nova] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] No waiting events found dispatching network-vif-plugged-44472973-4f12-49d0-bab1-930a57c5a234 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 16:07:33 user nova-compute[71229]: WARNING nova.compute.manager [req-e18411cf-b91c-4645-8db3-db1b72b69a26 req-6b51e081-15cc-407c-8917-b0e90d2cdc53 service nova] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Received unexpected event network-vif-plugged-44472973-4f12-49d0-bab1-930a57c5a234 for instance with vm_state building and task_state spawning.
Apr 11 16:07:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:07:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:07:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:07:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:07:34 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:07:34 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:07:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:07:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:07:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:07:34 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 16:07:34 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0473cd-bfe6-4b1c-83d0-6ede26811743/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:07:34 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0473cd-bfe6-4b1c-83d0-6ede26811743/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:07:34 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0473cd-bfe6-4b1c-83d0-6ede26811743/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:07:35 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0473cd-bfe6-4b1c-83d0-6ede26811743/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:07:35 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681229255.3091311, 9f0473cd-bfe6-4b1c-83d0-6ede26811743 => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 16:07:35 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] VM Resumed (Lifecycle Event)
Apr 11 16:07:35 user nova-compute[71229]: DEBUG nova.compute.manager [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 16:07:35 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Guest created on hypervisor {{(pid=71229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 16:07:35 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:07:35 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:07:35 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8876MB free_disk=25.984203338623047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 16:07:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:07:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:07:35 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Instance spawned successfully.
Apr 11 16:07:35 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 16:07:35 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 16:07:35 user nova-compute[71229]: DEBUG nova.compute.manager [req-11b5e168-c73a-4adb-880d-aa8d6e77214e req-fe9be200-6e7c-48de-a6e3-0ef1d3dbf70a service nova] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Received event network-vif-plugged-44472973-4f12-49d0-bab1-930a57c5a234 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:07:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-11b5e168-c73a-4adb-880d-aa8d6e77214e req-fe9be200-6e7c-48de-a6e3-0ef1d3dbf70a service nova] Acquiring lock "9f0473cd-bfe6-4b1c-83d0-6ede26811743-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:07:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-11b5e168-c73a-4adb-880d-aa8d6e77214e req-fe9be200-6e7c-48de-a6e3-0ef1d3dbf70a service nova] Lock "9f0473cd-bfe6-4b1c-83d0-6ede26811743-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:07:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-11b5e168-c73a-4adb-880d-aa8d6e77214e req-fe9be200-6e7c-48de-a6e3-0ef1d3dbf70a service nova] Lock "9f0473cd-bfe6-4b1c-83d0-6ede26811743-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:07:35 user nova-compute[71229]: DEBUG nova.compute.manager [req-11b5e168-c73a-4adb-880d-aa8d6e77214e req-fe9be200-6e7c-48de-a6e3-0ef1d3dbf70a service nova] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] No waiting events found dispatching network-vif-plugged-44472973-4f12-49d0-bab1-930a57c5a234 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 16:07:35 user nova-compute[71229]: WARNING nova.compute.manager [req-11b5e168-c73a-4adb-880d-aa8d6e77214e req-fe9be200-6e7c-48de-a6e3-0ef1d3dbf70a service nova] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Received unexpected event network-vif-plugged-44472973-4f12-49d0-bab1-930a57c5a234 for instance with vm_state building and task_state spawning.
Apr 11 16:07:35 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 16:07:35 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Found default for hw_cdrom_bus of ide {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 16:07:35 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Found default for hw_disk_bus of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 16:07:35 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Found default for hw_input_bus of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 16:07:35 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Found default for hw_pointer_model of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 16:07:35 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Found default for hw_video_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 16:07:35 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Found default for hw_vif_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 16:07:35 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 16:07:35 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681229255.3100514, 9f0473cd-bfe6-4b1c-83d0-6ede26811743 => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 16:07:35 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] VM Started (Lifecycle Event)
Apr 11 16:07:35 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 16:07:35 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 9f0473cd-bfe6-4b1c-83d0-6ede26811743 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 16:07:35 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 16:07:35 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 16:07:35 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 16:07:35 user nova-compute[71229]: INFO nova.compute.manager [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Took 5.43 seconds to spawn the instance on the hypervisor.
Apr 11 16:07:35 user nova-compute[71229]: DEBUG nova.compute.manager [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 16:07:35 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 16:07:35 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 16:07:35 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 16:07:35 user nova-compute[71229]: INFO nova.compute.manager [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Took 5.97 seconds to build instance.
Apr 11 16:07:35 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 16:07:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.234s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:07:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-35fe4a84-8f63-4a88-8e14-5e9f6b7309f8 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "9f0473cd-bfe6-4b1c-83d0-6ede26811743" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.059s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:07:36 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:07:36 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:07:36 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:07:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:07:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:07:38 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:07:41 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:07:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:07:42 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:07:42 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:07:42 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71229) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 16:07:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:07:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:07:50 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:07:51 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:07:52 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:07:52 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:07:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:07:57 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:08:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:08:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:08:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:08:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:08:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:08:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:08:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:08:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:08:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:08:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:08:21 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:08:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:08:26 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:08:26 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 16:08:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:08:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:08:33 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:08:33 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 16:08:33 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Rebuilding the list of instances to heal {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 16:08:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "refresh_cache-9f0473cd-bfe6-4b1c-83d0-6ede26811743" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 16:08:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquired lock "refresh_cache-9f0473cd-bfe6-4b1c-83d0-6ede26811743" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 16:08:33 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Forcefully refreshing network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 16:08:33 user nova-compute[71229]: DEBUG nova.objects.instance [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lazy-loading 'info_cache' on Instance uuid 9f0473cd-bfe6-4b1c-83d0-6ede26811743 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:08:34 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Updating instance_info_cache with network_info: [{"id": "44472973-4f12-49d0-bab1-930a57c5a234", "address": "fa:16:3e:57:d2:ab", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44472973-4f", "ovs_interfaceid": "44472973-4f12-49d0-bab1-930a57c5a234", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 16:08:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Releasing lock "refresh_cache-9f0473cd-bfe6-4b1c-83d0-6ede26811743" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 16:08:34 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Updated the network info_cache for instance {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 16:08:35 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:08:35 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:08:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:08:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:08:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:08:35 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 16:08:35 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0473cd-bfe6-4b1c-83d0-6ede26811743/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:08:35 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0473cd-bfe6-4b1c-83d0-6ede26811743/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:08:35 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0473cd-bfe6-4b1c-83d0-6ede26811743/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:08:36 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0473cd-bfe6-4b1c-83d0-6ede26811743/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:08:36 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:08:36 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:08:36 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8845MB free_disk=25.96381378173828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 16:08:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:08:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:08:36 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 9f0473cd-bfe6-4b1c-83d0-6ede26811743 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 16:08:36 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 16:08:36 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 16:08:36 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Refreshing inventories for resource provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 16:08:36 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Updating ProviderTree inventory for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 16:08:36 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Updating inventory in ProviderTree for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 16:08:36 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Refreshing aggregate associations for resource provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de, aggregates: None {{(pid=71229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 16:08:36 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Refreshing trait associations for resource provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de, traits: COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=71229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 16:08:36 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 16:08:36 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 16:08:36 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 16:08:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.430s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:08:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:08:37 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:08:37 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:08:37 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:08:38 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:08:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:08:43 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:08:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:08:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:08:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:08:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:08:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:08:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:08:51 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:08:53 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:08:53 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Triggering sync for uuid 9f0473cd-bfe6-4b1c-83d0-6ede26811743 {{(pid=71229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 16:08:53 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "9f0473cd-bfe6-4b1c-83d0-6ede26811743" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:08:53 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "9f0473cd-bfe6-4b1c-83d0-6ede26811743" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:08:53 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "9f0473cd-bfe6-4b1c-83d0-6ede26811743" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:08:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:08:57 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:09:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:09:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:09:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:09:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:09:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:09:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:09:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:09:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:09:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:09:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:09:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:09:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:09:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:09:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:09:20 user nova-compute[71229]: DEBUG nova.compute.manager [req-486200ef-df9d-4a72-959b-42132e8653ec req-27e40445-9e07-4908-bda8-7cb372382f08 service nova] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Received event network-changed-44472973-4f12-49d0-bab1-930a57c5a234 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:09:20 user nova-compute[71229]: DEBUG nova.compute.manager [req-486200ef-df9d-4a72-959b-42132e8653ec req-27e40445-9e07-4908-bda8-7cb372382f08 service nova] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Refreshing instance network info cache due to event network-changed-44472973-4f12-49d0-bab1-930a57c5a234. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 16:09:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-486200ef-df9d-4a72-959b-42132e8653ec req-27e40445-9e07-4908-bda8-7cb372382f08 service nova] Acquiring lock "refresh_cache-9f0473cd-bfe6-4b1c-83d0-6ede26811743" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 16:09:20 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-486200ef-df9d-4a72-959b-42132e8653ec req-27e40445-9e07-4908-bda8-7cb372382f08 service nova] Acquired lock "refresh_cache-9f0473cd-bfe6-4b1c-83d0-6ede26811743" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 16:09:20 user nova-compute[71229]: DEBUG nova.network.neutron [req-486200ef-df9d-4a72-959b-42132e8653ec req-27e40445-9e07-4908-bda8-7cb372382f08 service nova] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Refreshing network info cache for port 44472973-4f12-49d0-bab1-930a57c5a234 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 16:09:21 user nova-compute[71229]: DEBUG nova.network.neutron [req-486200ef-df9d-4a72-959b-42132e8653ec req-27e40445-9e07-4908-bda8-7cb372382f08 service nova] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Updated VIF entry in instance network info cache for port 44472973-4f12-49d0-bab1-930a57c5a234. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 16:09:21 user nova-compute[71229]: DEBUG nova.network.neutron [req-486200ef-df9d-4a72-959b-42132e8653ec req-27e40445-9e07-4908-bda8-7cb372382f08 service nova] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Updating instance_info_cache with network_info: [{"id": "44472973-4f12-49d0-bab1-930a57c5a234", "address": "fa:16:3e:57:d2:ab", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44472973-4f", "ovs_interfaceid": "44472973-4f12-49d0-bab1-930a57c5a234", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 16:09:21 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-486200ef-df9d-4a72-959b-42132e8653ec req-27e40445-9e07-4908-bda8-7cb372382f08 service nova] Releasing lock "refresh_cache-9f0473cd-bfe6-4b1c-83d0-6ede26811743" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 16:09:21 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:09:22 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "9f0473cd-bfe6-4b1c-83d0-6ede26811743" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:09:22 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "9f0473cd-bfe6-4b1c-83d0-6ede26811743" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:09:22 user nova-compute[71229]: DEBUG nova.objects.instance [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lazy-loading 'flavor' on Instance uuid 9f0473cd-bfe6-4b1c-83d0-6ede26811743 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:09:22 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "9f0473cd-bfe6-4b1c-83d0-6ede26811743" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:09:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:09:22 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "9f0473cd-bfe6-4b1c-83d0-6ede26811743" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:09:22 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "9f0473cd-bfe6-4b1c-83d0-6ede26811743" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:09:22 user nova-compute[71229]: INFO nova.compute.manager [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Attaching volume f728a0e1-861e-4f16-9255-fedbc1830b37 to /dev/vdb
Apr 11 16:09:23 user nova-compute[71229]: DEBUG os_brick.utils [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 16:09:23 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:09:23 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:09:23 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7ea82a-46a8-458b-8181-719a41f85de0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d55e24a97c90\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:09:23 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:09:23 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:09:23 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ededacc9-2150-490a-8046-f29edd5b568c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:09:23 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:09:23 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:09:23 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[475e04d5-58da-4c51-8ff6-3e087195de61]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:09:23 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0de32a3-138e-49e7-b2ff-871939fa7223]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:09:23 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Running cmd (subprocess): nvme version {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:09:23 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 'nvme version' failed. Not Retrying. {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 16:09:23 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] nvme not present on system {{(pid=71229) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 16:09:23 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:09:23 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 16:09:23 user nova-compute[71229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 16:09:23 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[459c8561-4747-46fd-9e35-15f5de13ea7c]: (4, '') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:09:23 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71229) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 16:09:23 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 16:09:23 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] LIGHTOS: no hostnqn found. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 16:09:23 user nova-compute[71229]: DEBUG os_brick.utils [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d55e24a97c90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 16:09:23 user nova-compute[71229]: DEBUG nova.virt.block_device [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Updating existing volume attachment record: 2831c1a0-fb2d-437f-8aed-99d75f02004d {{(pid=71229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 16:09:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f728a0e1-861e-4f16-9255-fedbc1830b37', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nzcgDayN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 16:09:27 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 16:09:27 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 16:09:27 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 16:09:27 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f728a0e1-861e-4f16-9255-fedbc1830b37" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f728a0e1-861e-4f16-9255-fedbc1830b37" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 16:09:27 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 16:09:27 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f728a0e1-861e-4f16-9255-fedbc1830b37 -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f728a0e1-861e-4f16-9255-fedbc1830b37 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4900d0-2a11-4775-8034-1f3b4d52e452]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 16:09:27 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f728a0e1-861e-4f16-9255-fedbc1830b37 -p 172.16.0.220:3260 --interface default --op new {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f728a0e1-861e-4f16-9255-fedbc1830b37 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[61578b31-7fc3-4d33-b2fd-bbacb4ffed39]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f728a0e1-861e-4f16-9255-fedbc1830b37] added\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f728a0e1-861e-4f16-9255-fedbc1830b37] added
Apr 11 16:09:27 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f728a0e1-861e-4f16-9255-fedbc1830b37 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f728a0e1-861e-4f16-9255-fedbc1830b37 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5ebc77-0f3e-4580-9cf7-563460b50c6f]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f728a0e1-861e-4f16-9255-fedbc1830b37 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f728a0e1-861e-4f16-9255-fedbc1830b37 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[07397024-715d-48a1-98b6-70e0b4f474ff]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f728a0e1-861e-4f16-9255-fedbc1830b37 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nzcgDayN {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f728a0e1-861e-4f16-9255-fedbc1830b37 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nzcgDayN" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90ab4be-393b-4bc7-b1e8-70e4e0213e87]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nzcgDayN'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f728a0e1-861e-4f16-9255-fedbc1830b37 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f728a0e1-861e-4f16-9255-fedbc1830b37 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6cf738a-4415-4b5f-ba9f-23f801d8fa92]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[437250f2-421a-44da-b719-0c02602f901a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 11 16:09:27 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 11 16:09:27 user nova-compute[71229]:  {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 16:09:27 user nova-compute[71229]: WARNING os_brick.initiator.connectors.iscsi [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 11 16:09:27 user nova-compute[71229]: 
Apr 11 16:09:27 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f728a0e1-861e-4f16-9255-fedbc1830b37 -p 172.16.0.220:3260 --login {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f728a0e1-861e-4f16-9255-fedbc1830b37 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[028a62a5-3f58-40f3-a898-a69d4ca46d64]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f728a0e1-861e-4f16-9255-fedbc1830b37, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f728a0e1-861e-4f16-9255-fedbc1830b37, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f728a0e1-861e-4f16-9255-fedbc1830b37, portal: 172.16.0.220,3260]
Apr 11 16:09:27 user nova-compute[71229]: Login to [iface: default, target: iqn.2010-10.org.openstack:f728a0e1-861e-4f16-9255-fedbc1830b37, portal: 172.16.0.220,3260] successful.
Apr 11 16:09:27 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f728a0e1-861e-4f16-9255-fedbc1830b37 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f728a0e1-861e-4f16-9255-fedbc1830b37 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc5e573-116e-4a60-96f3-de1ecb4929e6]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8952af7d-ba43-4cf3-8589-2204494219e4]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f728a0e1-861e-4f16-9255-fedbc1830b37 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f728a0e1-861e-4f16-9255-fedbc1830b37 (non-flash)
Apr 11 16:09:27 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f728a0e1-861e-4f16-9255-fedbc1830b37 (non-flash)
Apr 11 16:09:27 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f728a0e1-861e-4f16-9255-fedbc1830b37" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.233s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fa4456-24d3-4988-af2c-417b6269668b]: (4, ('- - 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f728a0e1-861e-4f16-9255-fedbc1830b37', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nzcgDayN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 16:09:27 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:09:28 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.265s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 16:09:28 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] <== connect_volume: return (1267ms) {'type': 'block', 'scsi_wwn': '23835636235643165', 'path': '/dev/sdb'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 16:09:28 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835636235643165', 'path': '/dev/sdb'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 16:09:28 user nova-compute[71229]: DEBUG nova.objects.instance [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lazy-loading 'flavor' on Instance uuid 9f0473cd-bfe6-4b1c-83d0-6ede26811743 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:09:28 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 16:09:28 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 16:09:28 user nova-compute[71229]:   <source dev="/dev/sdb"/>
Apr 11 16:09:28 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 16:09:28 user nova-compute[71229]:   <serial>f728a0e1-861e-4f16-9255-fedbc1830b37</serial>
Apr 11 16:09:28 user nova-compute[71229]: </disk>
Apr 11 16:09:28 user nova-compute[71229]:  {{(pid=71229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 16:09:28 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 16:09:28 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 16:09:28 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] No VIF found with MAC fa:16:3e:57:d2:ab, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 16:09:28 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4319ea4b-d840-4b2c-84cd-c56d01e18811 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "9f0473cd-bfe6-4b1c-83d0-6ede26811743" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.075s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:09:29 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:09:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "d6e7aedb-2302-467e-83ea-07584c5b86ff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:09:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "d6e7aedb-2302-467e-83ea-07584c5b86ff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:09:31 user nova-compute[71229]: DEBUG nova.compute.manager [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Starting instance... {{(pid=71229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 16:09:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:09:31 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:09:31 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 16:09:31 user nova-compute[71229]: INFO nova.compute.claims [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Claim successful on node user
Apr 11 16:09:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:09:32 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 16:09:32 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 16:09:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.229s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:09:32 user nova-compute[71229]: DEBUG nova.compute.manager [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Start building networks asynchronously for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 16:09:32 user nova-compute[71229]: DEBUG nova.compute.manager [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Allocating IP information in the background. {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 16:09:32 user nova-compute[71229]: DEBUG nova.network.neutron [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] allocate_for_instance() {{(pid=71229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 16:09:32 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 16:09:32 user nova-compute[71229]: DEBUG nova.compute.manager [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Start building block device mappings for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 16:09:32 user nova-compute[71229]: DEBUG nova.policy [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1332668b568e41a98bb68f6c28c92db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6241b8bab90c4f1991413b84c5241baf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71229) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 16:09:32 user nova-compute[71229]: DEBUG nova.compute.manager [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Start spawning the instance on the hypervisor. {{(pid=71229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 16:09:32 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Creating instance directory {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 16:09:32 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Creating image(s)
Apr 11 16:09:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "/opt/stack/data/nova/instances/d6e7aedb-2302-467e-83ea-07584c5b86ff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:09:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "/opt/stack/data/nova/instances/d6e7aedb-2302-467e-83ea-07584c5b86ff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:09:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "/opt/stack/data/nova/instances/d6e7aedb-2302-467e-83ea-07584c5b86ff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:09:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:09:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.134s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:09:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:09:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:09:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:09:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.140s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:09:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/d6e7aedb-2302-467e-83ea-07584c5b86ff/disk 1073741824 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:09:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/d6e7aedb-2302-467e-83ea-07584c5b86ff/disk 1073741824" returned: 0 in 0.051s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:09:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:09:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:09:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.130s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:09:32 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d6e7aedb-2302-467e-83ea-07584c5b86ff/disk. size=1073741824 {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 16:09:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e7aedb-2302-467e-83ea-07584c5b86ff/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:09:32 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e7aedb-2302-467e-83ea-07584c5b86ff/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:09:32 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Cannot resize image /opt/stack/data/nova/instances/d6e7aedb-2302-467e-83ea-07584c5b86ff/disk to a smaller size. {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 16:09:32 user nova-compute[71229]: DEBUG nova.objects.instance [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lazy-loading 'migration_context' on Instance uuid d6e7aedb-2302-467e-83ea-07584c5b86ff {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:09:32 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Created local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 16:09:32 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Ensure instance console log exists: /opt/stack/data/nova/instances/d6e7aedb-2302-467e-83ea-07584c5b86ff/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 16:09:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:09:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:09:32 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:09:32 user nova-compute[71229]: DEBUG nova.network.neutron [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Successfully created port: 02de7a0f-1b41-4535-9edc-ea84c6b14447 {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 16:09:33 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:09:33 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 16:09:33 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Rebuilding the list of instances to heal {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 16:09:33 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Skipping network cache update for instance because it is Building. {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 11 16:09:33 user nova-compute[71229]: DEBUG nova.network.neutron [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Successfully updated port: 02de7a0f-1b41-4535-9edc-ea84c6b14447 {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 16:09:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "refresh_cache-d6e7aedb-2302-467e-83ea-07584c5b86ff" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 16:09:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquired lock "refresh_cache-d6e7aedb-2302-467e-83ea-07584c5b86ff" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 16:09:33 user nova-compute[71229]: DEBUG nova.network.neutron [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 16:09:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "refresh_cache-9f0473cd-bfe6-4b1c-83d0-6ede26811743" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 16:09:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquired lock "refresh_cache-9f0473cd-bfe6-4b1c-83d0-6ede26811743" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 16:09:33 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Forcefully refreshing network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 16:09:33 user nova-compute[71229]: DEBUG nova.objects.instance [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lazy-loading 'info_cache' on Instance uuid 9f0473cd-bfe6-4b1c-83d0-6ede26811743 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:09:33 user nova-compute[71229]: DEBUG nova.network.neutron [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 16:09:33 user nova-compute[71229]: DEBUG nova.compute.manager [req-c50ea4e4-9612-4732-afc7-21fb81129d03 req-1ea79cc5-d3bd-4078-8686-c0050c552a54 service nova] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Received event network-changed-02de7a0f-1b41-4535-9edc-ea84c6b14447 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:09:33 user nova-compute[71229]: DEBUG nova.compute.manager [req-c50ea4e4-9612-4732-afc7-21fb81129d03 req-1ea79cc5-d3bd-4078-8686-c0050c552a54 service nova] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Refreshing instance network info cache due to event network-changed-02de7a0f-1b41-4535-9edc-ea84c6b14447. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 16:09:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c50ea4e4-9612-4732-afc7-21fb81129d03 req-1ea79cc5-d3bd-4078-8686-c0050c552a54 service nova] Acquiring lock "refresh_cache-d6e7aedb-2302-467e-83ea-07584c5b86ff" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 16:09:34 user nova-compute[71229]: DEBUG nova.network.neutron [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Updating instance_info_cache with network_info: [{"id": "02de7a0f-1b41-4535-9edc-ea84c6b14447", "address": "fa:16:3e:8d:28:6e", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02de7a0f-1b", "ovs_interfaceid": "02de7a0f-1b41-4535-9edc-ea84c6b14447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 16:09:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Releasing lock "refresh_cache-d6e7aedb-2302-467e-83ea-07584c5b86ff" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 16:09:34 user nova-compute[71229]: DEBUG nova.compute.manager [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Instance network_info: |[{"id": "02de7a0f-1b41-4535-9edc-ea84c6b14447", "address": "fa:16:3e:8d:28:6e", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02de7a0f-1b", "ovs_interfaceid": "02de7a0f-1b41-4535-9edc-ea84c6b14447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 16:09:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c50ea4e4-9612-4732-afc7-21fb81129d03 req-1ea79cc5-d3bd-4078-8686-c0050c552a54 service nova] Acquired lock "refresh_cache-d6e7aedb-2302-467e-83ea-07584c5b86ff" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 16:09:34 user nova-compute[71229]: DEBUG nova.network.neutron [req-c50ea4e4-9612-4732-afc7-21fb81129d03 req-1ea79cc5-d3bd-4078-8686-c0050c552a54 service nova] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Refreshing network info cache for port 02de7a0f-1b41-4535-9edc-ea84c6b14447 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 16:09:34 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Start _get_guest_xml network_info=[{"id": "02de7a0f-1b41-4535-9edc-ea84c6b14447", "address": "fa:16:3e:8d:28:6e", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02de7a0f-1b", "ovs_interfaceid": "02de7a0f-1b41-4535-9edc-ea84c6b14447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '52fe638c-5ada-47d5-b376-233bfa808a37'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 16:09:34 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:09:34 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:09:34 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 16:09:34 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 16:09:34 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 16:09:34 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 16:09:34 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 16:09:34 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 16:09:34 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 16:09:34 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 16:09:34 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 16:09:34 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 16:09:34 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 16:09:34 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 16:09:34 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T16:09:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-874375628',display_name='tempest-AttachVolumeNegativeTest-server-874375628',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-874375628',id=43,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhwj5HGj4LqkFfhM3prw807GjlwL3+JFQFZdekOyHjeT6jf+I7UzZjFvxNMkZVw+IA5tbCxNem0yf/re31E+6LVdriMcJRoLpLI3OEdeLdLr+XUaVEpcYXyKT5L8RhAlw==',key_name='tempest-keypair-1619440901',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6241b8bab90c4f1991413b84c5241baf',ramdisk_id='',reservation_id='r-5gto2unz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-537147684',owner_user_name='tempest-AttachVolumeNegativeTest-537147684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T16:09:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1332668b568e41a98bb68f6c28c92db9',uuid=d6e7aedb-2302-467e-83ea-07584c5b86ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02de7a0f-1b41-4535-9edc-ea84c6b14447", "address": "fa:16:3e:8d:28:6e", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02de7a0f-1b", "ovs_interfaceid": "02de7a0f-1b41-4535-9edc-ea84c6b14447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 16:09:34 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Converting VIF {"id": "02de7a0f-1b41-4535-9edc-ea84c6b14447", "address": "fa:16:3e:8d:28:6e", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02de7a0f-1b", "ovs_interfaceid": "02de7a0f-1b41-4535-9edc-ea84c6b14447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 16:09:34 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:28:6e,bridge_name='br-int',has_traffic_filtering=True,id=02de7a0f-1b41-4535-9edc-ea84c6b14447,network=Network(c3def4c9-33a3-48eb-ad5c-45bb499758ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02de7a0f-1b') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 16:09:34 user nova-compute[71229]: DEBUG nova.objects.instance [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lazy-loading 'pci_devices' on Instance uuid d6e7aedb-2302-467e-83ea-07584c5b86ff {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:09:34 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] End _get_guest_xml xml=<domain type="kvm">
Apr 11 16:09:34 user nova-compute[71229]:   <uuid>d6e7aedb-2302-467e-83ea-07584c5b86ff</uuid>
Apr 11 16:09:34 user nova-compute[71229]:   <name>instance-0000002b</name>
Apr 11 16:09:34 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 16:09:34 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 16:09:34 user nova-compute[71229]:   <metadata>
Apr 11 16:09:34 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 16:09:34 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 16:09:34 user nova-compute[71229]:       <nova:name>tempest-AttachVolumeNegativeTest-server-874375628</nova:name>
Apr 11 16:09:34 user nova-compute[71229]:       <nova:creationTime>2023-04-11 16:09:34</nova:creationTime>
Apr 11 16:09:34 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 16:09:34 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 16:09:34 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 16:09:34 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 16:09:34 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 16:09:34 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 16:09:34 user nova-compute[71229]:       </nova:flavor>
Apr 11 16:09:34 user nova-compute[71229]:       <nova:owner>
Apr 11 16:09:34 user nova-compute[71229]:         <nova:user uuid="1332668b568e41a98bb68f6c28c92db9">tempest-AttachVolumeNegativeTest-537147684-project-member</nova:user>
Apr 11 16:09:34 user nova-compute[71229]:         <nova:project uuid="6241b8bab90c4f1991413b84c5241baf">tempest-AttachVolumeNegativeTest-537147684</nova:project>
Apr 11 16:09:34 user nova-compute[71229]:       </nova:owner>
Apr 11 16:09:34 user nova-compute[71229]:       <nova:root type="image" uuid="52fe638c-5ada-47d5-b376-233bfa808a37"/>
Apr 11 16:09:34 user nova-compute[71229]:       <nova:ports>
Apr 11 16:09:34 user nova-compute[71229]:         <nova:port uuid="02de7a0f-1b41-4535-9edc-ea84c6b14447">
Apr 11 16:09:34 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 11 16:09:34 user nova-compute[71229]:         </nova:port>
Apr 11 16:09:34 user nova-compute[71229]:       </nova:ports>
Apr 11 16:09:34 user nova-compute[71229]:     </nova:instance>
Apr 11 16:09:34 user nova-compute[71229]:   </metadata>
Apr 11 16:09:34 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 16:09:34 user nova-compute[71229]:     <system>
Apr 11 16:09:34 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 16:09:34 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 16:09:34 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 16:09:34 user nova-compute[71229]:       <entry name="serial">d6e7aedb-2302-467e-83ea-07584c5b86ff</entry>
Apr 11 16:09:34 user nova-compute[71229]:       <entry name="uuid">d6e7aedb-2302-467e-83ea-07584c5b86ff</entry>
Apr 11 16:09:34 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 16:09:34 user nova-compute[71229]:     </system>
Apr 11 16:09:34 user nova-compute[71229]:   </sysinfo>
Apr 11 16:09:34 user nova-compute[71229]:   <os>
Apr 11 16:09:34 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 16:09:34 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 16:09:34 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 16:09:34 user nova-compute[71229]:   </os>
Apr 11 16:09:34 user nova-compute[71229]:   <features>
Apr 11 16:09:34 user nova-compute[71229]:     <acpi/>
Apr 11 16:09:34 user nova-compute[71229]:     <apic/>
Apr 11 16:09:34 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 16:09:34 user nova-compute[71229]:   </features>
Apr 11 16:09:34 user nova-compute[71229]:   <clock offset="utc">
Apr 11 16:09:34 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 16:09:34 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 16:09:34 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 16:09:34 user nova-compute[71229]:   </clock>
Apr 11 16:09:34 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 16:09:34 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 16:09:34 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 16:09:34 user nova-compute[71229]:   </cpu>
Apr 11 16:09:34 user nova-compute[71229]:   <devices>
Apr 11 16:09:34 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 16:09:34 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 16:09:34 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/d6e7aedb-2302-467e-83ea-07584c5b86ff/disk"/>
Apr 11 16:09:34 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 16:09:34 user nova-compute[71229]:     </disk>
Apr 11 16:09:34 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 16:09:34 user nova-compute[71229]:       <mac address="fa:16:3e:8d:28:6e"/>
Apr 11 16:09:34 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 16:09:34 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 16:09:34 user nova-compute[71229]:       <target dev="tap02de7a0f-1b"/>
Apr 11 16:09:34 user nova-compute[71229]:     </interface>
Apr 11 16:09:34 user nova-compute[71229]:     <serial type="pty">
Apr 11 16:09:34 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/d6e7aedb-2302-467e-83ea-07584c5b86ff/console.log" append="off"/>
Apr 11 16:09:34 user nova-compute[71229]:     </serial>
Apr 11 16:09:34 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 16:09:34 user nova-compute[71229]:     <video>
Apr 11 16:09:34 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 16:09:34 user nova-compute[71229]:     </video>
Apr 11 16:09:34 user nova-compute[71229]:     <rng model="virtio">
Apr 11 16:09:34 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 16:09:34 user nova-compute[71229]:     </rng>
Apr 11 16:09:34 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 16:09:34 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 16:09:34 user nova-compute[71229]:       <stats period="10"/>
Apr 11 16:09:34 user nova-compute[71229]:     </memballoon>
Apr 11 16:09:34 user nova-compute[71229]:   </devices>
Apr 11 16:09:34 user nova-compute[71229]: </domain>
Apr 11 16:09:34 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 16:09:34 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T16:09:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-874375628',display_name='tempest-AttachVolumeNegativeTest-server-874375628',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-874375628',id=43,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhwj5HGj4LqkFfhM3prw807GjlwL3+JFQFZdekOyHjeT6jf+I7UzZjFvxNMkZVw+IA5tbCxNem0yf/re31E+6LVdriMcJRoLpLI3OEdeLdLr+XUaVEpcYXyKT5L8RhAlw==',key_name='tempest-keypair-1619440901',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6241b8bab90c4f1991413b84c5241baf',ramdisk_id='',reservation_id='r-5gto2unz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-537147684',owner_user_name='tempest-AttachVolumeNegativeTest-537147684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T16:09:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1332668b568e41a98bb68f6c28c92db9',uuid=d6e7aedb-2302-467e-83ea-07584c5b86ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02de7a0f-1b41-4535-9edc-ea84c6b14447", "address": "fa:16:3e:8d:28:6e", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02de7a0f-1b", "ovs_interfaceid": "02de7a0f-1b41-4535-9edc-ea84c6b14447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 16:09:34 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Converting VIF {"id": "02de7a0f-1b41-4535-9edc-ea84c6b14447", "address": "fa:16:3e:8d:28:6e", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02de7a0f-1b", "ovs_interfaceid": "02de7a0f-1b41-4535-9edc-ea84c6b14447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 16:09:34 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:28:6e,bridge_name='br-int',has_traffic_filtering=True,id=02de7a0f-1b41-4535-9edc-ea84c6b14447,network=Network(c3def4c9-33a3-48eb-ad5c-45bb499758ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02de7a0f-1b') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 16:09:34 user nova-compute[71229]: DEBUG os_vif [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:28:6e,bridge_name='br-int',has_traffic_filtering=True,id=02de7a0f-1b41-4535-9edc-ea84c6b14447,network=Network(c3def4c9-33a3-48eb-ad5c-45bb499758ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02de7a0f-1b') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 16:09:34 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:09:34 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 16:09:34 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 16:09:34 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:09:34 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap02de7a0f-1b, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 16:09:34 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap02de7a0f-1b, col_values=(('external_ids', {'iface-id': '02de7a0f-1b41-4535-9edc-ea84c6b14447', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:28:6e', 'vm-uuid': 'd6e7aedb-2302-467e-83ea-07584c5b86ff'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 16:09:34 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:09:34 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:09:34 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:09:34 user nova-compute[71229]: INFO os_vif [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:28:6e,bridge_name='br-int',has_traffic_filtering=True,id=02de7a0f-1b41-4535-9edc-ea84c6b14447,network=Network(c3def4c9-33a3-48eb-ad5c-45bb499758ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02de7a0f-1b')
Apr 11 16:09:34 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 16:09:34 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] No VIF found with MAC fa:16:3e:8d:28:6e, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 16:09:34 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Updating instance_info_cache with network_info: [{"id": "44472973-4f12-49d0-bab1-930a57c5a234", "address": "fa:16:3e:57:d2:ab", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44472973-4f", "ovs_interfaceid": "44472973-4f12-49d0-bab1-930a57c5a234", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 16:09:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Releasing lock "refresh_cache-9f0473cd-bfe6-4b1c-83d0-6ede26811743" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 16:09:34 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Updated the network info_cache for instance {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 16:09:34 user nova-compute[71229]: DEBUG nova.network.neutron [req-c50ea4e4-9612-4732-afc7-21fb81129d03 req-1ea79cc5-d3bd-4078-8686-c0050c552a54 service nova] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Updated VIF entry in instance network info cache for port 02de7a0f-1b41-4535-9edc-ea84c6b14447. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 16:09:34 user nova-compute[71229]: DEBUG nova.network.neutron [req-c50ea4e4-9612-4732-afc7-21fb81129d03 req-1ea79cc5-d3bd-4078-8686-c0050c552a54 service nova] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Updating instance_info_cache with network_info: [{"id": "02de7a0f-1b41-4535-9edc-ea84c6b14447", "address": "fa:16:3e:8d:28:6e", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02de7a0f-1b", "ovs_interfaceid": "02de7a0f-1b41-4535-9edc-ea84c6b14447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 16:09:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-c50ea4e4-9612-4732-afc7-21fb81129d03 req-1ea79cc5-d3bd-4078-8686-c0050c552a54 service nova] Releasing lock "refresh_cache-d6e7aedb-2302-467e-83ea-07584c5b86ff" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 16:09:35 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:09:35 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:09:35 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:09:35 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:09:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:09:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:09:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:09:35 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 16:09:35 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:09:35 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:09:35 user nova-compute[71229]: DEBUG nova.compute.manager [req-5fae002d-a9f3-4658-92be-97bbc3771ebf req-9747a70f-3440-4e02-a527-5214215f3beb service nova] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Received event network-vif-plugged-02de7a0f-1b41-4535-9edc-ea84c6b14447 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:09:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-5fae002d-a9f3-4658-92be-97bbc3771ebf req-9747a70f-3440-4e02-a527-5214215f3beb service nova] Acquiring lock "d6e7aedb-2302-467e-83ea-07584c5b86ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:09:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-5fae002d-a9f3-4658-92be-97bbc3771ebf req-9747a70f-3440-4e02-a527-5214215f3beb service nova] Lock "d6e7aedb-2302-467e-83ea-07584c5b86ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:09:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-5fae002d-a9f3-4658-92be-97bbc3771ebf req-9747a70f-3440-4e02-a527-5214215f3beb service nova] Lock "d6e7aedb-2302-467e-83ea-07584c5b86ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:09:35 user nova-compute[71229]: DEBUG nova.compute.manager [req-5fae002d-a9f3-4658-92be-97bbc3771ebf req-9747a70f-3440-4e02-a527-5214215f3beb service nova] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] No waiting events found dispatching network-vif-plugged-02de7a0f-1b41-4535-9edc-ea84c6b14447 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 16:09:35 user nova-compute[71229]: WARNING nova.compute.manager [req-5fae002d-a9f3-4658-92be-97bbc3771ebf req-9747a70f-3440-4e02-a527-5214215f3beb service nova] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Received unexpected event network-vif-plugged-02de7a0f-1b41-4535-9edc-ea84c6b14447 for instance with vm_state building and task_state spawning.
Apr 11 16:09:35 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0473cd-bfe6-4b1c-83d0-6ede26811743/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:09:36 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0473cd-bfe6-4b1c-83d0-6ede26811743/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:09:36 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0473cd-bfe6-4b1c-83d0-6ede26811743/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:09:36 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0473cd-bfe6-4b1c-83d0-6ede26811743/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:09:36 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 16:09:36 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e7aedb-2302-467e-83ea-07584c5b86ff/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:09:36 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e7aedb-2302-467e-83ea-07584c5b86ff/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:09:36 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e7aedb-2302-467e-83ea-07584c5b86ff/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:09:36 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e7aedb-2302-467e-83ea-07584c5b86ff/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:09:36 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:09:36 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:09:36 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8813MB free_disk=25.962127685546875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 16:09:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:09:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:09:37 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 9f0473cd-bfe6-4b1c-83d0-6ede26811743 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 16:09:37 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance d6e7aedb-2302-467e-83ea-07584c5b86ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 16:09:37 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 16:09:37 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 16:09:37 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 16:09:37 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 16:09:37 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 16:09:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.225s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:09:37 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681229377.5638676, d6e7aedb-2302-467e-83ea-07584c5b86ff => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 16:09:37 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] VM Resumed (Lifecycle Event)
Apr 11 16:09:37 user nova-compute[71229]: DEBUG nova.compute.manager [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 16:09:37 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Guest created on hypervisor {{(pid=71229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 16:09:37 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Instance spawned successfully.
Apr 11 16:09:37 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 16:09:37 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 16:09:37 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 16:09:37 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Found default for hw_cdrom_bus of ide {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 16:09:37 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Found default for hw_disk_bus of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 16:09:37 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Found default for hw_input_bus of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 16:09:37 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Found default for hw_pointer_model of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 16:09:37 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Found default for hw_video_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 16:09:37 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Found default for hw_vif_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 16:09:37 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 16:09:37 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681229377.5682862, d6e7aedb-2302-467e-83ea-07584c5b86ff => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 16:09:37 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] VM Started (Lifecycle Event)
Apr 11 16:09:37 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 16:09:37 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 16:09:37 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 16:09:37 user nova-compute[71229]: INFO nova.compute.manager [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Took 5.35 seconds to spawn the instance on the hypervisor.
Apr 11 16:09:37 user nova-compute[71229]: DEBUG nova.compute.manager [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 16:09:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:09:37 user nova-compute[71229]: INFO nova.compute.manager [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Took 5.88 seconds to build instance.
Apr 11 16:09:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f91b92c0-9331-4cda-8e3b-2f1b983fabfb tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "d6e7aedb-2302-467e-83ea-07584c5b86ff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.978s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:09:37 user nova-compute[71229]: DEBUG nova.compute.manager [req-d2f74545-4f18-4eeb-8652-bec78024cb5f req-43613003-83c7-48ff-a729-2605f5eec32e service nova] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Received event network-vif-plugged-02de7a0f-1b41-4535-9edc-ea84c6b14447 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:09:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-d2f74545-4f18-4eeb-8652-bec78024cb5f req-43613003-83c7-48ff-a729-2605f5eec32e service nova] Acquiring lock "d6e7aedb-2302-467e-83ea-07584c5b86ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:09:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-d2f74545-4f18-4eeb-8652-bec78024cb5f req-43613003-83c7-48ff-a729-2605f5eec32e service nova] Lock "d6e7aedb-2302-467e-83ea-07584c5b86ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:09:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-d2f74545-4f18-4eeb-8652-bec78024cb5f req-43613003-83c7-48ff-a729-2605f5eec32e service nova] Lock "d6e7aedb-2302-467e-83ea-07584c5b86ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:09:37 user nova-compute[71229]: DEBUG nova.compute.manager [req-d2f74545-4f18-4eeb-8652-bec78024cb5f req-43613003-83c7-48ff-a729-2605f5eec32e service nova] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] No waiting events found dispatching network-vif-plugged-02de7a0f-1b41-4535-9edc-ea84c6b14447 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 16:09:37 user nova-compute[71229]: WARNING nova.compute.manager [req-d2f74545-4f18-4eeb-8652-bec78024cb5f req-43613003-83c7-48ff-a729-2605f5eec32e service nova] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Received unexpected event network-vif-plugged-02de7a0f-1b41-4535-9edc-ea84c6b14447 for instance with vm_state active and task_state None.
Apr 11 16:09:38 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:09:38 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:09:38 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:09:38 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:09:38 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:09:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:09:44 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:09:44 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:09:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:09:52 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:09:54 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:09:55 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:09:57 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:09:59 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:10:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:10:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:10:09 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:10:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:10:19 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:10:24 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:10:27 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:10:27 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 16:10:27 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:10:29 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:10:34 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:10:35 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:10:35 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 16:10:35 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Rebuilding the list of instances to heal {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 16:10:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "refresh_cache-9f0473cd-bfe6-4b1c-83d0-6ede26811743" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 16:10:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquired lock "refresh_cache-9f0473cd-bfe6-4b1c-83d0-6ede26811743" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 16:10:35 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Forcefully refreshing network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 16:10:35 user nova-compute[71229]: DEBUG nova.objects.instance [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lazy-loading 'info_cache' on Instance uuid 9f0473cd-bfe6-4b1c-83d0-6ede26811743 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:10:36 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Updating instance_info_cache with network_info: [{"id": "44472973-4f12-49d0-bab1-930a57c5a234", "address": "fa:16:3e:57:d2:ab", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44472973-4f", "ovs_interfaceid": "44472973-4f12-49d0-bab1-930a57c5a234", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 16:10:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Releasing lock "refresh_cache-9f0473cd-bfe6-4b1c-83d0-6ede26811743" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 16:10:36 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Updated the network info_cache for instance {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 16:10:36 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:10:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:10:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:10:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:10:36 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 16:10:36 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0473cd-bfe6-4b1c-83d0-6ede26811743/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:10:36 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0473cd-bfe6-4b1c-83d0-6ede26811743/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:10:36 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0473cd-bfe6-4b1c-83d0-6ede26811743/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:10:36 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0473cd-bfe6-4b1c-83d0-6ede26811743/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:10:36 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 16:10:36 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e7aedb-2302-467e-83ea-07584c5b86ff/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:10:36 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e7aedb-2302-467e-83ea-07584c5b86ff/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:10:36 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e7aedb-2302-467e-83ea-07584c5b86ff/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:10:36 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e7aedb-2302-467e-83ea-07584c5b86ff/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:10:37 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:10:37 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:10:37 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8783MB free_disk=25.94141387939453GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 16:10:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:10:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:10:37 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 9f0473cd-bfe6-4b1c-83d0-6ede26811743 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 16:10:37 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance d6e7aedb-2302-467e-83ea-07584c5b86ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 16:10:37 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 16:10:37 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 16:10:37 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 16:10:37 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 16:10:37 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 16:10:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.263s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:10:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:10:40 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:10:40 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:10:40 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:10:40 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:10:40 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:10:44 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:10:46 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:10:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:10:54 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:10:59 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:11:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:11:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:11:09 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:11:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:11:19 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:11:23 user nova-compute[71229]: DEBUG nova.compute.manager [req-1d30bf31-2770-4175-a805-d49e7c842716 req-1040a79f-4c82-4eab-98f4-d5da816e33e4 service nova] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Received event network-changed-02de7a0f-1b41-4535-9edc-ea84c6b14447 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:11:23 user nova-compute[71229]: DEBUG nova.compute.manager [req-1d30bf31-2770-4175-a805-d49e7c842716 req-1040a79f-4c82-4eab-98f4-d5da816e33e4 service nova] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Refreshing instance network info cache due to event network-changed-02de7a0f-1b41-4535-9edc-ea84c6b14447. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 16:11:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-1d30bf31-2770-4175-a805-d49e7c842716 req-1040a79f-4c82-4eab-98f4-d5da816e33e4 service nova] Acquiring lock "refresh_cache-d6e7aedb-2302-467e-83ea-07584c5b86ff" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 16:11:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-1d30bf31-2770-4175-a805-d49e7c842716 req-1040a79f-4c82-4eab-98f4-d5da816e33e4 service nova] Acquired lock "refresh_cache-d6e7aedb-2302-467e-83ea-07584c5b86ff" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 16:11:23 user nova-compute[71229]: DEBUG nova.network.neutron [req-1d30bf31-2770-4175-a805-d49e7c842716 req-1040a79f-4c82-4eab-98f4-d5da816e33e4 service nova] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Refreshing network info cache for port 02de7a0f-1b41-4535-9edc-ea84c6b14447 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 16:11:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-a8d46b50-9ade-4655-b80e-1f4b4c0e9887 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "d6e7aedb-2302-467e-83ea-07584c5b86ff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:11:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-a8d46b50-9ade-4655-b80e-1f4b4c0e9887 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "d6e7aedb-2302-467e-83ea-07584c5b86ff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:11:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-a8d46b50-9ade-4655-b80e-1f4b4c0e9887 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "d6e7aedb-2302-467e-83ea-07584c5b86ff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:11:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-a8d46b50-9ade-4655-b80e-1f4b4c0e9887 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "d6e7aedb-2302-467e-83ea-07584c5b86ff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:11:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-a8d46b50-9ade-4655-b80e-1f4b4c0e9887 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "d6e7aedb-2302-467e-83ea-07584c5b86ff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:11:23 user nova-compute[71229]: INFO nova.compute.manager [None req-a8d46b50-9ade-4655-b80e-1f4b4c0e9887 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Terminating instance
Apr 11 16:11:23 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a8d46b50-9ade-4655-b80e-1f4b4c0e9887 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Start destroying the instance on the hypervisor. {{(pid=71229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 16:11:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:11:23 user nova-compute[71229]: DEBUG nova.network.neutron [req-1d30bf31-2770-4175-a805-d49e7c842716 req-1040a79f-4c82-4eab-98f4-d5da816e33e4 service nova] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Updated VIF entry in instance network info cache for port 02de7a0f-1b41-4535-9edc-ea84c6b14447. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 16:11:23 user nova-compute[71229]: DEBUG nova.network.neutron [req-1d30bf31-2770-4175-a805-d49e7c842716 req-1040a79f-4c82-4eab-98f4-d5da816e33e4 service nova] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Updating instance_info_cache with network_info: [{"id": "02de7a0f-1b41-4535-9edc-ea84c6b14447", "address": "fa:16:3e:8d:28:6e", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02de7a0f-1b", "ovs_interfaceid": "02de7a0f-1b41-4535-9edc-ea84c6b14447", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 16:11:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-1d30bf31-2770-4175-a805-d49e7c842716 req-1040a79f-4c82-4eab-98f4-d5da816e33e4 service nova] Releasing lock "refresh_cache-d6e7aedb-2302-467e-83ea-07584c5b86ff" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 16:11:23 user nova-compute[71229]: DEBUG nova.compute.manager [req-68737f62-b617-4b98-bc97-e13389119f4b req-ad62fb6f-b09a-4e9f-bebb-1483a5574341 service nova] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Received event network-vif-unplugged-02de7a0f-1b41-4535-9edc-ea84c6b14447 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:11:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-68737f62-b617-4b98-bc97-e13389119f4b req-ad62fb6f-b09a-4e9f-bebb-1483a5574341 service nova] Acquiring lock "d6e7aedb-2302-467e-83ea-07584c5b86ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:11:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-68737f62-b617-4b98-bc97-e13389119f4b req-ad62fb6f-b09a-4e9f-bebb-1483a5574341 service nova] Lock "d6e7aedb-2302-467e-83ea-07584c5b86ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:11:23 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-68737f62-b617-4b98-bc97-e13389119f4b req-ad62fb6f-b09a-4e9f-bebb-1483a5574341 service nova] Lock "d6e7aedb-2302-467e-83ea-07584c5b86ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:11:23 user nova-compute[71229]: DEBUG nova.compute.manager [req-68737f62-b617-4b98-bc97-e13389119f4b req-ad62fb6f-b09a-4e9f-bebb-1483a5574341 service nova] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] No waiting events found dispatching network-vif-unplugged-02de7a0f-1b41-4535-9edc-ea84c6b14447 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 16:11:23 user nova-compute[71229]: DEBUG nova.compute.manager [req-68737f62-b617-4b98-bc97-e13389119f4b req-ad62fb6f-b09a-4e9f-bebb-1483a5574341 service nova] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Received event network-vif-unplugged-02de7a0f-1b41-4535-9edc-ea84c6b14447 for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 16:11:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:11:23 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:11:24 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:11:24 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Instance destroyed successfully.
Apr 11 16:11:24 user nova-compute[71229]: DEBUG nova.objects.instance [None req-a8d46b50-9ade-4655-b80e-1f4b4c0e9887 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lazy-loading 'resources' on Instance uuid d6e7aedb-2302-467e-83ea-07584c5b86ff {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:11:24 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-a8d46b50-9ade-4655-b80e-1f4b4c0e9887 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T16:09:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-874375628',display_name='tempest-AttachVolumeNegativeTest-server-874375628',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-874375628',id=43,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhwj5HGj4LqkFfhM3prw807GjlwL3+JFQFZdekOyHjeT6jf+I7UzZjFvxNMkZVw+IA5tbCxNem0yf/re31E+6LVdriMcJRoLpLI3OEdeLdLr+XUaVEpcYXyKT5L8RhAlw==',key_name='tempest-keypair-1619440901',keypairs=<?>,launch_index=0,launched_at=2023-04-11T16:09:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6241b8bab90c4f1991413b84c5241baf',ramdisk_id='',reservation_id='r-5gto2unz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-537147684',owner_user_name='tempest-AttachVolumeNegativeTest-537147684-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T16:09:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1332668b568e41a98bb68f6c28c92db9',uuid=d6e7aedb-2302-467e-83ea-07584c5b86ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "02de7a0f-1b41-4535-9edc-ea84c6b14447", "address": "fa:16:3e:8d:28:6e", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02de7a0f-1b", "ovs_interfaceid": "02de7a0f-1b41-4535-9edc-ea84c6b14447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 16:11:24 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-a8d46b50-9ade-4655-b80e-1f4b4c0e9887 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Converting VIF {"id": "02de7a0f-1b41-4535-9edc-ea84c6b14447", "address": "fa:16:3e:8d:28:6e", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02de7a0f-1b", "ovs_interfaceid": "02de7a0f-1b41-4535-9edc-ea84c6b14447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 16:11:24 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-a8d46b50-9ade-4655-b80e-1f4b4c0e9887 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:28:6e,bridge_name='br-int',has_traffic_filtering=True,id=02de7a0f-1b41-4535-9edc-ea84c6b14447,network=Network(c3def4c9-33a3-48eb-ad5c-45bb499758ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02de7a0f-1b') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 16:11:24 user nova-compute[71229]: DEBUG os_vif [None req-a8d46b50-9ade-4655-b80e-1f4b4c0e9887 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:28:6e,bridge_name='br-int',has_traffic_filtering=True,id=02de7a0f-1b41-4535-9edc-ea84c6b14447,network=Network(c3def4c9-33a3-48eb-ad5c-45bb499758ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02de7a0f-1b') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 16:11:24 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:11:24 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap02de7a0f-1b, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 16:11:24 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:11:24 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:11:24 user nova-compute[71229]: INFO os_vif [None req-a8d46b50-9ade-4655-b80e-1f4b4c0e9887 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:28:6e,bridge_name='br-int',has_traffic_filtering=True,id=02de7a0f-1b41-4535-9edc-ea84c6b14447,network=Network(c3def4c9-33a3-48eb-ad5c-45bb499758ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02de7a0f-1b')
Apr 11 16:11:24 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-a8d46b50-9ade-4655-b80e-1f4b4c0e9887 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Deleting instance files /opt/stack/data/nova/instances/d6e7aedb-2302-467e-83ea-07584c5b86ff_del
Apr 11 16:11:24 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-a8d46b50-9ade-4655-b80e-1f4b4c0e9887 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Deletion of /opt/stack/data/nova/instances/d6e7aedb-2302-467e-83ea-07584c5b86ff_del complete
Apr 11 16:11:24 user nova-compute[71229]: INFO nova.compute.manager [None req-a8d46b50-9ade-4655-b80e-1f4b4c0e9887 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Took 0.65 seconds to destroy the instance on the hypervisor.
Apr 11 16:11:24 user nova-compute[71229]: DEBUG oslo.service.loopingcall [None req-a8d46b50-9ade-4655-b80e-1f4b4c0e9887 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71229) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 16:11:24 user nova-compute[71229]: DEBUG nova.compute.manager [-] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Deallocating network for instance {{(pid=71229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 16:11:24 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] deallocate_for_instance() {{(pid=71229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 16:11:25 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 16:11:25 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Took 0.77 seconds to deallocate network for instance.
Apr 11 16:11:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-a8d46b50-9ade-4655-b80e-1f4b4c0e9887 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:11:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-a8d46b50-9ade-4655-b80e-1f4b4c0e9887 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:11:25 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-a8d46b50-9ade-4655-b80e-1f4b4c0e9887 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 16:11:25 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-a8d46b50-9ade-4655-b80e-1f4b4c0e9887 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 16:11:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-a8d46b50-9ade-4655-b80e-1f4b4c0e9887 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.130s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:11:25 user nova-compute[71229]: INFO nova.scheduler.client.report [None req-a8d46b50-9ade-4655-b80e-1f4b4c0e9887 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Deleted allocations for instance d6e7aedb-2302-467e-83ea-07584c5b86ff
Apr 11 16:11:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-a8d46b50-9ade-4655-b80e-1f4b4c0e9887 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "d6e7aedb-2302-467e-83ea-07584c5b86ff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.724s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:11:25 user nova-compute[71229]: DEBUG nova.compute.manager [req-3f9151ad-ed53-4dd9-8785-2d2e5b8952ad req-6b4bd80a-2bd3-4158-a35f-be0cf6a0936c service nova] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Received event network-vif-plugged-02de7a0f-1b41-4535-9edc-ea84c6b14447 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:11:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3f9151ad-ed53-4dd9-8785-2d2e5b8952ad req-6b4bd80a-2bd3-4158-a35f-be0cf6a0936c service nova] Acquiring lock "d6e7aedb-2302-467e-83ea-07584c5b86ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:11:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3f9151ad-ed53-4dd9-8785-2d2e5b8952ad req-6b4bd80a-2bd3-4158-a35f-be0cf6a0936c service nova] Lock "d6e7aedb-2302-467e-83ea-07584c5b86ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:11:25 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3f9151ad-ed53-4dd9-8785-2d2e5b8952ad req-6b4bd80a-2bd3-4158-a35f-be0cf6a0936c service nova] Lock "d6e7aedb-2302-467e-83ea-07584c5b86ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:11:25 user nova-compute[71229]: DEBUG nova.compute.manager [req-3f9151ad-ed53-4dd9-8785-2d2e5b8952ad req-6b4bd80a-2bd3-4158-a35f-be0cf6a0936c service nova] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] No waiting events found dispatching network-vif-plugged-02de7a0f-1b41-4535-9edc-ea84c6b14447 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 16:11:25 user nova-compute[71229]: WARNING nova.compute.manager [req-3f9151ad-ed53-4dd9-8785-2d2e5b8952ad req-6b4bd80a-2bd3-4158-a35f-be0cf6a0936c service nova] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Received unexpected event network-vif-plugged-02de7a0f-1b41-4535-9edc-ea84c6b14447 for instance with vm_state deleted and task_state None.
Apr 11 16:11:25 user nova-compute[71229]: DEBUG nova.compute.manager [req-3f9151ad-ed53-4dd9-8785-2d2e5b8952ad req-6b4bd80a-2bd3-4158-a35f-be0cf6a0936c service nova] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Received event network-vif-deleted-02de7a0f-1b41-4535-9edc-ea84c6b14447 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:11:27 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:11:28 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:11:28 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 16:11:29 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:11:34 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:11:35 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:11:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:11:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:11:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:11:35 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 16:11:35 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0473cd-bfe6-4b1c-83d0-6ede26811743/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:11:35 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0473cd-bfe6-4b1c-83d0-6ede26811743/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:11:35 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0473cd-bfe6-4b1c-83d0-6ede26811743/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:11:36 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0473cd-bfe6-4b1c-83d0-6ede26811743/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:11:36 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 16:11:36 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:11:36 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:11:36 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8836MB free_disk=25.960338592529297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 16:11:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:11:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:11:36 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 9f0473cd-bfe6-4b1c-83d0-6ede26811743 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 16:11:36 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 16:11:36 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 16:11:36 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 16:11:36 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 16:11:36 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 16:11:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:11:37 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:11:37 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 16:11:37 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Didn't find any instances for network info cache update. {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 16:11:38 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:11:39 user nova-compute[71229]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681229484.1635308, d6e7aedb-2302-467e-83ea-07584c5b86ff => Stopped> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 16:11:39 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] VM Stopped (Lifecycle Event)
Apr 11 16:11:39 user nova-compute[71229]: DEBUG nova.compute.manager [None req-dbc3db2c-b6ed-4102-92c5-1e7c840df3f0 None None] [instance: d6e7aedb-2302-467e-83ea-07584c5b86ff] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 16:11:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:11:40 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:11:40 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:11:40 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:11:42 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:11:44 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:11:46 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:11:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:11:54 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:11:58 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:11:59 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:12:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:12:09 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:12:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:12:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:12:14 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4851de25-1d81-4b02-bae4-4a826e285193 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "9f0473cd-bfe6-4b1c-83d0-6ede26811743" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:12:14 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4851de25-1d81-4b02-bae4-4a826e285193 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "9f0473cd-bfe6-4b1c-83d0-6ede26811743" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:12:14 user nova-compute[71229]: INFO nova.compute.manager [None req-4851de25-1d81-4b02-bae4-4a826e285193 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Detaching volume f728a0e1-861e-4f16-9255-fedbc1830b37
Apr 11 16:12:14 user nova-compute[71229]: INFO nova.virt.block_device [None req-4851de25-1d81-4b02-bae4-4a826e285193 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Attempting to driver detach volume f728a0e1-861e-4f16-9255-fedbc1830b37 from mountpoint /dev/vdb
Apr 11 16:12:14 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-4851de25-1d81-4b02-bae4-4a826e285193 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Attempting to detach device vdb from instance 9f0473cd-bfe6-4b1c-83d0-6ede26811743 from the persistent domain config. {{(pid=71229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 16:12:14 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-4851de25-1d81-4b02-bae4-4a826e285193 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 16:12:14 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 16:12:14 user nova-compute[71229]:   <source dev="/dev/sdb"/>
Apr 11 16:12:14 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 16:12:14 user nova-compute[71229]:   <serial>f728a0e1-861e-4f16-9255-fedbc1830b37</serial>
Apr 11 16:12:14 user nova-compute[71229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 16:12:14 user nova-compute[71229]: </disk>
Apr 11 16:12:14 user nova-compute[71229]:  {{(pid=71229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 16:12:14 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-4851de25-1d81-4b02-bae4-4a826e285193 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Successfully detached device vdb from instance 9f0473cd-bfe6-4b1c-83d0-6ede26811743 from the persistent domain config.
Apr 11 16:12:14 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-4851de25-1d81-4b02-bae4-4a826e285193 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9f0473cd-bfe6-4b1c-83d0-6ede26811743 from the live domain config. {{(pid=71229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 16:12:14 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-4851de25-1d81-4b02-bae4-4a826e285193 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 16:12:14 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 16:12:14 user nova-compute[71229]:   <source dev="/dev/sdb"/>
Apr 11 16:12:14 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 16:12:14 user nova-compute[71229]:   <serial>f728a0e1-861e-4f16-9255-fedbc1830b37</serial>
Apr 11 16:12:14 user nova-compute[71229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 16:12:14 user nova-compute[71229]: </disk>
Apr 11 16:12:14 user nova-compute[71229]:  {{(pid=71229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 16:12:15 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Received event <DeviceRemovedEvent: 1681229535.442143, 9f0473cd-bfe6-4b1c-83d0-6ede26811743 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71229) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 16:12:15 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-4851de25-1d81-4b02-bae4-4a826e285193 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9f0473cd-bfe6-4b1c-83d0-6ede26811743 {{(pid=71229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 16:12:15 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-4851de25-1d81-4b02-bae4-4a826e285193 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Successfully detached device vdb from instance 9f0473cd-bfe6-4b1c-83d0-6ede26811743 from the live domain config.
Apr 11 16:12:15 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4851de25-1d81-4b02-bae4-4a826e285193 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 16:12:15 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4851de25-1d81-4b02-bae4-4a826e285193 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:f728a0e1-861e-4f16-9255-fedbc1830b37', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nzcgDayN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 16:12:15 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-4851de25-1d81-4b02-bae4-4a826e285193 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 16:12:15 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-4851de25-1d81-4b02-bae4-4a826e285193 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 16:12:15 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-4851de25-1d81-4b02-bae4-4a826e285193 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 16:12:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:12:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:12:15 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b711b8-6f86-4b8e-8124-472744950aa0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f728a0e1-861e-4f16-9255-fedbc1830b37\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:12:15 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4851de25-1d81-4b02-bae4-4a826e285193 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 16:12:15 user nova-compute[71229]: No targets found.
Apr 11 16:12:15 user nova-compute[71229]: iSNS:
Apr 11 16:12:15 user nova-compute[71229]: No targets found.
Apr 11 16:12:15 user nova-compute[71229]: STATIC:
Apr 11 16:12:15 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:f728a0e1-861e-4f16-9255-fedbc1830b37
Apr 11 16:12:15 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 16:12:15 user nova-compute[71229]:                 Iface Name: default
Apr 11 16:12:15 user nova-compute[71229]: FIRMWARE:
Apr 11 16:12:15 user nova-compute[71229]: No targets found.
Apr 11 16:12:15 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 16:12:15 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4851de25-1d81-4b02-bae4-4a826e285193 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 16:12:15 user nova-compute[71229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 16:12:15 user nova-compute[71229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71229) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 16:12:15 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4851de25-1d81-4b02-bae4-4a826e285193 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f728a0e1-861e-4f16-9255-fedbc1830b37', 0)] {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 16:12:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:12:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:12:15 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[42105b69-32bf-4730-b9f6-4c1b01f27f50]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f728a0e1-861e-4f16-9255-fedbc1830b37\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:12:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:12:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:12:15 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb087a99-9616-4400-be03-3f9da2ad26f2]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f728a0e1-861e-4f16-9255-fedbc1830b37 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:12:15 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4851de25-1d81-4b02-bae4-4a826e285193 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f728a0e1-861e-4f16-9255-fedbc1830b37 (non-flash)
Apr 11 16:12:15 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 16:12:15 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4851de25-1d81-4b02-bae4-4a826e285193 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f728a0e1-861e-4f16-9255-fedbc1830b37 (non-flash)
Apr 11 16:12:15 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 16:12:15 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4851de25-1d81-4b02-bae4-4a826e285193 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb5c27cca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f728a0e1-861e-4f16-9255-fedbc1830b37'): ({'sdb'}, set())}) {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 16:12:15 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-4851de25-1d81-4b02-bae4-4a826e285193 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Removing single pathed devices sdb {{(pid=71229) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 16:12:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:12:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:12:15 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5152a33-1666-4f2a-9438-bf802481b827]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:12:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:12:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:12:15 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc8cbc7-9d65-4ad9-9a01-0287f3d59595]: (4, ('ok\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:12:15 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-4851de25-1d81-4b02-bae4-4a826e285193 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Flushing IO for device /dev/sdb {{(pid=71229) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 16:12:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:12:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:12:15 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f19ea5e-3b76-40fd-ba10-7592523952ef]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:12:15 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-4851de25-1d81-4b02-bae4-4a826e285193 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71229) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 16:12:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:12:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:12:15 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8593d8-c041-493d-baba-7be5e6d89261]: (4, ('1', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:12:15 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-4851de25-1d81-4b02-bae4-4a826e285193 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 16:12:15 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-4851de25-1d81-4b02-bae4-4a826e285193 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] SCSI volumes sdb have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 16:12:15 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4851de25-1d81-4b02-bae4-4a826e285193 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f728a0e1-861e-4f16-9255-fedbc1830b37')] {{(pid=71229) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 16:12:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f728a0e1-861e-4f16-9255-fedbc1830b37 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:12:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f728a0e1-861e-4f16-9255-fedbc1830b37 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:12:15 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[881effc7-8864-4e8f-99b9-036bcbd0d415]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:12:15 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4851de25-1d81-4b02-bae4-4a826e285193 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:12:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f728a0e1-861e-4f16-9255-fedbc1830b37 -p 172.16.0.220:3260 --logout {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:12:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f728a0e1-861e-4f16-9255-fedbc1830b37 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:12:15 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01a784f-c638-4c6e-bdfe-ec3789aa1b9c]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:f728a0e1-861e-4f16-9255-fedbc1830b37, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:f728a0e1-861e-4f16-9255-fedbc1830b37, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:12:15 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4851de25-1d81-4b02-bae4-4a826e285193 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:f728a0e1-861e-4f16-9255-fedbc1830b37, portal: 172.16.0.220,3260]
Apr 11 16:12:15 user nova-compute[71229]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:f728a0e1-861e-4f16-9255-fedbc1830b37, portal: 172.16.0.220,3260] successful.
Apr 11 16:12:15 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:12:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f728a0e1-861e-4f16-9255-fedbc1830b37 -p 172.16.0.220:3260 --op delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:12:15 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f728a0e1-861e-4f16-9255-fedbc1830b37 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:12:15 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[75314bce-430a-4810-9e1e-f4a9c0e5f6d5]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:12:15 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4851de25-1d81-4b02-bae4-4a826e285193 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:12:15 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-4851de25-1d81-4b02-bae4-4a826e285193 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 16:12:15 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-4851de25-1d81-4b02-bae4-4a826e285193 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] <== disconnect_volume: return (296ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 16:12:15 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4851de25-1d81-4b02-bae4-4a826e285193 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 16:12:16 user nova-compute[71229]: DEBUG nova.objects.instance [None req-4851de25-1d81-4b02-bae4-4a826e285193 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lazy-loading 'flavor' on Instance uuid 9f0473cd-bfe6-4b1c-83d0-6ede26811743 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:12:16 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-4851de25-1d81-4b02-bae4-4a826e285193 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "9f0473cd-bfe6-4b1c-83d0-6ede26811743" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.713s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:12:19 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:12:24 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:12:29 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:12:30 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:12:30 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 16:12:34 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:12:36 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:12:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:12:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:12:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:12:36 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 16:12:36 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0473cd-bfe6-4b1c-83d0-6ede26811743/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:12:36 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0473cd-bfe6-4b1c-83d0-6ede26811743/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:12:36 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0473cd-bfe6-4b1c-83d0-6ede26811743/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:12:37 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f0473cd-bfe6-4b1c-83d0-6ede26811743/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:12:37 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:12:37 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:12:37 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8839MB free_disk=25.959590911865234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 16:12:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:12:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:12:37 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 9f0473cd-bfe6-4b1c-83d0-6ede26811743 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 16:12:37 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 16:12:37 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 16:12:37 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 16:12:37 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 16:12:37 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 16:12:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.181s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:12:38 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:12:38 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 16:12:38 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Rebuilding the list of instances to heal {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 16:12:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "refresh_cache-9f0473cd-bfe6-4b1c-83d0-6ede26811743" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 16:12:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquired lock "refresh_cache-9f0473cd-bfe6-4b1c-83d0-6ede26811743" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 16:12:38 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Forcefully refreshing network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 16:12:38 user nova-compute[71229]: DEBUG nova.objects.instance [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lazy-loading 'info_cache' on Instance uuid 9f0473cd-bfe6-4b1c-83d0-6ede26811743 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:12:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:12:39 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Updating instance_info_cache with network_info: [{"id": "44472973-4f12-49d0-bab1-930a57c5a234", "address": "fa:16:3e:57:d2:ab", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44472973-4f", "ovs_interfaceid": "44472973-4f12-49d0-bab1-930a57c5a234", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 16:12:39 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Releasing lock "refresh_cache-9f0473cd-bfe6-4b1c-83d0-6ede26811743" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 16:12:39 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Updated the network info_cache for instance {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 16:12:39 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:12:39 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Cleaning up deleted instances {{(pid=71229) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 16:12:39 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] There are 0 instances to clean {{(pid=71229) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 16:12:40 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:12:41 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:12:42 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:12:42 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:12:44 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:12:44 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:12:47 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:12:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:12:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:12:52 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:12:52 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71229) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 16:12:54 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:12:59 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:13:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:13:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:13:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:13:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:13:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:13:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:13:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b3159bcd-9e90-49cc-8887-af4e35f52ddc tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "9f0473cd-bfe6-4b1c-83d0-6ede26811743" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:13:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b3159bcd-9e90-49cc-8887-af4e35f52ddc tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "9f0473cd-bfe6-4b1c-83d0-6ede26811743" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:13:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b3159bcd-9e90-49cc-8887-af4e35f52ddc tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "9f0473cd-bfe6-4b1c-83d0-6ede26811743-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:13:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b3159bcd-9e90-49cc-8887-af4e35f52ddc tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "9f0473cd-bfe6-4b1c-83d0-6ede26811743-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:13:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b3159bcd-9e90-49cc-8887-af4e35f52ddc tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "9f0473cd-bfe6-4b1c-83d0-6ede26811743-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:13:05 user nova-compute[71229]: INFO nova.compute.manager [None req-b3159bcd-9e90-49cc-8887-af4e35f52ddc tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Terminating instance
Apr 11 16:13:05 user nova-compute[71229]: DEBUG nova.compute.manager [None req-b3159bcd-9e90-49cc-8887-af4e35f52ddc tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Start destroying the instance on the hypervisor. {{(pid=71229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 16:13:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:13:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:13:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:13:05 user nova-compute[71229]: DEBUG nova.compute.manager [req-26b96ea8-037d-4326-a798-1c815eb7e2e3 req-0058357d-2590-4ae5-b0a8-c484e23cc87d service nova] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Received event network-vif-unplugged-44472973-4f12-49d0-bab1-930a57c5a234 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:13:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-26b96ea8-037d-4326-a798-1c815eb7e2e3 req-0058357d-2590-4ae5-b0a8-c484e23cc87d service nova] Acquiring lock "9f0473cd-bfe6-4b1c-83d0-6ede26811743-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:13:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-26b96ea8-037d-4326-a798-1c815eb7e2e3 req-0058357d-2590-4ae5-b0a8-c484e23cc87d service nova] Lock "9f0473cd-bfe6-4b1c-83d0-6ede26811743-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:13:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-26b96ea8-037d-4326-a798-1c815eb7e2e3 req-0058357d-2590-4ae5-b0a8-c484e23cc87d service nova] Lock "9f0473cd-bfe6-4b1c-83d0-6ede26811743-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:13:05 user nova-compute[71229]: DEBUG nova.compute.manager [req-26b96ea8-037d-4326-a798-1c815eb7e2e3 req-0058357d-2590-4ae5-b0a8-c484e23cc87d service nova] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] No waiting events found dispatching network-vif-unplugged-44472973-4f12-49d0-bab1-930a57c5a234 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 16:13:05 user nova-compute[71229]: DEBUG nova.compute.manager [req-26b96ea8-037d-4326-a798-1c815eb7e2e3 req-0058357d-2590-4ae5-b0a8-c484e23cc87d service nova] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Received event network-vif-unplugged-44472973-4f12-49d0-bab1-930a57c5a234 for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 16:13:05 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:13:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:13:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:13:06 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Instance destroyed successfully.
Apr 11 16:13:06 user nova-compute[71229]: DEBUG nova.objects.instance [None req-b3159bcd-9e90-49cc-8887-af4e35f52ddc tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lazy-loading 'resources' on Instance uuid 9f0473cd-bfe6-4b1c-83d0-6ede26811743 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:13:06 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-b3159bcd-9e90-49cc-8887-af4e35f52ddc tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T16:07:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1014812344',display_name='tempest-AttachVolumeNegativeTest-server-1014812344',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1014812344',id=42,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZlx+pLUniXvWrJxlxiw5Q+BoJuFNLs4p2kBVBWKeduQ8+tLSOSPSY9wKUYy0gnOh+MHugFjOkVfE6Zpf/rtzSv/FPhR8I4RBXImWMlF3W7sSu4IRSYaCGk6aSma3hmjA==',key_name='tempest-keypair-1339074440',keypairs=<?>,launch_index=0,launched_at=2023-04-11T16:07:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6241b8bab90c4f1991413b84c5241baf',ramdisk_id='',reservation_id='r-jk80mvfn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-537147684',owner_user_name='tempest-AttachVolumeNegativeTest-537147684-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T16:07:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1332668b568e41a98bb68f6c28c92db9',uuid=9f0473cd-bfe6-4b1c-83d0-6ede26811743,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "44472973-4f12-49d0-bab1-930a57c5a234", "address": "fa:16:3e:57:d2:ab", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44472973-4f", "ovs_interfaceid": "44472973-4f12-49d0-bab1-930a57c5a234", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 16:13:06 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-b3159bcd-9e90-49cc-8887-af4e35f52ddc tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Converting VIF {"id": "44472973-4f12-49d0-bab1-930a57c5a234", "address": "fa:16:3e:57:d2:ab", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44472973-4f", "ovs_interfaceid": "44472973-4f12-49d0-bab1-930a57c5a234", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 16:13:06 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-b3159bcd-9e90-49cc-8887-af4e35f52ddc tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:d2:ab,bridge_name='br-int',has_traffic_filtering=True,id=44472973-4f12-49d0-bab1-930a57c5a234,network=Network(c3def4c9-33a3-48eb-ad5c-45bb499758ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44472973-4f') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 16:13:06 user nova-compute[71229]: DEBUG os_vif [None req-b3159bcd-9e90-49cc-8887-af4e35f52ddc tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:d2:ab,bridge_name='br-int',has_traffic_filtering=True,id=44472973-4f12-49d0-bab1-930a57c5a234,network=Network(c3def4c9-33a3-48eb-ad5c-45bb499758ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44472973-4f') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 16:13:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:13:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap44472973-4f, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 16:13:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:13:06 user nova-compute[71229]: INFO os_vif [None req-b3159bcd-9e90-49cc-8887-af4e35f52ddc tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:d2:ab,bridge_name='br-int',has_traffic_filtering=True,id=44472973-4f12-49d0-bab1-930a57c5a234,network=Network(c3def4c9-33a3-48eb-ad5c-45bb499758ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44472973-4f')
Apr 11 16:13:06 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-b3159bcd-9e90-49cc-8887-af4e35f52ddc tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Deleting instance files /opt/stack/data/nova/instances/9f0473cd-bfe6-4b1c-83d0-6ede26811743_del
Apr 11 16:13:06 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-b3159bcd-9e90-49cc-8887-af4e35f52ddc tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Deletion of /opt/stack/data/nova/instances/9f0473cd-bfe6-4b1c-83d0-6ede26811743_del complete
Apr 11 16:13:06 user nova-compute[71229]: INFO nova.compute.manager [None req-b3159bcd-9e90-49cc-8887-af4e35f52ddc tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Took 0.82 seconds to destroy the instance on the hypervisor.
Apr 11 16:13:06 user nova-compute[71229]: DEBUG oslo.service.loopingcall [None req-b3159bcd-9e90-49cc-8887-af4e35f52ddc tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71229) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 16:13:06 user nova-compute[71229]: DEBUG nova.compute.manager [-] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Deallocating network for instance {{(pid=71229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 16:13:06 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] deallocate_for_instance() {{(pid=71229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 16:13:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:13:06 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 16:13:06 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Took 0.76 seconds to deallocate network for instance.
Apr 11 16:13:06 user nova-compute[71229]: DEBUG nova.compute.manager [req-e43627a2-5446-4f45-8b72-559ade087684 req-c47afbe7-f0b1-45eb-8059-e939a6892ffc service nova] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Received event network-vif-deleted-44472973-4f12-49d0-bab1-930a57c5a234 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:13:06 user nova-compute[71229]: INFO nova.compute.manager [req-e43627a2-5446-4f45-8b72-559ade087684 req-c47afbe7-f0b1-45eb-8059-e939a6892ffc service nova] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Neutron deleted interface 44472973-4f12-49d0-bab1-930a57c5a234; detaching it from the instance and deleting it from the info cache
Apr 11 16:13:06 user nova-compute[71229]: DEBUG nova.network.neutron [req-e43627a2-5446-4f45-8b72-559ade087684 req-c47afbe7-f0b1-45eb-8059-e939a6892ffc service nova] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 16:13:06 user nova-compute[71229]: DEBUG nova.compute.manager [req-e43627a2-5446-4f45-8b72-559ade087684 req-c47afbe7-f0b1-45eb-8059-e939a6892ffc service nova] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Detach interface failed, port_id=44472973-4f12-49d0-bab1-930a57c5a234, reason: Instance 9f0473cd-bfe6-4b1c-83d0-6ede26811743 could not be found. {{(pid=71229) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 16:13:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b3159bcd-9e90-49cc-8887-af4e35f52ddc tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:13:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b3159bcd-9e90-49cc-8887-af4e35f52ddc tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:13:07 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-b3159bcd-9e90-49cc-8887-af4e35f52ddc tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 16:13:07 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-b3159bcd-9e90-49cc-8887-af4e35f52ddc tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 16:13:07 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b3159bcd-9e90-49cc-8887-af4e35f52ddc tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.110s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:13:07 user nova-compute[71229]: INFO nova.scheduler.client.report [None req-b3159bcd-9e90-49cc-8887-af4e35f52ddc tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Deleted allocations for instance 9f0473cd-bfe6-4b1c-83d0-6ede26811743
Apr 11 16:13:07 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b3159bcd-9e90-49cc-8887-af4e35f52ddc tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "9f0473cd-bfe6-4b1c-83d0-6ede26811743" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.890s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:13:07 user nova-compute[71229]: DEBUG nova.compute.manager [req-961e6315-74d5-4650-be30-024e6c625059 req-e1056120-59be-444a-aba9-d568cb450f10 service nova] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Received event network-vif-plugged-44472973-4f12-49d0-bab1-930a57c5a234 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:13:07 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-961e6315-74d5-4650-be30-024e6c625059 req-e1056120-59be-444a-aba9-d568cb450f10 service nova] Acquiring lock "9f0473cd-bfe6-4b1c-83d0-6ede26811743-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:13:07 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-961e6315-74d5-4650-be30-024e6c625059 req-e1056120-59be-444a-aba9-d568cb450f10 service nova] Lock "9f0473cd-bfe6-4b1c-83d0-6ede26811743-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:13:07 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-961e6315-74d5-4650-be30-024e6c625059 req-e1056120-59be-444a-aba9-d568cb450f10 service nova] Lock "9f0473cd-bfe6-4b1c-83d0-6ede26811743-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:13:07 user nova-compute[71229]: DEBUG nova.compute.manager [req-961e6315-74d5-4650-be30-024e6c625059 req-e1056120-59be-444a-aba9-d568cb450f10 service nova] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] No waiting events found dispatching network-vif-plugged-44472973-4f12-49d0-bab1-930a57c5a234 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 16:13:07 user nova-compute[71229]: WARNING nova.compute.manager [req-961e6315-74d5-4650-be30-024e6c625059 req-e1056120-59be-444a-aba9-d568cb450f10 service nova] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Received unexpected event network-vif-plugged-44472973-4f12-49d0-bab1-930a57c5a234 for instance with vm_state deleted and task_state None.
Apr 11 16:13:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:13:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:13:21 user nova-compute[71229]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681229586.0471175, 9f0473cd-bfe6-4b1c-83d0-6ede26811743 => Stopped> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 16:13:21 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] VM Stopped (Lifecycle Event)
Apr 11 16:13:21 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73450007-bc64-43fa-b384-ef3e2348cf50 None None] [instance: 9f0473cd-bfe6-4b1c-83d0-6ede26811743] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 16:13:21 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:13:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:13:30 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:13:30 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 16:13:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:13:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:13:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:13:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:13:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:13:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:13:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:13:37 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:13:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:13:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:13:37 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:13:37 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 16:13:38 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:13:38 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:13:38 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8949MB free_disk=25.97864532470703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 16:13:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:13:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:13:38 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 16:13:38 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 16:13:38 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Refreshing inventories for resource provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 16:13:38 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Updating ProviderTree inventory for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 16:13:38 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Updating inventory in ProviderTree for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 16:13:38 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Refreshing aggregate associations for resource provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de, aggregates: None {{(pid=71229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 16:13:38 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Refreshing trait associations for resource provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de, traits: COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=71229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 16:13:38 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 16:13:38 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 16:13:38 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 16:13:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.434s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:13:39 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:13:39 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 16:13:39 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Rebuilding the list of instances to heal {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 16:13:39 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Didn't find any instances for network info cache update. {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 16:13:40 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:13:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:13:42 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:13:42 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:13:43 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:13:45 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:13:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:13:48 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:13:51 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:13:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:13:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:13:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "cce5fba0-a0e4-46c1-8388-96a979360371" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:13:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "cce5fba0-a0e4-46c1-8388-96a979360371" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:13:58 user nova-compute[71229]: DEBUG nova.compute.manager [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Starting instance... {{(pid=71229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 16:13:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:13:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:13:58 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 16:13:58 user nova-compute[71229]: INFO nova.compute.claims [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Claim successful on node user
Apr 11 16:13:59 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 16:13:59 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 16:13:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.227s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:13:59 user nova-compute[71229]: DEBUG nova.compute.manager [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Start building networks asynchronously for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 16:13:59 user nova-compute[71229]: DEBUG nova.compute.manager [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Allocating IP information in the background. {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 16:13:59 user nova-compute[71229]: DEBUG nova.network.neutron [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] allocate_for_instance() {{(pid=71229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 16:13:59 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 16:13:59 user nova-compute[71229]: DEBUG nova.compute.manager [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Start building block device mappings for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 16:13:59 user nova-compute[71229]: DEBUG nova.policy [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1332668b568e41a98bb68f6c28c92db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6241b8bab90c4f1991413b84c5241baf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71229) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 16:13:59 user nova-compute[71229]: DEBUG nova.compute.manager [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Start spawning the instance on the hypervisor. {{(pid=71229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 16:13:59 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Creating instance directory {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 16:13:59 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Creating image(s)
Apr 11 16:13:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "/opt/stack/data/nova/instances/cce5fba0-a0e4-46c1-8388-96a979360371/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:13:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "/opt/stack/data/nova/instances/cce5fba0-a0e4-46c1-8388-96a979360371/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:13:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "/opt/stack/data/nova/instances/cce5fba0-a0e4-46c1-8388-96a979360371/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:13:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:13:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.132s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:13:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:13:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:13:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:13:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.135s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:13:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/cce5fba0-a0e4-46c1-8388-96a979360371/disk 1073741824 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:13:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/cce5fba0-a0e4-46c1-8388-96a979360371/disk 1073741824" returned: 0 in 0.053s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:13:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:13:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:13:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.133s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:13:59 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cce5fba0-a0e4-46c1-8388-96a979360371/disk. size=1073741824 {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 16:13:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce5fba0-a0e4-46c1-8388-96a979360371/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:13:59 user nova-compute[71229]: DEBUG nova.network.neutron [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Successfully created port: 928d0128-648f-46b1-85df-d743f3b9b642 {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 16:13:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce5fba0-a0e4-46c1-8388-96a979360371/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:13:59 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Cannot resize image /opt/stack/data/nova/instances/cce5fba0-a0e4-46c1-8388-96a979360371/disk to a smaller size. {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 16:13:59 user nova-compute[71229]: DEBUG nova.objects.instance [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lazy-loading 'migration_context' on Instance uuid cce5fba0-a0e4-46c1-8388-96a979360371 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:13:59 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Created local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 16:13:59 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Ensure instance console log exists: /opt/stack/data/nova/instances/cce5fba0-a0e4-46c1-8388-96a979360371/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 16:13:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:13:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:13:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:14:00 user nova-compute[71229]: DEBUG nova.network.neutron [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Successfully updated port: 928d0128-648f-46b1-85df-d743f3b9b642 {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 16:14:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "refresh_cache-cce5fba0-a0e4-46c1-8388-96a979360371" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 16:14:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquired lock "refresh_cache-cce5fba0-a0e4-46c1-8388-96a979360371" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 16:14:00 user nova-compute[71229]: DEBUG nova.network.neutron [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 16:14:00 user nova-compute[71229]: DEBUG nova.compute.manager [req-ec2a0e2e-5f2c-4337-b71b-a5d266848326 req-e5add60f-e6d3-482f-b092-de065b8c3eaf service nova] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Received event network-changed-928d0128-648f-46b1-85df-d743f3b9b642 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:14:00 user nova-compute[71229]: DEBUG nova.compute.manager [req-ec2a0e2e-5f2c-4337-b71b-a5d266848326 req-e5add60f-e6d3-482f-b092-de065b8c3eaf service nova] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Refreshing instance network info cache due to event network-changed-928d0128-648f-46b1-85df-d743f3b9b642. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 16:14:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-ec2a0e2e-5f2c-4337-b71b-a5d266848326 req-e5add60f-e6d3-482f-b092-de065b8c3eaf service nova] Acquiring lock "refresh_cache-cce5fba0-a0e4-46c1-8388-96a979360371" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 16:14:00 user nova-compute[71229]: DEBUG nova.network.neutron [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 16:14:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:14:01 user nova-compute[71229]: DEBUG nova.network.neutron [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Updating instance_info_cache with network_info: [{"id": "928d0128-648f-46b1-85df-d743f3b9b642", "address": "fa:16:3e:0f:7a:2d", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap928d0128-64", "ovs_interfaceid": "928d0128-648f-46b1-85df-d743f3b9b642", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 16:14:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Releasing lock "refresh_cache-cce5fba0-a0e4-46c1-8388-96a979360371" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 16:14:01 user nova-compute[71229]: DEBUG nova.compute.manager [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Instance network_info: |[{"id": "928d0128-648f-46b1-85df-d743f3b9b642", "address": "fa:16:3e:0f:7a:2d", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap928d0128-64", "ovs_interfaceid": "928d0128-648f-46b1-85df-d743f3b9b642", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 16:14:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-ec2a0e2e-5f2c-4337-b71b-a5d266848326 req-e5add60f-e6d3-482f-b092-de065b8c3eaf service nova] Acquired lock "refresh_cache-cce5fba0-a0e4-46c1-8388-96a979360371" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 16:14:01 user nova-compute[71229]: DEBUG nova.network.neutron [req-ec2a0e2e-5f2c-4337-b71b-a5d266848326 req-e5add60f-e6d3-482f-b092-de065b8c3eaf service nova] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Refreshing network info cache for port 928d0128-648f-46b1-85df-d743f3b9b642 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 16:14:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Start _get_guest_xml network_info=[{"id": "928d0128-648f-46b1-85df-d743f3b9b642", "address": "fa:16:3e:0f:7a:2d", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap928d0128-64", "ovs_interfaceid": "928d0128-648f-46b1-85df-d743f3b9b642", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '52fe638c-5ada-47d5-b376-233bfa808a37'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 16:14:01 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:14:01 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:14:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 16:14:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 16:14:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 16:14:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 16:14:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 16:14:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 16:14:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 16:14:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 16:14:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 16:14:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 16:14:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 16:14:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 16:14:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T16:13:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-504159588',display_name='tempest-AttachVolumeNegativeTest-server-504159588',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-504159588',id=44,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyO65adxfnVO95Gl79TghN3BBsPLDFp/eUd08QommzWWwIKtuKJGjj42drTustAaitCK+3fvkqSKUysqopyv7x6I5217CTf1uAlkBGpbqxX4XQl8IocH35tVRtEYrg6Fg==',key_name='tempest-keypair-1806827597',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6241b8bab90c4f1991413b84c5241baf',ramdisk_id='',reservation_id='r-ikj3yzsd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-537147684',owner_user_name='tempest-AttachVolumeNegativeTest-537147684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T16:13:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1332668b568e41a98bb68f6c28c92db9',uuid=cce5fba0-a0e4-46c1-8388-96a979360371,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "928d0128-648f-46b1-85df-d743f3b9b642", "address": "fa:16:3e:0f:7a:2d", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap928d0128-64", "ovs_interfaceid": "928d0128-648f-46b1-85df-d743f3b9b642", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 16:14:01 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Converting VIF {"id": "928d0128-648f-46b1-85df-d743f3b9b642", "address": "fa:16:3e:0f:7a:2d", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap928d0128-64", "ovs_interfaceid": "928d0128-648f-46b1-85df-d743f3b9b642", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 16:14:01 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:7a:2d,bridge_name='br-int',has_traffic_filtering=True,id=928d0128-648f-46b1-85df-d743f3b9b642,network=Network(c3def4c9-33a3-48eb-ad5c-45bb499758ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap928d0128-64') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 16:14:01 user nova-compute[71229]: DEBUG nova.objects.instance [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lazy-loading 'pci_devices' on Instance uuid cce5fba0-a0e4-46c1-8388-96a979360371 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:14:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] End _get_guest_xml xml=<domain type="kvm">
Apr 11 16:14:01 user nova-compute[71229]:   <uuid>cce5fba0-a0e4-46c1-8388-96a979360371</uuid>
Apr 11 16:14:01 user nova-compute[71229]:   <name>instance-0000002c</name>
Apr 11 16:14:01 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 16:14:01 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 16:14:01 user nova-compute[71229]:   <metadata>
Apr 11 16:14:01 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 16:14:01 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 16:14:01 user nova-compute[71229]:       <nova:name>tempest-AttachVolumeNegativeTest-server-504159588</nova:name>
Apr 11 16:14:01 user nova-compute[71229]:       <nova:creationTime>2023-04-11 16:14:01</nova:creationTime>
Apr 11 16:14:01 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 16:14:01 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 16:14:01 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 16:14:01 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 16:14:01 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 16:14:01 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 16:14:01 user nova-compute[71229]:       </nova:flavor>
Apr 11 16:14:01 user nova-compute[71229]:       <nova:owner>
Apr 11 16:14:01 user nova-compute[71229]:         <nova:user uuid="1332668b568e41a98bb68f6c28c92db9">tempest-AttachVolumeNegativeTest-537147684-project-member</nova:user>
Apr 11 16:14:01 user nova-compute[71229]:         <nova:project uuid="6241b8bab90c4f1991413b84c5241baf">tempest-AttachVolumeNegativeTest-537147684</nova:project>
Apr 11 16:14:01 user nova-compute[71229]:       </nova:owner>
Apr 11 16:14:01 user nova-compute[71229]:       <nova:root type="image" uuid="52fe638c-5ada-47d5-b376-233bfa808a37"/>
Apr 11 16:14:01 user nova-compute[71229]:       <nova:ports>
Apr 11 16:14:01 user nova-compute[71229]:         <nova:port uuid="928d0128-648f-46b1-85df-d743f3b9b642">
Apr 11 16:14:01 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 11 16:14:01 user nova-compute[71229]:         </nova:port>
Apr 11 16:14:01 user nova-compute[71229]:       </nova:ports>
Apr 11 16:14:01 user nova-compute[71229]:     </nova:instance>
Apr 11 16:14:01 user nova-compute[71229]:   </metadata>
Apr 11 16:14:01 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 16:14:01 user nova-compute[71229]:     <system>
Apr 11 16:14:01 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 16:14:01 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 16:14:01 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 16:14:01 user nova-compute[71229]:       <entry name="serial">cce5fba0-a0e4-46c1-8388-96a979360371</entry>
Apr 11 16:14:01 user nova-compute[71229]:       <entry name="uuid">cce5fba0-a0e4-46c1-8388-96a979360371</entry>
Apr 11 16:14:01 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 16:14:01 user nova-compute[71229]:     </system>
Apr 11 16:14:01 user nova-compute[71229]:   </sysinfo>
Apr 11 16:14:01 user nova-compute[71229]:   <os>
Apr 11 16:14:01 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 16:14:01 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 16:14:01 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 16:14:01 user nova-compute[71229]:   </os>
Apr 11 16:14:01 user nova-compute[71229]:   <features>
Apr 11 16:14:01 user nova-compute[71229]:     <acpi/>
Apr 11 16:14:01 user nova-compute[71229]:     <apic/>
Apr 11 16:14:01 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 16:14:01 user nova-compute[71229]:   </features>
Apr 11 16:14:01 user nova-compute[71229]:   <clock offset="utc">
Apr 11 16:14:01 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 16:14:01 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 16:14:01 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 16:14:01 user nova-compute[71229]:   </clock>
Apr 11 16:14:01 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 16:14:01 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 16:14:01 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 16:14:01 user nova-compute[71229]:   </cpu>
Apr 11 16:14:01 user nova-compute[71229]:   <devices>
Apr 11 16:14:01 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 16:14:01 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 16:14:01 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/cce5fba0-a0e4-46c1-8388-96a979360371/disk"/>
Apr 11 16:14:01 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 16:14:01 user nova-compute[71229]:     </disk>
Apr 11 16:14:01 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 16:14:01 user nova-compute[71229]:       <mac address="fa:16:3e:0f:7a:2d"/>
Apr 11 16:14:01 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 16:14:01 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 16:14:01 user nova-compute[71229]:       <target dev="tap928d0128-64"/>
Apr 11 16:14:01 user nova-compute[71229]:     </interface>
Apr 11 16:14:01 user nova-compute[71229]:     <serial type="pty">
Apr 11 16:14:01 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/cce5fba0-a0e4-46c1-8388-96a979360371/console.log" append="off"/>
Apr 11 16:14:01 user nova-compute[71229]:     </serial>
Apr 11 16:14:01 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 16:14:01 user nova-compute[71229]:     <video>
Apr 11 16:14:01 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 16:14:01 user nova-compute[71229]:     </video>
Apr 11 16:14:01 user nova-compute[71229]:     <rng model="virtio">
Apr 11 16:14:01 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 16:14:01 user nova-compute[71229]:     </rng>
Apr 11 16:14:01 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 16:14:01 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 16:14:01 user nova-compute[71229]:       <stats period="10"/>
Apr 11 16:14:01 user nova-compute[71229]:     </memballoon>
Apr 11 16:14:01 user nova-compute[71229]:   </devices>
Apr 11 16:14:01 user nova-compute[71229]: </domain>
Apr 11 16:14:01 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 16:14:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T16:13:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-504159588',display_name='tempest-AttachVolumeNegativeTest-server-504159588',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-504159588',id=44,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyO65adxfnVO95Gl79TghN3BBsPLDFp/eUd08QommzWWwIKtuKJGjj42drTustAaitCK+3fvkqSKUysqopyv7x6I5217CTf1uAlkBGpbqxX4XQl8IocH35tVRtEYrg6Fg==',key_name='tempest-keypair-1806827597',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6241b8bab90c4f1991413b84c5241baf',ramdisk_id='',reservation_id='r-ikj3yzsd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-537147684',owner_user_name='tempest-AttachVolumeNegativeTest-537147684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T16:13:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1332668b568e41a98bb68f6c28c92db9',uuid=cce5fba0-a0e4-46c1-8388-96a979360371,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "928d0128-648f-46b1-85df-d743f3b9b642", "address": "fa:16:3e:0f:7a:2d", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap928d0128-64", "ovs_interfaceid": "928d0128-648f-46b1-85df-d743f3b9b642", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 16:14:01 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Converting VIF {"id": "928d0128-648f-46b1-85df-d743f3b9b642", "address": "fa:16:3e:0f:7a:2d", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap928d0128-64", "ovs_interfaceid": "928d0128-648f-46b1-85df-d743f3b9b642", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 16:14:01 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:7a:2d,bridge_name='br-int',has_traffic_filtering=True,id=928d0128-648f-46b1-85df-d743f3b9b642,network=Network(c3def4c9-33a3-48eb-ad5c-45bb499758ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap928d0128-64') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 16:14:01 user nova-compute[71229]: DEBUG os_vif [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:7a:2d,bridge_name='br-int',has_traffic_filtering=True,id=928d0128-648f-46b1-85df-d743f3b9b642,network=Network(c3def4c9-33a3-48eb-ad5c-45bb499758ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap928d0128-64') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 16:14:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:14:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 16:14:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 16:14:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:14:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap928d0128-64, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 16:14:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap928d0128-64, col_values=(('external_ids', {'iface-id': '928d0128-648f-46b1-85df-d743f3b9b642', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:7a:2d', 'vm-uuid': 'cce5fba0-a0e4-46c1-8388-96a979360371'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 16:14:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:14:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:14:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:14:01 user nova-compute[71229]: INFO os_vif [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:7a:2d,bridge_name='br-int',has_traffic_filtering=True,id=928d0128-648f-46b1-85df-d743f3b9b642,network=Network(c3def4c9-33a3-48eb-ad5c-45bb499758ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap928d0128-64')
Apr 11 16:14:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 16:14:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] No VIF found with MAC fa:16:3e:0f:7a:2d, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 16:14:01 user nova-compute[71229]: DEBUG nova.network.neutron [req-ec2a0e2e-5f2c-4337-b71b-a5d266848326 req-e5add60f-e6d3-482f-b092-de065b8c3eaf service nova] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Updated VIF entry in instance network info cache for port 928d0128-648f-46b1-85df-d743f3b9b642. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 16:14:01 user nova-compute[71229]: DEBUG nova.network.neutron [req-ec2a0e2e-5f2c-4337-b71b-a5d266848326 req-e5add60f-e6d3-482f-b092-de065b8c3eaf service nova] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Updating instance_info_cache with network_info: [{"id": "928d0128-648f-46b1-85df-d743f3b9b642", "address": "fa:16:3e:0f:7a:2d", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap928d0128-64", "ovs_interfaceid": "928d0128-648f-46b1-85df-d743f3b9b642", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 16:14:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-ec2a0e2e-5f2c-4337-b71b-a5d266848326 req-e5add60f-e6d3-482f-b092-de065b8c3eaf service nova] Releasing lock "refresh_cache-cce5fba0-a0e4-46c1-8388-96a979360371" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 16:14:02 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:14:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:14:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:14:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:14:02 user nova-compute[71229]: DEBUG nova.compute.manager [req-faf3a67c-558a-4db3-ab93-2af76fff5aff req-3126e0cc-43a0-4615-922e-95522f51f55a service nova] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Received event network-vif-plugged-928d0128-648f-46b1-85df-d743f3b9b642 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:14:02 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-faf3a67c-558a-4db3-ab93-2af76fff5aff req-3126e0cc-43a0-4615-922e-95522f51f55a service nova] Acquiring lock "cce5fba0-a0e4-46c1-8388-96a979360371-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:14:02 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-faf3a67c-558a-4db3-ab93-2af76fff5aff req-3126e0cc-43a0-4615-922e-95522f51f55a service nova] Lock "cce5fba0-a0e4-46c1-8388-96a979360371-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:14:02 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-faf3a67c-558a-4db3-ab93-2af76fff5aff req-3126e0cc-43a0-4615-922e-95522f51f55a service nova] Lock "cce5fba0-a0e4-46c1-8388-96a979360371-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:14:02 user nova-compute[71229]: DEBUG nova.compute.manager [req-faf3a67c-558a-4db3-ab93-2af76fff5aff req-3126e0cc-43a0-4615-922e-95522f51f55a service nova] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] No waiting events found dispatching network-vif-plugged-928d0128-648f-46b1-85df-d743f3b9b642 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 16:14:02 user nova-compute[71229]: WARNING nova.compute.manager [req-faf3a67c-558a-4db3-ab93-2af76fff5aff req-3126e0cc-43a0-4615-922e-95522f51f55a service nova] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Received unexpected event network-vif-plugged-928d0128-648f-46b1-85df-d743f3b9b642 for instance with vm_state building and task_state spawning.
Apr 11 16:14:03 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:14:03 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:14:03 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:14:04 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681229644.7871177, cce5fba0-a0e4-46c1-8388-96a979360371 => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 16:14:04 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] VM Resumed (Lifecycle Event)
Apr 11 16:14:04 user nova-compute[71229]: DEBUG nova.compute.manager [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 16:14:04 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Guest created on hypervisor {{(pid=71229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 16:14:04 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Instance spawned successfully.
Apr 11 16:14:04 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 16:14:04 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 16:14:04 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 16:14:04 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Found default for hw_cdrom_bus of ide {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 16:14:04 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Found default for hw_disk_bus of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 16:14:04 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Found default for hw_input_bus of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 16:14:04 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Found default for hw_pointer_model of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 16:14:04 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Found default for hw_video_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 16:14:04 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Found default for hw_vif_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 16:14:04 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 16:14:04 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681229644.7911942, cce5fba0-a0e4-46c1-8388-96a979360371 => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 16:14:04 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] VM Started (Lifecycle Event)
Apr 11 16:14:04 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 16:14:04 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 16:14:04 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 16:14:04 user nova-compute[71229]: DEBUG nova.compute.manager [req-22d9ea5e-729d-4708-ae53-06dc4ff84089 req-7dbeb4b0-f5d9-4eaf-bc06-e447915612c5 service nova] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Received event network-vif-plugged-928d0128-648f-46b1-85df-d743f3b9b642 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:14:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-22d9ea5e-729d-4708-ae53-06dc4ff84089 req-7dbeb4b0-f5d9-4eaf-bc06-e447915612c5 service nova] Acquiring lock "cce5fba0-a0e4-46c1-8388-96a979360371-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:14:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-22d9ea5e-729d-4708-ae53-06dc4ff84089 req-7dbeb4b0-f5d9-4eaf-bc06-e447915612c5 service nova] Lock "cce5fba0-a0e4-46c1-8388-96a979360371-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:14:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-22d9ea5e-729d-4708-ae53-06dc4ff84089 req-7dbeb4b0-f5d9-4eaf-bc06-e447915612c5 service nova] Lock "cce5fba0-a0e4-46c1-8388-96a979360371-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:14:04 user nova-compute[71229]: DEBUG nova.compute.manager [req-22d9ea5e-729d-4708-ae53-06dc4ff84089 req-7dbeb4b0-f5d9-4eaf-bc06-e447915612c5 service nova] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] No waiting events found dispatching network-vif-plugged-928d0128-648f-46b1-85df-d743f3b9b642 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 16:14:04 user nova-compute[71229]: WARNING nova.compute.manager [req-22d9ea5e-729d-4708-ae53-06dc4ff84089 req-7dbeb4b0-f5d9-4eaf-bc06-e447915612c5 service nova] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Received unexpected event network-vif-plugged-928d0128-648f-46b1-85df-d743f3b9b642 for instance with vm_state building and task_state spawning.
Apr 11 16:14:04 user nova-compute[71229]: INFO nova.compute.manager [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Took 5.70 seconds to spawn the instance on the hypervisor.
Apr 11 16:14:04 user nova-compute[71229]: DEBUG nova.compute.manager [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 16:14:05 user nova-compute[71229]: INFO nova.compute.manager [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Took 6.23 seconds to build instance.
Apr 11 16:14:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-e6f936a9-bb6b-47e6-8acd-666ef39dedb5 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "cce5fba0-a0e4-46c1-8388-96a979360371" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.329s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:14:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:14:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:14:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:14:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:14:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:14:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:14:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:14:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:14:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:14:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:14:21 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:14:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:14:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:14:30 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:14:30 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 16:14:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:14:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:14:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:14:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:14:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:14:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:14:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:14:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:14:38 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:14:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:14:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:14:38 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:14:38 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 16:14:38 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce5fba0-a0e4-46c1-8388-96a979360371/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:14:38 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce5fba0-a0e4-46c1-8388-96a979360371/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:14:38 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce5fba0-a0e4-46c1-8388-96a979360371/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:14:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce5fba0-a0e4-46c1-8388-96a979360371/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:14:39 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:14:39 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:14:39 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8825MB free_disk=25.957054138183594GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 16:14:39 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:14:39 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:14:39 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance cce5fba0-a0e4-46c1-8388-96a979360371 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 16:14:39 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 16:14:39 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 16:14:39 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 16:14:39 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 16:14:39 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 16:14:39 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.203s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:14:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:14:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:14:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:14:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:14:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:14:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:14:41 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:14:41 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 16:14:41 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Rebuilding the list of instances to heal {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 16:14:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "refresh_cache-cce5fba0-a0e4-46c1-8388-96a979360371" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 16:14:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquired lock "refresh_cache-cce5fba0-a0e4-46c1-8388-96a979360371" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 16:14:41 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Forcefully refreshing network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 16:14:41 user nova-compute[71229]: DEBUG nova.objects.instance [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lazy-loading 'info_cache' on Instance uuid cce5fba0-a0e4-46c1-8388-96a979360371 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:14:42 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Updating instance_info_cache with network_info: [{"id": "928d0128-648f-46b1-85df-d743f3b9b642", "address": "fa:16:3e:0f:7a:2d", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap928d0128-64", "ovs_interfaceid": "928d0128-648f-46b1-85df-d743f3b9b642", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 16:14:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Releasing lock "refresh_cache-cce5fba0-a0e4-46c1-8388-96a979360371" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 16:14:42 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Updated the network info_cache for instance {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 16:14:42 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:14:42 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:14:43 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:14:45 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:14:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:14:47 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:14:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:14:48 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:14:51 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:14:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:15:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:15:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:15:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:15:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:15:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:15:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:15:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:15:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:15:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:15:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:15:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:15:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:15:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:15:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:15:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:15:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:15:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:15:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:15:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:15:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:15:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:15:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:15:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:15:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:15:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:15:21 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:15:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:15:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:15:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:15:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:15:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:15:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:15:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:15:32 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:15:32 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 16:15:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:15:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:15:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:15:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:15:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:15:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:15:39 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:15:39 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:15:39 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:15:39 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:15:39 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 16:15:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce5fba0-a0e4-46c1-8388-96a979360371/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:15:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce5fba0-a0e4-46c1-8388-96a979360371/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:15:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce5fba0-a0e4-46c1-8388-96a979360371/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:15:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce5fba0-a0e4-46c1-8388-96a979360371/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:15:40 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:15:40 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:15:40 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8832MB free_disk=25.95645523071289GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 16:15:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:15:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:15:40 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance cce5fba0-a0e4-46c1-8388-96a979360371 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 16:15:40 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 16:15:40 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 16:15:40 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 16:15:40 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 16:15:40 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 16:15:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.334s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:15:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:15:42 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:15:42 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 16:15:42 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Rebuilding the list of instances to heal {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 16:15:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "refresh_cache-cce5fba0-a0e4-46c1-8388-96a979360371" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 16:15:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquired lock "refresh_cache-cce5fba0-a0e4-46c1-8388-96a979360371" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 16:15:42 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Forcefully refreshing network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 16:15:42 user nova-compute[71229]: DEBUG nova.objects.instance [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lazy-loading 'info_cache' on Instance uuid cce5fba0-a0e4-46c1-8388-96a979360371 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:15:43 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Updating instance_info_cache with network_info: [{"id": "928d0128-648f-46b1-85df-d743f3b9b642", "address": "fa:16:3e:0f:7a:2d", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap928d0128-64", "ovs_interfaceid": "928d0128-648f-46b1-85df-d743f3b9b642", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 16:15:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Releasing lock "refresh_cache-cce5fba0-a0e4-46c1-8388-96a979360371" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 16:15:43 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Updated the network info_cache for instance {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 16:15:43 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:15:43 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:15:44 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:15:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:15:46 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:15:49 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:15:49 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:15:49 user nova-compute[71229]: DEBUG nova.compute.manager [req-3ab531e5-d57f-4954-8851-dbaa789f3fd3 req-7b4db91a-5b8e-4045-9900-91fa191d045d service nova] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Received event network-changed-928d0128-648f-46b1-85df-d743f3b9b642 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:15:49 user nova-compute[71229]: DEBUG nova.compute.manager [req-3ab531e5-d57f-4954-8851-dbaa789f3fd3 req-7b4db91a-5b8e-4045-9900-91fa191d045d service nova] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Refreshing instance network info cache due to event network-changed-928d0128-648f-46b1-85df-d743f3b9b642. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 16:15:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3ab531e5-d57f-4954-8851-dbaa789f3fd3 req-7b4db91a-5b8e-4045-9900-91fa191d045d service nova] Acquiring lock "refresh_cache-cce5fba0-a0e4-46c1-8388-96a979360371" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 16:15:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3ab531e5-d57f-4954-8851-dbaa789f3fd3 req-7b4db91a-5b8e-4045-9900-91fa191d045d service nova] Acquired lock "refresh_cache-cce5fba0-a0e4-46c1-8388-96a979360371" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 16:15:49 user nova-compute[71229]: DEBUG nova.network.neutron [req-3ab531e5-d57f-4954-8851-dbaa789f3fd3 req-7b4db91a-5b8e-4045-9900-91fa191d045d service nova] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Refreshing network info cache for port 928d0128-648f-46b1-85df-d743f3b9b642 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 16:15:50 user nova-compute[71229]: DEBUG nova.network.neutron [req-3ab531e5-d57f-4954-8851-dbaa789f3fd3 req-7b4db91a-5b8e-4045-9900-91fa191d045d service nova] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Updated VIF entry in instance network info cache for port 928d0128-648f-46b1-85df-d743f3b9b642. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 16:15:50 user nova-compute[71229]: DEBUG nova.network.neutron [req-3ab531e5-d57f-4954-8851-dbaa789f3fd3 req-7b4db91a-5b8e-4045-9900-91fa191d045d service nova] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Updating instance_info_cache with network_info: [{"id": "928d0128-648f-46b1-85df-d743f3b9b642", "address": "fa:16:3e:0f:7a:2d", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap928d0128-64", "ovs_interfaceid": "928d0128-648f-46b1-85df-d743f3b9b642", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 16:15:50 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3ab531e5-d57f-4954-8851-dbaa789f3fd3 req-7b4db91a-5b8e-4045-9900-91fa191d045d service nova] Releasing lock "refresh_cache-cce5fba0-a0e4-46c1-8388-96a979360371" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 16:15:51 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:15:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "cce5fba0-a0e4-46c1-8388-96a979360371" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:15:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "cce5fba0-a0e4-46c1-8388-96a979360371" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:15:51 user nova-compute[71229]: DEBUG nova.objects.instance [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lazy-loading 'flavor' on Instance uuid cce5fba0-a0e4-46c1-8388-96a979360371 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:15:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "cce5fba0-a0e4-46c1-8388-96a979360371" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:15:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "cce5fba0-a0e4-46c1-8388-96a979360371" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:15:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "cce5fba0-a0e4-46c1-8388-96a979360371" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:15:51 user nova-compute[71229]: INFO nova.compute.manager [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Attaching volume 789af7ed-0979-44c1-a717-fed1749c1b0a to /dev/vdb
Apr 11 16:15:51 user nova-compute[71229]: DEBUG os_brick.utils [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 16:15:51 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:15:51 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:15:51 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7ddffa-9a21-4286-93f6-220e71587e01]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d55e24a97c90\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:15:51 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:15:51 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:15:51 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3d8634-e8ea-42ce-8463-4979b4a24489]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:15:51 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:15:51 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:15:51 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b879bc69-7a48-4f63-84db-a52b0b402acc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:15:51 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c086c4-3e74-4a87-9eff-0d8ae13bb18c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:15:51 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Running cmd (subprocess): nvme version {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:15:51 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 'nvme version' failed. Not Retrying. {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 16:15:51 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] nvme not present on system {{(pid=71229) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 16:15:51 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:15:51 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 16:15:51 user nova-compute[71229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 16:15:51 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bae022f-38cf-4ba1-9a06-c739ec42d381]: (4, '') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:15:51 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71229) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 16:15:51 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 16:15:51 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] LIGHTOS: no hostnqn found. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 16:15:51 user nova-compute[71229]: DEBUG os_brick.utils [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d55e24a97c90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 16:15:51 user nova-compute[71229]: DEBUG nova.virt.block_device [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Updating existing volume attachment record: 00c7a0fd-e122-4107-8672-57571373faad {{(pid=71229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 16:15:52 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:15:55 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 16:15:55 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:789af7ed-0979-44c1-a717-fed1749c1b0a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KwAWdQGf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 16:15:55 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 16:15:55 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 16:15:55 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 16:15:55 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 16:15:55 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:789af7ed-0979-44c1-a717-fed1749c1b0a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 16:15:55 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:789af7ed-0979-44c1-a717-fed1749c1b0a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 16:15:55 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 16:15:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:789af7ed-0979-44c1-a717-fed1749c1b0a -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:15:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:789af7ed-0979-44c1-a717-fed1749c1b0a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:15:55 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d49f636-b704-40d1-bf41-74f5ca630572]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:15:55 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 16:15:55 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:15:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:789af7ed-0979-44c1-a717-fed1749c1b0a -p 172.16.0.220:3260 --interface default --op new {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:15:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:789af7ed-0979-44c1-a717-fed1749c1b0a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:15:55 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[920ffe9c-03c3-4eda-acae-63ccfa300527]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:789af7ed-0979-44c1-a717-fed1749c1b0a] added\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:15:55 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:789af7ed-0979-44c1-a717-fed1749c1b0a] added
Apr 11 16:15:55 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:15:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:789af7ed-0979-44c1-a717-fed1749c1b0a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:15:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:789af7ed-0979-44c1-a717-fed1749c1b0a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:15:55 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0c3883-14a5-4567-96b5-5af155133fe0]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:15:55 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:15:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:789af7ed-0979-44c1-a717-fed1749c1b0a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:15:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:789af7ed-0979-44c1-a717-fed1749c1b0a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:15:55 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[515f99c1-d846-44a8-9b05-9ede1f30c031]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:15:55 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:15:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:789af7ed-0979-44c1-a717-fed1749c1b0a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KwAWdQGf {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:15:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:789af7ed-0979-44c1-a717-fed1749c1b0a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KwAWdQGf" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:15:55 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8748fa0e-1b26-490a-8656-4686b1e2861c]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:15:55 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KwAWdQGf'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:15:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:789af7ed-0979-44c1-a717-fed1749c1b0a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:15:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:789af7ed-0979-44c1-a717-fed1749c1b0a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:15:55 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ca858d-1731-4840-aff7-5be7624cd404]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:15:55 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:15:55 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:15:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:15:56 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e43d42b-eeb4-40b7-845f-5b711d181013]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:15:56 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 11 16:15:56 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 16:15:56 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 11 16:15:56 user nova-compute[71229]:  {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 16:15:56 user nova-compute[71229]: WARNING os_brick.initiator.connectors.iscsi [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 11 16:15:56 user nova-compute[71229]: 
Apr 11 16:15:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:789af7ed-0979-44c1-a717-fed1749c1b0a -p 172.16.0.220:3260 --login {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:15:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:789af7ed-0979-44c1-a717-fed1749c1b0a -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:15:56 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8dbc8e8-acb2-4bbb-91b4-c722e5e16353]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:789af7ed-0979-44c1-a717-fed1749c1b0a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:789af7ed-0979-44c1-a717-fed1749c1b0a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:15:56 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:789af7ed-0979-44c1-a717-fed1749c1b0a, portal: 172.16.0.220,3260]
Apr 11 16:15:56 user nova-compute[71229]: Login to [iface: default, target: iqn.2010-10.org.openstack:789af7ed-0979-44c1-a717-fed1749c1b0a, portal: 172.16.0.220,3260] successful.
Apr 11 16:15:56 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:15:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:789af7ed-0979-44c1-a717-fed1749c1b0a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:15:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:789af7ed-0979-44c1-a717-fed1749c1b0a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:15:56 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[93331579-c199-42d2-a2dd-4dd7ac08de89]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:15:56 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:15:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:15:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:15:56 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bc87b8-a16f-4b31-8832-3e3dc7e02e3a]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789af7ed-0979-44c1-a717-fed1749c1b0a (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:15:56 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789af7ed-0979-44c1-a717-fed1749c1b0a (non-flash)
Apr 11 16:15:56 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 16:15:56 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789af7ed-0979-44c1-a717-fed1749c1b0a (non-flash)
Apr 11 16:15:56 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 16:15:56 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:789af7ed-0979-44c1-a717-fed1749c1b0a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 16:15:56 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 16:15:56 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 16:15:56 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 16:15:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:15:56 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:15:56 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab93f93-d2e1-42af-886d-4058501c2dec]: (4, ('- - 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:15:56 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: None {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 16:15:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:15:57 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 16:15:57 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:789af7ed-0979-44c1-a717-fed1749c1b0a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KwAWdQGf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 16:15:57 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 16:15:57 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '26635373333613136', 'path': '/dev/sdb'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 16:15:57 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635373333613136', 'path': '/dev/sdb'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 16:15:57 user nova-compute[71229]: DEBUG nova.objects.instance [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lazy-loading 'flavor' on Instance uuid cce5fba0-a0e4-46c1-8388-96a979360371 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:15:57 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 16:15:57 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 16:15:57 user nova-compute[71229]:   <source dev="/dev/sdb"/>
Apr 11 16:15:57 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 16:15:57 user nova-compute[71229]:   <serial>789af7ed-0979-44c1-a717-fed1749c1b0a</serial>
Apr 11 16:15:57 user nova-compute[71229]: </disk>
Apr 11 16:15:57 user nova-compute[71229]:  {{(pid=71229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 16:15:57 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 16:15:57 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 16:15:57 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] No VIF found with MAC fa:16:3e:0f:7a:2d, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 16:15:57 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f4020c57-e78c-400d-8c21-c5e21a66f1f9 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "cce5fba0-a0e4-46c1-8388-96a979360371" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.012s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:15:57 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:15:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-acc436fa-5ee9-4a7f-bd20-6354b43cef1b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "cce5fba0-a0e4-46c1-8388-96a979360371" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:15:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-acc436fa-5ee9-4a7f-bd20-6354b43cef1b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "cce5fba0-a0e4-46c1-8388-96a979360371" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:15:58 user nova-compute[71229]: INFO nova.compute.manager [None req-acc436fa-5ee9-4a7f-bd20-6354b43cef1b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Detaching volume 789af7ed-0979-44c1-a717-fed1749c1b0a
Apr 11 16:15:58 user nova-compute[71229]: INFO nova.virt.block_device [None req-acc436fa-5ee9-4a7f-bd20-6354b43cef1b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Attempting to driver detach volume 789af7ed-0979-44c1-a717-fed1749c1b0a from mountpoint /dev/vdb
Apr 11 16:15:58 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-acc436fa-5ee9-4a7f-bd20-6354b43cef1b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Attempting to detach device vdb from instance cce5fba0-a0e4-46c1-8388-96a979360371 from the persistent domain config. {{(pid=71229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 16:15:58 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-acc436fa-5ee9-4a7f-bd20-6354b43cef1b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 16:15:58 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 16:15:58 user nova-compute[71229]:   <source dev="/dev/sdb"/>
Apr 11 16:15:58 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 16:15:58 user nova-compute[71229]:   <serial>789af7ed-0979-44c1-a717-fed1749c1b0a</serial>
Apr 11 16:15:58 user nova-compute[71229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 16:15:58 user nova-compute[71229]: </disk>
Apr 11 16:15:58 user nova-compute[71229]:  {{(pid=71229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 16:15:58 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-acc436fa-5ee9-4a7f-bd20-6354b43cef1b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Successfully detached device vdb from instance cce5fba0-a0e4-46c1-8388-96a979360371 from the persistent domain config.
Apr 11 16:15:58 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-acc436fa-5ee9-4a7f-bd20-6354b43cef1b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cce5fba0-a0e4-46c1-8388-96a979360371 from the live domain config. {{(pid=71229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 16:15:58 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-acc436fa-5ee9-4a7f-bd20-6354b43cef1b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 16:15:58 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 16:15:58 user nova-compute[71229]:   <source dev="/dev/sdb"/>
Apr 11 16:15:58 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 16:15:58 user nova-compute[71229]:   <serial>789af7ed-0979-44c1-a717-fed1749c1b0a</serial>
Apr 11 16:15:58 user nova-compute[71229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 16:15:58 user nova-compute[71229]: </disk>
Apr 11 16:15:58 user nova-compute[71229]:  {{(pid=71229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 16:15:59 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Received event <DeviceRemovedEvent: 1681229759.1323638, cce5fba0-a0e4-46c1-8388-96a979360371 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71229) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 16:15:59 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-acc436fa-5ee9-4a7f-bd20-6354b43cef1b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cce5fba0-a0e4-46c1-8388-96a979360371 {{(pid=71229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 16:15:59 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-acc436fa-5ee9-4a7f-bd20-6354b43cef1b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Successfully detached device vdb from instance cce5fba0-a0e4-46c1-8388-96a979360371 from the live domain config.
Apr 11 16:15:59 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acc436fa-5ee9-4a7f-bd20-6354b43cef1b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 16:15:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc436fa-5ee9-4a7f-bd20-6354b43cef1b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:789af7ed-0979-44c1-a717-fed1749c1b0a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KwAWdQGf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 16:15:59 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-acc436fa-5ee9-4a7f-bd20-6354b43cef1b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 16:15:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-acc436fa-5ee9-4a7f-bd20-6354b43cef1b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 16:15:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-acc436fa-5ee9-4a7f-bd20-6354b43cef1b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 16:15:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:15:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:15:59 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a8a8ee-dcfa-4d2c-ac4f-b3e950428ecc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:789af7ed-0979-44c1-a717-fed1749c1b0a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:15:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc436fa-5ee9-4a7f-bd20-6354b43cef1b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 16:15:59 user nova-compute[71229]: No targets found.
Apr 11 16:15:59 user nova-compute[71229]: iSNS:
Apr 11 16:15:59 user nova-compute[71229]: No targets found.
Apr 11 16:15:59 user nova-compute[71229]: STATIC:
Apr 11 16:15:59 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:789af7ed-0979-44c1-a717-fed1749c1b0a
Apr 11 16:15:59 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 16:15:59 user nova-compute[71229]:                 Iface Name: default
Apr 11 16:15:59 user nova-compute[71229]: FIRMWARE:
Apr 11 16:15:59 user nova-compute[71229]: No targets found.
Apr 11 16:15:59 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 16:15:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc436fa-5ee9-4a7f-bd20-6354b43cef1b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 16:15:59 user nova-compute[71229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 16:15:59 user nova-compute[71229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71229) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 16:15:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc436fa-5ee9-4a7f-bd20-6354b43cef1b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:789af7ed-0979-44c1-a717-fed1749c1b0a', 0)] {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 16:15:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:15:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:15:59 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[08250361-6120-471e-a9f6-44c43268ec38]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:789af7ed-0979-44c1-a717-fed1749c1b0a\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:15:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:15:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:15:59 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b773cbee-fbd3-415f-90f8-6cf52575c1a8]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789af7ed-0979-44c1-a717-fed1749c1b0a (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:15:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc436fa-5ee9-4a7f-bd20-6354b43cef1b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789af7ed-0979-44c1-a717-fed1749c1b0a (non-flash)
Apr 11 16:15:59 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 16:15:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc436fa-5ee9-4a7f-bd20-6354b43cef1b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789af7ed-0979-44c1-a717-fed1749c1b0a (non-flash)
Apr 11 16:15:59 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 16:15:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc436fa-5ee9-4a7f-bd20-6354b43cef1b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb286dff40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:789af7ed-0979-44c1-a717-fed1749c1b0a'): ({'sdb'}, set())}) {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 16:15:59 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-acc436fa-5ee9-4a7f-bd20-6354b43cef1b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Removing single pathed devices sdb {{(pid=71229) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 16:15:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:15:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:15:59 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c2ca8b-f121-4a22-aa6b-d82dc5ee71aa]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:15:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:15:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:15:59 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a075cada-5a6f-456f-8276-9db651f4166e]: (4, ('ok\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:15:59 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-acc436fa-5ee9-4a7f-bd20-6354b43cef1b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Flushing IO for device /dev/sdb {{(pid=71229) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 16:15:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:15:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:15:59 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9337540e-d06a-4d98-9ae7-e2348c057164]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:15:59 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-acc436fa-5ee9-4a7f-bd20-6354b43cef1b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71229) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 16:15:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:15:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:15:59 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3288b36-4368-4e82-b729-d0236001ed69]: (4, ('1', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:15:59 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-acc436fa-5ee9-4a7f-bd20-6354b43cef1b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 16:15:59 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-acc436fa-5ee9-4a7f-bd20-6354b43cef1b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] SCSI volumes sdb have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 16:15:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc436fa-5ee9-4a7f-bd20-6354b43cef1b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:789af7ed-0979-44c1-a717-fed1749c1b0a')] {{(pid=71229) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 16:15:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:789af7ed-0979-44c1-a717-fed1749c1b0a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:15:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:789af7ed-0979-44c1-a717-fed1749c1b0a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:15:59 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9937e09-6659-40e8-9d01-6d456b8aac7d]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:15:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc436fa-5ee9-4a7f-bd20-6354b43cef1b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:15:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:789af7ed-0979-44c1-a717-fed1749c1b0a -p 172.16.0.220:3260 --logout {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:15:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:789af7ed-0979-44c1-a717-fed1749c1b0a -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:15:59 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3aded6-5c1f-4124-8a5e-6c7810be5587]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:789af7ed-0979-44c1-a717-fed1749c1b0a, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:789af7ed-0979-44c1-a717-fed1749c1b0a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:15:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc436fa-5ee9-4a7f-bd20-6354b43cef1b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:789af7ed-0979-44c1-a717-fed1749c1b0a, portal: 172.16.0.220,3260]
Apr 11 16:15:59 user nova-compute[71229]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:789af7ed-0979-44c1-a717-fed1749c1b0a, portal: 172.16.0.220,3260] successful.
Apr 11 16:15:59 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:15:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:789af7ed-0979-44c1-a717-fed1749c1b0a -p 172.16.0.220:3260 --op delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:15:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:789af7ed-0979-44c1-a717-fed1749c1b0a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:15:59 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a39c6e-1553-4e95-958d-94e4273e06e3]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:15:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc436fa-5ee9-4a7f-bd20-6354b43cef1b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:15:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-acc436fa-5ee9-4a7f-bd20-6354b43cef1b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.267s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 16:15:59 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc436fa-5ee9-4a7f-bd20-6354b43cef1b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] <== disconnect_volume: return (268ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 16:15:59 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acc436fa-5ee9-4a7f-bd20-6354b43cef1b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 16:16:00 user nova-compute[71229]: DEBUG nova.objects.instance [None req-acc436fa-5ee9-4a7f-bd20-6354b43cef1b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lazy-loading 'flavor' on Instance uuid cce5fba0-a0e4-46c1-8388-96a979360371 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:16:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-acc436fa-5ee9-4a7f-bd20-6354b43cef1b tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "cce5fba0-a0e4-46c1-8388-96a979360371" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.562s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:16:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:16:02 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:16:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:16:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:16:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:16:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:16:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:16:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:16:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:16:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:16:12 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:16:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:16:21 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:16:21 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:16:21 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:16:21 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:16:21 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:16:21 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:16:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:16:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:16:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:16:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:16:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:16:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:16:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:16:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:16:33 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:16:33 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 16:16:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:16:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:16:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:16:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:16:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:16:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:16:40 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:16:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:16:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:16:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:16:40 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 16:16:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce5fba0-a0e4-46c1-8388-96a979360371/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:16:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce5fba0-a0e4-46c1-8388-96a979360371/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:16:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce5fba0-a0e4-46c1-8388-96a979360371/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:16:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cce5fba0-a0e4-46c1-8388-96a979360371/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:16:41 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:16:41 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:16:41 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8841MB free_disk=25.95538330078125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 16:16:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:16:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:16:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:16:41 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance cce5fba0-a0e4-46c1-8388-96a979360371 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 16:16:41 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 16:16:41 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 16:16:41 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 16:16:41 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 16:16:41 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 16:16:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.180s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:16:44 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:16:44 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 16:16:44 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Rebuilding the list of instances to heal {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 16:16:44 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "refresh_cache-cce5fba0-a0e4-46c1-8388-96a979360371" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 16:16:44 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquired lock "refresh_cache-cce5fba0-a0e4-46c1-8388-96a979360371" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 16:16:44 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Forcefully refreshing network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 16:16:44 user nova-compute[71229]: DEBUG nova.objects.instance [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lazy-loading 'info_cache' on Instance uuid cce5fba0-a0e4-46c1-8388-96a979360371 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:16:45 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Updating instance_info_cache with network_info: [{"id": "928d0128-648f-46b1-85df-d743f3b9b642", "address": "fa:16:3e:0f:7a:2d", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap928d0128-64", "ovs_interfaceid": "928d0128-648f-46b1-85df-d743f3b9b642", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 16:16:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Releasing lock "refresh_cache-cce5fba0-a0e4-46c1-8388-96a979360371" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 16:16:45 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Updated the network info_cache for instance {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 16:16:45 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:16:45 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:16:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:16:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:16:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:16:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:16:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:16:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:16:46 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:16:46 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:16:48 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:16:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-0e887cc8-2f07-4d02-96dd-3faa300c5516 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "cce5fba0-a0e4-46c1-8388-96a979360371" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:16:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-0e887cc8-2f07-4d02-96dd-3faa300c5516 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "cce5fba0-a0e4-46c1-8388-96a979360371" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:16:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-0e887cc8-2f07-4d02-96dd-3faa300c5516 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "cce5fba0-a0e4-46c1-8388-96a979360371-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:16:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-0e887cc8-2f07-4d02-96dd-3faa300c5516 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "cce5fba0-a0e4-46c1-8388-96a979360371-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:16:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-0e887cc8-2f07-4d02-96dd-3faa300c5516 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "cce5fba0-a0e4-46c1-8388-96a979360371-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:16:49 user nova-compute[71229]: INFO nova.compute.manager [None req-0e887cc8-2f07-4d02-96dd-3faa300c5516 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Terminating instance
Apr 11 16:16:49 user nova-compute[71229]: DEBUG nova.compute.manager [None req-0e887cc8-2f07-4d02-96dd-3faa300c5516 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Start destroying the instance on the hypervisor. {{(pid=71229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 16:16:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:16:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:16:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:16:49 user nova-compute[71229]: DEBUG nova.compute.manager [req-bd7207cc-4d2e-42be-b700-3f4db1240b98 req-e3cd723b-ae3a-450a-82c3-8648e04d9535 service nova] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Received event network-vif-unplugged-928d0128-648f-46b1-85df-d743f3b9b642 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:16:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-bd7207cc-4d2e-42be-b700-3f4db1240b98 req-e3cd723b-ae3a-450a-82c3-8648e04d9535 service nova] Acquiring lock "cce5fba0-a0e4-46c1-8388-96a979360371-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:16:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-bd7207cc-4d2e-42be-b700-3f4db1240b98 req-e3cd723b-ae3a-450a-82c3-8648e04d9535 service nova] Lock "cce5fba0-a0e4-46c1-8388-96a979360371-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:16:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-bd7207cc-4d2e-42be-b700-3f4db1240b98 req-e3cd723b-ae3a-450a-82c3-8648e04d9535 service nova] Lock "cce5fba0-a0e4-46c1-8388-96a979360371-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:16:49 user nova-compute[71229]: DEBUG nova.compute.manager [req-bd7207cc-4d2e-42be-b700-3f4db1240b98 req-e3cd723b-ae3a-450a-82c3-8648e04d9535 service nova] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] No waiting events found dispatching network-vif-unplugged-928d0128-648f-46b1-85df-d743f3b9b642 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 16:16:49 user nova-compute[71229]: DEBUG nova.compute.manager [req-bd7207cc-4d2e-42be-b700-3f4db1240b98 req-e3cd723b-ae3a-450a-82c3-8648e04d9535 service nova] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Received event network-vif-unplugged-928d0128-648f-46b1-85df-d743f3b9b642 for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 16:16:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:16:49 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:16:49 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Instance destroyed successfully.
Apr 11 16:16:49 user nova-compute[71229]: DEBUG nova.objects.instance [None req-0e887cc8-2f07-4d02-96dd-3faa300c5516 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lazy-loading 'resources' on Instance uuid cce5fba0-a0e4-46c1-8388-96a979360371 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:16:49 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-0e887cc8-2f07-4d02-96dd-3faa300c5516 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T16:13:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-504159588',display_name='tempest-AttachVolumeNegativeTest-server-504159588',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-504159588',id=44,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyO65adxfnVO95Gl79TghN3BBsPLDFp/eUd08QommzWWwIKtuKJGjj42drTustAaitCK+3fvkqSKUysqopyv7x6I5217CTf1uAlkBGpbqxX4XQl8IocH35tVRtEYrg6Fg==',key_name='tempest-keypair-1806827597',keypairs=<?>,launch_index=0,launched_at=2023-04-11T16:14:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6241b8bab90c4f1991413b84c5241baf',ramdisk_id='',reservation_id='r-ikj3yzsd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-537147684',owner_user_name='tempest-AttachVolumeNegativeTest-537147684-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T16:14:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1332668b568e41a98bb68f6c28c92db9',uuid=cce5fba0-a0e4-46c1-8388-96a979360371,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "928d0128-648f-46b1-85df-d743f3b9b642", "address": "fa:16:3e:0f:7a:2d", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap928d0128-64", "ovs_interfaceid": "928d0128-648f-46b1-85df-d743f3b9b642", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 16:16:49 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-0e887cc8-2f07-4d02-96dd-3faa300c5516 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Converting VIF {"id": "928d0128-648f-46b1-85df-d743f3b9b642", "address": "fa:16:3e:0f:7a:2d", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap928d0128-64", "ovs_interfaceid": "928d0128-648f-46b1-85df-d743f3b9b642", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 16:16:49 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-0e887cc8-2f07-4d02-96dd-3faa300c5516 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:7a:2d,bridge_name='br-int',has_traffic_filtering=True,id=928d0128-648f-46b1-85df-d743f3b9b642,network=Network(c3def4c9-33a3-48eb-ad5c-45bb499758ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap928d0128-64') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 16:16:49 user nova-compute[71229]: DEBUG os_vif [None req-0e887cc8-2f07-4d02-96dd-3faa300c5516 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:7a:2d,bridge_name='br-int',has_traffic_filtering=True,id=928d0128-648f-46b1-85df-d743f3b9b642,network=Network(c3def4c9-33a3-48eb-ad5c-45bb499758ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap928d0128-64') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 16:16:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:16:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap928d0128-64, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 16:16:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:16:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:16:49 user nova-compute[71229]: INFO os_vif [None req-0e887cc8-2f07-4d02-96dd-3faa300c5516 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:7a:2d,bridge_name='br-int',has_traffic_filtering=True,id=928d0128-648f-46b1-85df-d743f3b9b642,network=Network(c3def4c9-33a3-48eb-ad5c-45bb499758ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap928d0128-64')
Apr 11 16:16:49 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-0e887cc8-2f07-4d02-96dd-3faa300c5516 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Deleting instance files /opt/stack/data/nova/instances/cce5fba0-a0e4-46c1-8388-96a979360371_del
Apr 11 16:16:49 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-0e887cc8-2f07-4d02-96dd-3faa300c5516 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Deletion of /opt/stack/data/nova/instances/cce5fba0-a0e4-46c1-8388-96a979360371_del complete
Apr 11 16:16:49 user nova-compute[71229]: INFO nova.compute.manager [None req-0e887cc8-2f07-4d02-96dd-3faa300c5516 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 11 16:16:49 user nova-compute[71229]: DEBUG oslo.service.loopingcall [None req-0e887cc8-2f07-4d02-96dd-3faa300c5516 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71229) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 16:16:49 user nova-compute[71229]: DEBUG nova.compute.manager [-] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Deallocating network for instance {{(pid=71229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 16:16:49 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] deallocate_for_instance() {{(pid=71229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 16:16:50 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 16:16:50 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Took 0.68 seconds to deallocate network for instance.
Apr 11 16:16:50 user nova-compute[71229]: DEBUG nova.compute.manager [req-45009ea6-54bc-40b2-8f92-21d7b1f7669b req-1187a413-dd8f-4b1c-804e-3b621f0b8333 service nova] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Received event network-vif-deleted-928d0128-648f-46b1-85df-d743f3b9b642 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:16:50 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-0e887cc8-2f07-4d02-96dd-3faa300c5516 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:16:50 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-0e887cc8-2f07-4d02-96dd-3faa300c5516 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:16:50 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-0e887cc8-2f07-4d02-96dd-3faa300c5516 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 16:16:50 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-0e887cc8-2f07-4d02-96dd-3faa300c5516 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 16:16:50 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-0e887cc8-2f07-4d02-96dd-3faa300c5516 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.109s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:16:50 user nova-compute[71229]: INFO nova.scheduler.client.report [None req-0e887cc8-2f07-4d02-96dd-3faa300c5516 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Deleted allocations for instance cce5fba0-a0e4-46c1-8388-96a979360371
Apr 11 16:16:50 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-0e887cc8-2f07-4d02-96dd-3faa300c5516 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "cce5fba0-a0e4-46c1-8388-96a979360371" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.833s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:16:51 user nova-compute[71229]: DEBUG nova.compute.manager [req-6a9b9af1-f22d-4ba0-a25c-4e138f9bcc33 req-c8ab8a2f-beb7-49a2-b2fd-809c0255cdec service nova] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Received event network-vif-plugged-928d0128-648f-46b1-85df-d743f3b9b642 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:16:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-6a9b9af1-f22d-4ba0-a25c-4e138f9bcc33 req-c8ab8a2f-beb7-49a2-b2fd-809c0255cdec service nova] Acquiring lock "cce5fba0-a0e4-46c1-8388-96a979360371-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:16:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-6a9b9af1-f22d-4ba0-a25c-4e138f9bcc33 req-c8ab8a2f-beb7-49a2-b2fd-809c0255cdec service nova] Lock "cce5fba0-a0e4-46c1-8388-96a979360371-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:16:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-6a9b9af1-f22d-4ba0-a25c-4e138f9bcc33 req-c8ab8a2f-beb7-49a2-b2fd-809c0255cdec service nova] Lock "cce5fba0-a0e4-46c1-8388-96a979360371-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:16:51 user nova-compute[71229]: DEBUG nova.compute.manager [req-6a9b9af1-f22d-4ba0-a25c-4e138f9bcc33 req-c8ab8a2f-beb7-49a2-b2fd-809c0255cdec service nova] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] No waiting events found dispatching network-vif-plugged-928d0128-648f-46b1-85df-d743f3b9b642 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 16:16:51 user nova-compute[71229]: WARNING nova.compute.manager [req-6a9b9af1-f22d-4ba0-a25c-4e138f9bcc33 req-c8ab8a2f-beb7-49a2-b2fd-809c0255cdec service nova] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Received unexpected event network-vif-plugged-928d0128-648f-46b1-85df-d743f3b9b642 for instance with vm_state deleted and task_state None.
Apr 11 16:16:51 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:16:54 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:16:59 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:17:04 user nova-compute[71229]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681229809.790389, cce5fba0-a0e4-46c1-8388-96a979360371 => Stopped> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 16:17:04 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] VM Stopped (Lifecycle Event)
Apr 11 16:17:04 user nova-compute[71229]: DEBUG nova.compute.manager [None req-88c2bebc-f7de-47c7-b6db-b4cf803e47e2 None None] [instance: cce5fba0-a0e4-46c1-8388-96a979360371] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 16:17:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:17:09 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:17:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:17:19 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:17:24 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:17:29 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:17:34 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:17:34 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 16:17:34 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:17:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:17:40 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:17:40 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:17:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:17:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:17:40 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:17:40 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 16:17:41 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:17:41 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:17:41 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8943MB free_disk=25.96643829345703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 16:17:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:17:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:17:41 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 16:17:41 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 16:17:41 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 16:17:41 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 16:17:41 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 16:17:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.152s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:17:41 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:17:41 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Cleaning up deleted instances {{(pid=71229) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 16:17:41 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] There are 0 instances to clean {{(pid=71229) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 16:17:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "d0a9404e-69b2-4633-badb-520f3d92ded8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:17:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "d0a9404e-69b2-4633-badb-520f3d92ded8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:17:42 user nova-compute[71229]: DEBUG nova.compute.manager [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Starting instance... {{(pid=71229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 16:17:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:17:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:17:42 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 16:17:42 user nova-compute[71229]: INFO nova.compute.claims [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Claim successful on node user
Apr 11 16:17:42 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:17:43 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 16:17:43 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 16:17:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.182s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:17:43 user nova-compute[71229]: DEBUG nova.compute.manager [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Start building networks asynchronously for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 16:17:43 user nova-compute[71229]: DEBUG nova.compute.manager [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Allocating IP information in the background. {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 16:17:43 user nova-compute[71229]: DEBUG nova.network.neutron [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] allocate_for_instance() {{(pid=71229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 16:17:43 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 16:17:43 user nova-compute[71229]: DEBUG nova.compute.manager [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Start building block device mappings for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 16:17:43 user nova-compute[71229]: DEBUG nova.policy [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1332668b568e41a98bb68f6c28c92db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6241b8bab90c4f1991413b84c5241baf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71229) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 16:17:43 user nova-compute[71229]: DEBUG nova.compute.manager [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Start spawning the instance on the hypervisor. {{(pid=71229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 16:17:43 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Creating instance directory {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 16:17:43 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Creating image(s)
Apr 11 16:17:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "/opt/stack/data/nova/instances/d0a9404e-69b2-4633-badb-520f3d92ded8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:17:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "/opt/stack/data/nova/instances/d0a9404e-69b2-4633-badb-520f3d92ded8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:17:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "/opt/stack/data/nova/instances/d0a9404e-69b2-4633-badb-520f3d92ded8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:17:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:17:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.134s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:17:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:17:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:17:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:17:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.139s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:17:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/d0a9404e-69b2-4633-badb-520f3d92ded8/disk 1073741824 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:17:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/d0a9404e-69b2-4633-badb-520f3d92ded8/disk 1073741824" returned: 0 in 0.049s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:17:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:17:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:17:43 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:17:43 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 16:17:43 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Rebuilding the list of instances to heal {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 16:17:43 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Skipping network cache update for instance because it is Building. {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 11 16:17:43 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Didn't find any instances for network info cache update. {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 16:17:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.135s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:17:43 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d0a9404e-69b2-4633-badb-520f3d92ded8/disk. size=1073741824 {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 16:17:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a9404e-69b2-4633-badb-520f3d92ded8/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:17:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a9404e-69b2-4633-badb-520f3d92ded8/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:17:43 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Cannot resize image /opt/stack/data/nova/instances/d0a9404e-69b2-4633-badb-520f3d92ded8/disk to a smaller size. {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 16:17:43 user nova-compute[71229]: DEBUG nova.objects.instance [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lazy-loading 'migration_context' on Instance uuid d0a9404e-69b2-4633-badb-520f3d92ded8 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:17:43 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Created local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 16:17:43 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Ensure instance console log exists: /opt/stack/data/nova/instances/d0a9404e-69b2-4633-badb-520f3d92ded8/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 16:17:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:17:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:17:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:17:44 user nova-compute[71229]: DEBUG nova.network.neutron [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Successfully created port: fa104891-1010-43ae-96f4-d7daa88d142c {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 16:17:44 user nova-compute[71229]: DEBUG nova.network.neutron [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Successfully updated port: fa104891-1010-43ae-96f4-d7daa88d142c {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 16:17:44 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "refresh_cache-d0a9404e-69b2-4633-badb-520f3d92ded8" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 16:17:44 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquired lock "refresh_cache-d0a9404e-69b2-4633-badb-520f3d92ded8" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 16:17:44 user nova-compute[71229]: DEBUG nova.network.neutron [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 16:17:44 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:17:44 user nova-compute[71229]: DEBUG nova.compute.manager [req-25192cd9-0d4a-4150-be1e-1b086768e448 req-3ee3772e-0920-4604-a150-3e5473f8b088 service nova] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Received event network-changed-fa104891-1010-43ae-96f4-d7daa88d142c {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:17:44 user nova-compute[71229]: DEBUG nova.compute.manager [req-25192cd9-0d4a-4150-be1e-1b086768e448 req-3ee3772e-0920-4604-a150-3e5473f8b088 service nova] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Refreshing instance network info cache due to event network-changed-fa104891-1010-43ae-96f4-d7daa88d142c. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 16:17:44 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-25192cd9-0d4a-4150-be1e-1b086768e448 req-3ee3772e-0920-4604-a150-3e5473f8b088 service nova] Acquiring lock "refresh_cache-d0a9404e-69b2-4633-badb-520f3d92ded8" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 16:17:44 user nova-compute[71229]: DEBUG nova.network.neutron [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 16:17:45 user nova-compute[71229]: DEBUG nova.network.neutron [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Updating instance_info_cache with network_info: [{"id": "fa104891-1010-43ae-96f4-d7daa88d142c", "address": "fa:16:3e:b3:43:20", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa104891-10", "ovs_interfaceid": "fa104891-1010-43ae-96f4-d7daa88d142c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 16:17:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Releasing lock "refresh_cache-d0a9404e-69b2-4633-badb-520f3d92ded8" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 16:17:45 user nova-compute[71229]: DEBUG nova.compute.manager [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Instance network_info: |[{"id": "fa104891-1010-43ae-96f4-d7daa88d142c", "address": "fa:16:3e:b3:43:20", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa104891-10", "ovs_interfaceid": "fa104891-1010-43ae-96f4-d7daa88d142c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 16:17:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-25192cd9-0d4a-4150-be1e-1b086768e448 req-3ee3772e-0920-4604-a150-3e5473f8b088 service nova] Acquired lock "refresh_cache-d0a9404e-69b2-4633-badb-520f3d92ded8" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 16:17:45 user nova-compute[71229]: DEBUG nova.network.neutron [req-25192cd9-0d4a-4150-be1e-1b086768e448 req-3ee3772e-0920-4604-a150-3e5473f8b088 service nova] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Refreshing network info cache for port fa104891-1010-43ae-96f4-d7daa88d142c {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 16:17:45 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Start _get_guest_xml network_info=[{"id": "fa104891-1010-43ae-96f4-d7daa88d142c", "address": "fa:16:3e:b3:43:20", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa104891-10", "ovs_interfaceid": "fa104891-1010-43ae-96f4-d7daa88d142c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '52fe638c-5ada-47d5-b376-233bfa808a37'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 16:17:45 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:17:45 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:17:45 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 16:17:45 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 16:17:45 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 16:17:45 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 16:17:45 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 16:17:45 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 16:17:45 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 16:17:45 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 16:17:45 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 16:17:45 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 16:17:45 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 16:17:45 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 16:17:45 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T16:17:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2006453280',display_name='tempest-AttachVolumeNegativeTest-server-2006453280',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2006453280',id=45,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8dlbQFiB7ISPLitc6dlEUMareriBSlnSSkyjSbknoEp8Kff9mdhoyWRUd8YJ7RHBILd2bd9WuL5uTfC2Oa/ga9zutVFhTsrhuX4vX+7GQ3xSh2wsWvbCADZDal6vyiPQ==',key_name='tempest-keypair-987834870',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6241b8bab90c4f1991413b84c5241baf',ramdisk_id='',reservation_id='r-qe0hha41',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-537147684',owner_user_name='tempest-AttachVolumeNegativeTest-537147684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T16:17:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1332668b568e41a98bb68f6c28c92db9',uuid=d0a9404e-69b2-4633-badb-520f3d92ded8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa104891-1010-43ae-96f4-d7daa88d142c", "address": "fa:16:3e:b3:43:20", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa104891-10", "ovs_interfaceid": "fa104891-1010-43ae-96f4-d7daa88d142c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 16:17:45 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Converting VIF {"id": "fa104891-1010-43ae-96f4-d7daa88d142c", "address": "fa:16:3e:b3:43:20", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa104891-10", "ovs_interfaceid": "fa104891-1010-43ae-96f4-d7daa88d142c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 16:17:45 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:43:20,bridge_name='br-int',has_traffic_filtering=True,id=fa104891-1010-43ae-96f4-d7daa88d142c,network=Network(c3def4c9-33a3-48eb-ad5c-45bb499758ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa104891-10') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 16:17:45 user nova-compute[71229]: DEBUG nova.objects.instance [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lazy-loading 'pci_devices' on Instance uuid d0a9404e-69b2-4633-badb-520f3d92ded8 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:17:45 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] End _get_guest_xml xml=<domain type="kvm">
Apr 11 16:17:45 user nova-compute[71229]:   <uuid>d0a9404e-69b2-4633-badb-520f3d92ded8</uuid>
Apr 11 16:17:45 user nova-compute[71229]:   <name>instance-0000002d</name>
Apr 11 16:17:45 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 16:17:45 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 16:17:45 user nova-compute[71229]:   <metadata>
Apr 11 16:17:45 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 16:17:45 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 16:17:45 user nova-compute[71229]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2006453280</nova:name>
Apr 11 16:17:45 user nova-compute[71229]:       <nova:creationTime>2023-04-11 16:17:45</nova:creationTime>
Apr 11 16:17:45 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 16:17:45 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 16:17:45 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 16:17:45 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 16:17:45 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 16:17:45 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 16:17:45 user nova-compute[71229]:       </nova:flavor>
Apr 11 16:17:45 user nova-compute[71229]:       <nova:owner>
Apr 11 16:17:45 user nova-compute[71229]:         <nova:user uuid="1332668b568e41a98bb68f6c28c92db9">tempest-AttachVolumeNegativeTest-537147684-project-member</nova:user>
Apr 11 16:17:45 user nova-compute[71229]:         <nova:project uuid="6241b8bab90c4f1991413b84c5241baf">tempest-AttachVolumeNegativeTest-537147684</nova:project>
Apr 11 16:17:45 user nova-compute[71229]:       </nova:owner>
Apr 11 16:17:45 user nova-compute[71229]:       <nova:root type="image" uuid="52fe638c-5ada-47d5-b376-233bfa808a37"/>
Apr 11 16:17:45 user nova-compute[71229]:       <nova:ports>
Apr 11 16:17:45 user nova-compute[71229]:         <nova:port uuid="fa104891-1010-43ae-96f4-d7daa88d142c">
Apr 11 16:17:45 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 11 16:17:45 user nova-compute[71229]:         </nova:port>
Apr 11 16:17:45 user nova-compute[71229]:       </nova:ports>
Apr 11 16:17:45 user nova-compute[71229]:     </nova:instance>
Apr 11 16:17:45 user nova-compute[71229]:   </metadata>
Apr 11 16:17:45 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 16:17:45 user nova-compute[71229]:     <system>
Apr 11 16:17:45 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 16:17:45 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 16:17:45 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 16:17:45 user nova-compute[71229]:       <entry name="serial">d0a9404e-69b2-4633-badb-520f3d92ded8</entry>
Apr 11 16:17:45 user nova-compute[71229]:       <entry name="uuid">d0a9404e-69b2-4633-badb-520f3d92ded8</entry>
Apr 11 16:17:45 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 16:17:45 user nova-compute[71229]:     </system>
Apr 11 16:17:45 user nova-compute[71229]:   </sysinfo>
Apr 11 16:17:45 user nova-compute[71229]:   <os>
Apr 11 16:17:45 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 16:17:45 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 16:17:45 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 16:17:45 user nova-compute[71229]:   </os>
Apr 11 16:17:45 user nova-compute[71229]:   <features>
Apr 11 16:17:45 user nova-compute[71229]:     <acpi/>
Apr 11 16:17:45 user nova-compute[71229]:     <apic/>
Apr 11 16:17:45 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 16:17:45 user nova-compute[71229]:   </features>
Apr 11 16:17:45 user nova-compute[71229]:   <clock offset="utc">
Apr 11 16:17:45 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 16:17:45 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 16:17:45 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 16:17:45 user nova-compute[71229]:   </clock>
Apr 11 16:17:45 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 16:17:45 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 16:17:45 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 16:17:45 user nova-compute[71229]:   </cpu>
Apr 11 16:17:45 user nova-compute[71229]:   <devices>
Apr 11 16:17:45 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 16:17:45 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 16:17:45 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/d0a9404e-69b2-4633-badb-520f3d92ded8/disk"/>
Apr 11 16:17:45 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 16:17:45 user nova-compute[71229]:     </disk>
Apr 11 16:17:45 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 16:17:45 user nova-compute[71229]:       <mac address="fa:16:3e:b3:43:20"/>
Apr 11 16:17:45 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 16:17:45 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 16:17:45 user nova-compute[71229]:       <target dev="tapfa104891-10"/>
Apr 11 16:17:45 user nova-compute[71229]:     </interface>
Apr 11 16:17:45 user nova-compute[71229]:     <serial type="pty">
Apr 11 16:17:45 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/d0a9404e-69b2-4633-badb-520f3d92ded8/console.log" append="off"/>
Apr 11 16:17:45 user nova-compute[71229]:     </serial>
Apr 11 16:17:45 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 16:17:45 user nova-compute[71229]:     <video>
Apr 11 16:17:45 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 16:17:45 user nova-compute[71229]:     </video>
Apr 11 16:17:45 user nova-compute[71229]:     <rng model="virtio">
Apr 11 16:17:45 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 16:17:45 user nova-compute[71229]:     </rng>
Apr 11 16:17:45 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 16:17:45 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 16:17:45 user nova-compute[71229]:       <stats period="10"/>
Apr 11 16:17:45 user nova-compute[71229]:     </memballoon>
Apr 11 16:17:45 user nova-compute[71229]:   </devices>
Apr 11 16:17:45 user nova-compute[71229]: </domain>
Apr 11 16:17:45 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 16:17:45 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T16:17:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2006453280',display_name='tempest-AttachVolumeNegativeTest-server-2006453280',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2006453280',id=45,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8dlbQFiB7ISPLitc6dlEUMareriBSlnSSkyjSbknoEp8Kff9mdhoyWRUd8YJ7RHBILd2bd9WuL5uTfC2Oa/ga9zutVFhTsrhuX4vX+7GQ3xSh2wsWvbCADZDal6vyiPQ==',key_name='tempest-keypair-987834870',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6241b8bab90c4f1991413b84c5241baf',ramdisk_id='',reservation_id='r-qe0hha41',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-537147684',owner_user_name='tempest-AttachVolumeNegativeTest-537147684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T16:17:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1332668b568e41a98bb68f6c28c92db9',uuid=d0a9404e-69b2-4633-badb-520f3d92ded8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa104891-1010-43ae-96f4-d7daa88d142c", "address": "fa:16:3e:b3:43:20", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa104891-10", "ovs_interfaceid": "fa104891-1010-43ae-96f4-d7daa88d142c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 16:17:45 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Converting VIF {"id": "fa104891-1010-43ae-96f4-d7daa88d142c", "address": "fa:16:3e:b3:43:20", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa104891-10", "ovs_interfaceid": "fa104891-1010-43ae-96f4-d7daa88d142c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 16:17:45 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:43:20,bridge_name='br-int',has_traffic_filtering=True,id=fa104891-1010-43ae-96f4-d7daa88d142c,network=Network(c3def4c9-33a3-48eb-ad5c-45bb499758ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa104891-10') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 16:17:45 user nova-compute[71229]: DEBUG os_vif [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:43:20,bridge_name='br-int',has_traffic_filtering=True,id=fa104891-1010-43ae-96f4-d7daa88d142c,network=Network(c3def4c9-33a3-48eb-ad5c-45bb499758ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa104891-10') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 16:17:45 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:17:45 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 16:17:45 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 16:17:45 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:17:45 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa104891-10, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 16:17:45 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfa104891-10, col_values=(('external_ids', {'iface-id': 'fa104891-1010-43ae-96f4-d7daa88d142c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:43:20', 'vm-uuid': 'd0a9404e-69b2-4633-badb-520f3d92ded8'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 16:17:45 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:17:45 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:17:45 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:17:45 user nova-compute[71229]: INFO os_vif [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:43:20,bridge_name='br-int',has_traffic_filtering=True,id=fa104891-1010-43ae-96f4-d7daa88d142c,network=Network(c3def4c9-33a3-48eb-ad5c-45bb499758ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa104891-10')
Apr 11 16:17:45 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 16:17:45 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] No VIF found with MAC fa:16:3e:b3:43:20, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 16:17:45 user nova-compute[71229]: DEBUG nova.network.neutron [req-25192cd9-0d4a-4150-be1e-1b086768e448 req-3ee3772e-0920-4604-a150-3e5473f8b088 service nova] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Updated VIF entry in instance network info cache for port fa104891-1010-43ae-96f4-d7daa88d142c. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 16:17:45 user nova-compute[71229]: DEBUG nova.network.neutron [req-25192cd9-0d4a-4150-be1e-1b086768e448 req-3ee3772e-0920-4604-a150-3e5473f8b088 service nova] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Updating instance_info_cache with network_info: [{"id": "fa104891-1010-43ae-96f4-d7daa88d142c", "address": "fa:16:3e:b3:43:20", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa104891-10", "ovs_interfaceid": "fa104891-1010-43ae-96f4-d7daa88d142c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 16:17:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-25192cd9-0d4a-4150-be1e-1b086768e448 req-3ee3772e-0920-4604-a150-3e5473f8b088 service nova] Releasing lock "refresh_cache-d0a9404e-69b2-4633-badb-520f3d92ded8" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 16:17:45 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:17:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:17:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:17:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:17:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:17:46 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:17:46 user nova-compute[71229]: DEBUG nova.compute.manager [req-0aea3066-c719-46c2-bd90-8f3773152262 req-81dd8168-031a-4680-ae43-49b4d93e0dfd service nova] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Received event network-vif-plugged-fa104891-1010-43ae-96f4-d7daa88d142c {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:17:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-0aea3066-c719-46c2-bd90-8f3773152262 req-81dd8168-031a-4680-ae43-49b4d93e0dfd service nova] Acquiring lock "d0a9404e-69b2-4633-badb-520f3d92ded8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:17:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-0aea3066-c719-46c2-bd90-8f3773152262 req-81dd8168-031a-4680-ae43-49b4d93e0dfd service nova] Lock "d0a9404e-69b2-4633-badb-520f3d92ded8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:17:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-0aea3066-c719-46c2-bd90-8f3773152262 req-81dd8168-031a-4680-ae43-49b4d93e0dfd service nova] Lock "d0a9404e-69b2-4633-badb-520f3d92ded8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:17:46 user nova-compute[71229]: DEBUG nova.compute.manager [req-0aea3066-c719-46c2-bd90-8f3773152262 req-81dd8168-031a-4680-ae43-49b4d93e0dfd service nova] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] No waiting events found dispatching network-vif-plugged-fa104891-1010-43ae-96f4-d7daa88d142c {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 16:17:46 user nova-compute[71229]: WARNING nova.compute.manager [req-0aea3066-c719-46c2-bd90-8f3773152262 req-81dd8168-031a-4680-ae43-49b4d93e0dfd service nova] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Received unexpected event network-vif-plugged-fa104891-1010-43ae-96f4-d7daa88d142c for instance with vm_state building and task_state spawning.
Apr 11 16:17:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:17:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:17:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:17:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:17:48 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:17:48 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681229868.7291484, d0a9404e-69b2-4633-badb-520f3d92ded8 => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 16:17:48 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] VM Resumed (Lifecycle Event)
Apr 11 16:17:48 user nova-compute[71229]: DEBUG nova.compute.manager [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 16:17:48 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Guest created on hypervisor {{(pid=71229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 16:17:48 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Instance spawned successfully.
Apr 11 16:17:48 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 16:17:48 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 16:17:48 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 16:17:48 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Found default for hw_cdrom_bus of ide {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 16:17:48 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Found default for hw_disk_bus of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 16:17:48 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Found default for hw_input_bus of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 16:17:48 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Found default for hw_pointer_model of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 16:17:48 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Found default for hw_video_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 16:17:48 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Found default for hw_vif_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 16:17:48 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 16:17:48 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681229868.7327166, d0a9404e-69b2-4633-badb-520f3d92ded8 => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 16:17:48 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] VM Started (Lifecycle Event)
Apr 11 16:17:48 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 16:17:48 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 16:17:48 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 16:17:48 user nova-compute[71229]: INFO nova.compute.manager [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Took 5.59 seconds to spawn the instance on the hypervisor.
Apr 11 16:17:48 user nova-compute[71229]: DEBUG nova.compute.manager [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 16:17:48 user nova-compute[71229]: INFO nova.compute.manager [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Took 6.07 seconds to build instance.
Apr 11 16:17:48 user nova-compute[71229]: DEBUG nova.compute.manager [req-8a4d0825-75dd-4de7-8b13-3d3fd625ead3 req-4d831357-5792-4b62-86bc-8e4cdcb06e82 service nova] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Received event network-vif-plugged-fa104891-1010-43ae-96f4-d7daa88d142c {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:17:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-8a4d0825-75dd-4de7-8b13-3d3fd625ead3 req-4d831357-5792-4b62-86bc-8e4cdcb06e82 service nova] Acquiring lock "d0a9404e-69b2-4633-badb-520f3d92ded8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:17:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-8a4d0825-75dd-4de7-8b13-3d3fd625ead3 req-4d831357-5792-4b62-86bc-8e4cdcb06e82 service nova] Lock "d0a9404e-69b2-4633-badb-520f3d92ded8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:17:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-8a4d0825-75dd-4de7-8b13-3d3fd625ead3 req-4d831357-5792-4b62-86bc-8e4cdcb06e82 service nova] Lock "d0a9404e-69b2-4633-badb-520f3d92ded8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:17:48 user nova-compute[71229]: DEBUG nova.compute.manager [req-8a4d0825-75dd-4de7-8b13-3d3fd625ead3 req-4d831357-5792-4b62-86bc-8e4cdcb06e82 service nova] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] No waiting events found dispatching network-vif-plugged-fa104891-1010-43ae-96f4-d7daa88d142c {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 16:17:48 user nova-compute[71229]: WARNING nova.compute.manager [req-8a4d0825-75dd-4de7-8b13-3d3fd625ead3 req-4d831357-5792-4b62-86bc-8e4cdcb06e82 service nova] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Received unexpected event network-vif-plugged-fa104891-1010-43ae-96f4-d7daa88d142c for instance with vm_state active and task_state None.
Apr 11 16:17:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-dbb35837-0319-4657-a702-d83cd8131a8a tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "d0a9404e-69b2-4633-badb-520f3d92ded8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.165s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:17:49 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:17:50 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:17:50 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:17:52 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:17:52 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:17:55 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:18:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:18:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:18:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:18:06 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:18:06 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:18:06 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71229) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 16:18:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:18:10 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:18:15 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:18:15 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:18:15 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:18:15 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:18:15 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:18:15 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:18:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:18:18 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:18:20 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:18:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:18:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:18:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:18:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:18:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:18:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:18:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:18:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:18:35 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:18:35 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:18:35 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 16:18:40 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:18:40 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:18:40 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:18:40 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:18:40 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:18:40 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:18:41 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:18:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:18:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:18:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:18:41 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 16:18:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a9404e-69b2-4633-badb-520f3d92ded8/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:18:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a9404e-69b2-4633-badb-520f3d92ded8/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:18:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a9404e-69b2-4633-badb-520f3d92ded8/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:18:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a9404e-69b2-4633-badb-520f3d92ded8/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:18:42 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:18:42 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:18:42 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8828MB free_disk=25.945068359375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 16:18:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:18:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:18:42 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance d0a9404e-69b2-4633-badb-520f3d92ded8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 16:18:42 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 16:18:42 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 16:18:42 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Refreshing inventories for resource provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 16:18:42 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Updating ProviderTree inventory for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 16:18:42 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Updating inventory in ProviderTree for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 16:18:42 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Refreshing aggregate associations for resource provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de, aggregates: None {{(pid=71229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 16:18:42 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Refreshing trait associations for resource provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de, traits: COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=71229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 16:18:42 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 16:18:42 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 16:18:42 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 16:18:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.298s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:18:45 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:18:45 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:18:45 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 16:18:45 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Rebuilding the list of instances to heal {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 16:18:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "refresh_cache-d0a9404e-69b2-4633-badb-520f3d92ded8" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 16:18:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquired lock "refresh_cache-d0a9404e-69b2-4633-badb-520f3d92ded8" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 16:18:45 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Forcefully refreshing network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 16:18:45 user nova-compute[71229]: DEBUG nova.objects.instance [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lazy-loading 'info_cache' on Instance uuid d0a9404e-69b2-4633-badb-520f3d92ded8 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:18:46 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Updating instance_info_cache with network_info: [{"id": "fa104891-1010-43ae-96f4-d7daa88d142c", "address": "fa:16:3e:b3:43:20", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa104891-10", "ovs_interfaceid": "fa104891-1010-43ae-96f4-d7daa88d142c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 16:18:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Releasing lock "refresh_cache-d0a9404e-69b2-4633-badb-520f3d92ded8" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 16:18:46 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Updated the network info_cache for instance {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 16:18:47 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:18:47 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:18:48 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:18:50 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:18:50 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:18:50 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:18:50 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:18:50 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:18:50 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:18:50 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:18:50 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:18:53 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:18:55 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:18:57 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:18:57 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Triggering sync for uuid d0a9404e-69b2-4633-badb-520f3d92ded8 {{(pid=71229) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 16:18:57 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "d0a9404e-69b2-4633-badb-520f3d92ded8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:18:57 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "d0a9404e-69b2-4633-badb-520f3d92ded8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:18:57 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "d0a9404e-69b2-4633-badb-520f3d92ded8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:19:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:19:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:19:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:19:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:19:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:19:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:19:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:19:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:19:10 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:19:10 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:19:10 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:19:10 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:19:10 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:19:10 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:19:15 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:19:20 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:19:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:19:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:19:33 user nova-compute[71229]: DEBUG nova.compute.manager [req-e20d7a52-b5a7-4b5d-80a4-f63bf6c48806 req-8fee5e0a-6b34-4b59-98e0-f359d9673752 service nova] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Received event network-changed-fa104891-1010-43ae-96f4-d7daa88d142c {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:19:33 user nova-compute[71229]: DEBUG nova.compute.manager [req-e20d7a52-b5a7-4b5d-80a4-f63bf6c48806 req-8fee5e0a-6b34-4b59-98e0-f359d9673752 service nova] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Refreshing instance network info cache due to event network-changed-fa104891-1010-43ae-96f4-d7daa88d142c. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 16:19:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e20d7a52-b5a7-4b5d-80a4-f63bf6c48806 req-8fee5e0a-6b34-4b59-98e0-f359d9673752 service nova] Acquiring lock "refresh_cache-d0a9404e-69b2-4633-badb-520f3d92ded8" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 16:19:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e20d7a52-b5a7-4b5d-80a4-f63bf6c48806 req-8fee5e0a-6b34-4b59-98e0-f359d9673752 service nova] Acquired lock "refresh_cache-d0a9404e-69b2-4633-badb-520f3d92ded8" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 16:19:33 user nova-compute[71229]: DEBUG nova.network.neutron [req-e20d7a52-b5a7-4b5d-80a4-f63bf6c48806 req-8fee5e0a-6b34-4b59-98e0-f359d9673752 service nova] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Refreshing network info cache for port fa104891-1010-43ae-96f4-d7daa88d142c {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 16:19:34 user nova-compute[71229]: DEBUG nova.network.neutron [req-e20d7a52-b5a7-4b5d-80a4-f63bf6c48806 req-8fee5e0a-6b34-4b59-98e0-f359d9673752 service nova] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Updated VIF entry in instance network info cache for port fa104891-1010-43ae-96f4-d7daa88d142c. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 16:19:34 user nova-compute[71229]: DEBUG nova.network.neutron [req-e20d7a52-b5a7-4b5d-80a4-f63bf6c48806 req-8fee5e0a-6b34-4b59-98e0-f359d9673752 service nova] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Updating instance_info_cache with network_info: [{"id": "fa104891-1010-43ae-96f4-d7daa88d142c", "address": "fa:16:3e:b3:43:20", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa104891-10", "ovs_interfaceid": "fa104891-1010-43ae-96f4-d7daa88d142c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 16:19:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-e20d7a52-b5a7-4b5d-80a4-f63bf6c48806 req-8fee5e0a-6b34-4b59-98e0-f359d9673752 service nova] Releasing lock "refresh_cache-d0a9404e-69b2-4633-badb-520f3d92ded8" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 16:19:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "d0a9404e-69b2-4633-badb-520f3d92ded8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:19:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "d0a9404e-69b2-4633-badb-520f3d92ded8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:19:35 user nova-compute[71229]: DEBUG nova.objects.instance [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lazy-loading 'flavor' on Instance uuid d0a9404e-69b2-4633-badb-520f3d92ded8 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:19:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "d0a9404e-69b2-4633-badb-520f3d92ded8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:19:35 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:19:35 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:19:35 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:19:35 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:19:35 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:19:35 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:19:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "d0a9404e-69b2-4633-badb-520f3d92ded8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:19:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "d0a9404e-69b2-4633-badb-520f3d92ded8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:19:35 user nova-compute[71229]: INFO nova.compute.manager [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Attaching volume d74ea732-6d3c-4463-934c-6bf832a1bbd2 to /dev/vdb
Apr 11 16:19:35 user nova-compute[71229]: DEBUG os_brick.utils [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 16:19:35 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:19:35 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:19:35 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90ea25d-98a2-43d5-b91f-464ce49b0cb1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d55e24a97c90\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:19:35 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:19:35 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:19:35 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0359303-c19c-449e-a09e-9f61f9906844]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:19:35 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:19:35 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:19:35 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05362bd-dea3-4e83-a16d-cfb9b09133b0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:19:35 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a039fbe0-7dae-430c-9fb0-dce54fce230c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:19:35 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Running cmd (subprocess): nvme version {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:19:35 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] 'nvme version' failed. Not Retrying. {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 16:19:35 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] nvme not present on system {{(pid=71229) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 16:19:35 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:19:35 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 16:19:35 user nova-compute[71229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 16:19:35 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1759bd1d-9c2a-4cf6-b053-7f55d49d449f]: (4, '') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:19:35 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71229) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 16:19:35 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 16:19:35 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] LIGHTOS: no hostnqn found. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 16:19:35 user nova-compute[71229]: DEBUG os_brick.utils [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d55e24a97c90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 16:19:35 user nova-compute[71229]: DEBUG nova.virt.block_device [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Updating existing volume attachment record: 6a73c0f7-2acd-41e4-aed1-6a07275924e0 {{(pid=71229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 16:19:36 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:19:36 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 16:19:37 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:19:39 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 16:19:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d74ea732-6d3c-4463-934c-6bf832a1bbd2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MiOLuwnq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 16:19:39 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 16:19:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 16:19:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 16:19:39 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 16:19:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d74ea732-6d3c-4463-934c-6bf832a1bbd2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 16:19:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d74ea732-6d3c-4463-934c-6bf832a1bbd2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 16:19:39 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 16:19:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d74ea732-6d3c-4463-934c-6bf832a1bbd2 -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:19:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d74ea732-6d3c-4463-934c-6bf832a1bbd2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:19:39 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[20cd1cfc-bd80-431b-ab5b-dc9e1f929ca9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:19:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 16:19:39 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:19:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d74ea732-6d3c-4463-934c-6bf832a1bbd2 -p 172.16.0.220:3260 --interface default --op new {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:19:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d74ea732-6d3c-4463-934c-6bf832a1bbd2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:19:39 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[af237e25-cbc8-4dc6-990b-2cb270e0f4ad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d74ea732-6d3c-4463-934c-6bf832a1bbd2] added\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:19:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d74ea732-6d3c-4463-934c-6bf832a1bbd2] added
Apr 11 16:19:39 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:19:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d74ea732-6d3c-4463-934c-6bf832a1bbd2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:19:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d74ea732-6d3c-4463-934c-6bf832a1bbd2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:19:39 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ffc70d2-9650-46b1-8beb-d53e393c26b2]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:19:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:19:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d74ea732-6d3c-4463-934c-6bf832a1bbd2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:19:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d74ea732-6d3c-4463-934c-6bf832a1bbd2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:19:39 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd74f2cb-ff3c-4a94-a067-a9c7873b9eb5]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:19:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:19:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d74ea732-6d3c-4463-934c-6bf832a1bbd2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MiOLuwnq {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:19:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d74ea732-6d3c-4463-934c-6bf832a1bbd2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MiOLuwnq" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:19:39 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5640a4c2-5d2f-43d3-be69-f56d4261ae35]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:19:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MiOLuwnq'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:19:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d74ea732-6d3c-4463-934c-6bf832a1bbd2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:19:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d74ea732-6d3c-4463-934c-6bf832a1bbd2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:19:39 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0170bd35-f326-4809-b241-8065aa9f7591]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:19:39 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:19:39 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:19:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:19:40 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f468bb-507c-4502-b330-8fa866ba919b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:19:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 11 16:19:40 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 16:19:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 11 16:19:40 user nova-compute[71229]:  {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 16:19:40 user nova-compute[71229]: WARNING os_brick.initiator.connectors.iscsi [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 11 16:19:40 user nova-compute[71229]: 
Apr 11 16:19:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d74ea732-6d3c-4463-934c-6bf832a1bbd2 -p 172.16.0.220:3260 --login {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:19:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d74ea732-6d3c-4463-934c-6bf832a1bbd2 -p 172.16.0.220:3260 --login" returned: 0 in 0.223s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:19:40 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76b2f19-c4f0-4fb0-b125-907aadaae6d2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d74ea732-6d3c-4463-934c-6bf832a1bbd2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d74ea732-6d3c-4463-934c-6bf832a1bbd2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:19:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d74ea732-6d3c-4463-934c-6bf832a1bbd2, portal: 172.16.0.220,3260]
Apr 11 16:19:40 user nova-compute[71229]: Login to [iface: default, target: iqn.2010-10.org.openstack:d74ea732-6d3c-4463-934c-6bf832a1bbd2, portal: 172.16.0.220,3260] successful.
Apr 11 16:19:40 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:19:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d74ea732-6d3c-4463-934c-6bf832a1bbd2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:19:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d74ea732-6d3c-4463-934c-6bf832a1bbd2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:19:40 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d717f3c-6b81-4382-983f-a2f59e006504]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:19:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:19:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:19:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:19:40 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4cd77e2-b0d8-4f25-be0a-416b2f3ecc2b]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d74ea732-6d3c-4463-934c-6bf832a1bbd2 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:19:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d74ea732-6d3c-4463-934c-6bf832a1bbd2 (non-flash)
Apr 11 16:19:40 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 16:19:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d74ea732-6d3c-4463-934c-6bf832a1bbd2 (non-flash)
Apr 11 16:19:40 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 16:19:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d74ea732-6d3c-4463-934c-6bf832a1bbd2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.425s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 16:19:40 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 16:19:40 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 16:19:40 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 16:19:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:19:40 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:19:40 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e84390b-438a-4956-b745-1ced128e4559]: (4, ('- - 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:19:40 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: None {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 16:19:40 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:19:41 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 16:19:41 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d74ea732-6d3c-4463-934c-6bf832a1bbd2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MiOLuwnq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 16:19:41 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.458s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 16:19:41 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] <== connect_volume: return (1461ms) {'type': 'block', 'scsi_wwn': '23231376137613733', 'path': '/dev/sdb'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 16:19:41 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231376137613733', 'path': '/dev/sdb'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 16:19:41 user nova-compute[71229]: DEBUG nova.objects.instance [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lazy-loading 'flavor' on Instance uuid d0a9404e-69b2-4633-badb-520f3d92ded8 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:19:41 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 16:19:41 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 16:19:41 user nova-compute[71229]:   <source dev="/dev/sdb"/>
Apr 11 16:19:41 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 16:19:41 user nova-compute[71229]:   <serial>d74ea732-6d3c-4463-934c-6bf832a1bbd2</serial>
Apr 11 16:19:41 user nova-compute[71229]: </disk>
Apr 11 16:19:41 user nova-compute[71229]:  {{(pid=71229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 16:19:41 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:19:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:19:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:19:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:19:41 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 16:19:41 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 16:19:41 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 16:19:41 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] No VIF found with MAC fa:16:3e:b3:43:20, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 16:19:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a9404e-69b2-4633-badb-520f3d92ded8/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:19:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-6d703dc1-655e-4998-ac00-b4d5d7c2f1ec tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "d0a9404e-69b2-4633-badb-520f3d92ded8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.523s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:19:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a9404e-69b2-4633-badb-520f3d92ded8/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:19:41 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a9404e-69b2-4633-badb-520f3d92ded8/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:19:42 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a9404e-69b2-4633-badb-520f3d92ded8/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:19:42 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71229) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 16:19:42 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:19:42 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:19:42 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8839MB free_disk=25.94412612915039GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 16:19:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:19:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:19:42 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance d0a9404e-69b2-4633-badb-520f3d92ded8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 16:19:42 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 16:19:42 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 16:19:42 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 16:19:42 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 16:19:42 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 16:19:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:19:42 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:19:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-92a46158-51f9-4b65-a205-b795a8906515 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "d0a9404e-69b2-4633-badb-520f3d92ded8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:19:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-92a46158-51f9-4b65-a205-b795a8906515 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "d0a9404e-69b2-4633-badb-520f3d92ded8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:19:43 user nova-compute[71229]: INFO nova.compute.manager [None req-92a46158-51f9-4b65-a205-b795a8906515 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Detaching volume d74ea732-6d3c-4463-934c-6bf832a1bbd2
Apr 11 16:19:43 user nova-compute[71229]: INFO nova.virt.block_device [None req-92a46158-51f9-4b65-a205-b795a8906515 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Attempting to driver detach volume d74ea732-6d3c-4463-934c-6bf832a1bbd2 from mountpoint /dev/vdb
Apr 11 16:19:43 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-92a46158-51f9-4b65-a205-b795a8906515 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Attempting to detach device vdb from instance d0a9404e-69b2-4633-badb-520f3d92ded8 from the persistent domain config. {{(pid=71229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 16:19:43 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-92a46158-51f9-4b65-a205-b795a8906515 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 16:19:43 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 16:19:43 user nova-compute[71229]:   <source dev="/dev/sdb"/>
Apr 11 16:19:43 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 16:19:43 user nova-compute[71229]:   <serial>d74ea732-6d3c-4463-934c-6bf832a1bbd2</serial>
Apr 11 16:19:43 user nova-compute[71229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 16:19:43 user nova-compute[71229]: </disk>
Apr 11 16:19:43 user nova-compute[71229]:  {{(pid=71229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 16:19:43 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-92a46158-51f9-4b65-a205-b795a8906515 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Successfully detached device vdb from instance d0a9404e-69b2-4633-badb-520f3d92ded8 from the persistent domain config.
Apr 11 16:19:43 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-92a46158-51f9-4b65-a205-b795a8906515 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d0a9404e-69b2-4633-badb-520f3d92ded8 from the live domain config. {{(pid=71229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 16:19:43 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-92a46158-51f9-4b65-a205-b795a8906515 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 16:19:43 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 16:19:43 user nova-compute[71229]:   <source dev="/dev/sdb"/>
Apr 11 16:19:43 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 16:19:43 user nova-compute[71229]:   <serial>d74ea732-6d3c-4463-934c-6bf832a1bbd2</serial>
Apr 11 16:19:43 user nova-compute[71229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 16:19:43 user nova-compute[71229]: </disk>
Apr 11 16:19:43 user nova-compute[71229]:  {{(pid=71229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 16:19:43 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Received event <DeviceRemovedEvent: 1681229983.9733422, d0a9404e-69b2-4633-badb-520f3d92ded8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71229) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 16:19:43 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-92a46158-51f9-4b65-a205-b795a8906515 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d0a9404e-69b2-4633-badb-520f3d92ded8 {{(pid=71229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 16:19:43 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-92a46158-51f9-4b65-a205-b795a8906515 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Successfully detached device vdb from instance d0a9404e-69b2-4633-badb-520f3d92ded8 from the live domain config.
Apr 11 16:19:43 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92a46158-51f9-4b65-a205-b795a8906515 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 16:19:43 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a46158-51f9-4b65-a205-b795a8906515 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:d74ea732-6d3c-4463-934c-6bf832a1bbd2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MiOLuwnq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 16:19:43 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-92a46158-51f9-4b65-a205-b795a8906515 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 16:19:43 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-92a46158-51f9-4b65-a205-b795a8906515 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 16:19:43 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-92a46158-51f9-4b65-a205-b795a8906515 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 16:19:43 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:19:44 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:19:44 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea52899-ee41-4ea2-9795-8a6cd03e4ace]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d74ea732-6d3c-4463-934c-6bf832a1bbd2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:19:44 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a46158-51f9-4b65-a205-b795a8906515 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 16:19:44 user nova-compute[71229]: No targets found.
Apr 11 16:19:44 user nova-compute[71229]: iSNS:
Apr 11 16:19:44 user nova-compute[71229]: No targets found.
Apr 11 16:19:44 user nova-compute[71229]: STATIC:
Apr 11 16:19:44 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:d74ea732-6d3c-4463-934c-6bf832a1bbd2
Apr 11 16:19:44 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 16:19:44 user nova-compute[71229]:                 Iface Name: default
Apr 11 16:19:44 user nova-compute[71229]: FIRMWARE:
Apr 11 16:19:44 user nova-compute[71229]: No targets found.
Apr 11 16:19:44 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 16:19:44 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a46158-51f9-4b65-a205-b795a8906515 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 16:19:44 user nova-compute[71229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 16:19:44 user nova-compute[71229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71229) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 16:19:44 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a46158-51f9-4b65-a205-b795a8906515 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d74ea732-6d3c-4463-934c-6bf832a1bbd2', 0)] {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 16:19:44 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:19:44 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:19:44 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[8919d8c9-7693-443f-afea-1e02d8eb2652]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d74ea732-6d3c-4463-934c-6bf832a1bbd2\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:19:44 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:19:44 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:19:44 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d685b7-c224-4b25-8e49-278ac184c9c2]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d74ea732-6d3c-4463-934c-6bf832a1bbd2 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:19:44 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a46158-51f9-4b65-a205-b795a8906515 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d74ea732-6d3c-4463-934c-6bf832a1bbd2 (non-flash)
Apr 11 16:19:44 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 16:19:44 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a46158-51f9-4b65-a205-b795a8906515 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d74ea732-6d3c-4463-934c-6bf832a1bbd2 (non-flash)
Apr 11 16:19:44 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 16:19:44 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a46158-51f9-4b65-a205-b795a8906515 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb69c6cee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d74ea732-6d3c-4463-934c-6bf832a1bbd2'): ({'sdb'}, set())}) {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 16:19:44 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-92a46158-51f9-4b65-a205-b795a8906515 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Removing single pathed devices sdb {{(pid=71229) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 16:19:44 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:19:44 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:19:44 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0165c91a-386b-4c9e-a636-657981174b82]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:19:44 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:19:44 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:19:44 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6022bcca-49bd-4bac-bad0-bf582587cff2]: (4, ('ok\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:19:44 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-92a46158-51f9-4b65-a205-b795a8906515 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Flushing IO for device /dev/sdb {{(pid=71229) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 16:19:44 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:19:44 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:19:44 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b154409-6201-4284-affd-afc158bce58c]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:19:44 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-92a46158-51f9-4b65-a205-b795a8906515 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71229) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 16:19:44 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:19:44 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:19:44 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e8da8b-7855-4b04-8abf-b15023affa3a]: (4, ('1', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:19:44 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-92a46158-51f9-4b65-a205-b795a8906515 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 16:19:44 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-92a46158-51f9-4b65-a205-b795a8906515 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] SCSI volumes sdb have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 16:19:44 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a46158-51f9-4b65-a205-b795a8906515 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d74ea732-6d3c-4463-934c-6bf832a1bbd2')] {{(pid=71229) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 16:19:44 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d74ea732-6d3c-4463-934c-6bf832a1bbd2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:19:44 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d74ea732-6d3c-4463-934c-6bf832a1bbd2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:19:44 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e5022c-4a9e-4f52-97b5-f3d71ddee777]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:19:44 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a46158-51f9-4b65-a205-b795a8906515 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:19:44 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d74ea732-6d3c-4463-934c-6bf832a1bbd2 -p 172.16.0.220:3260 --logout {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:19:44 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d74ea732-6d3c-4463-934c-6bf832a1bbd2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:19:44 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31e5cf6-e822-42a8-8732-3f6626cd4bc7]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:d74ea732-6d3c-4463-934c-6bf832a1bbd2, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:d74ea732-6d3c-4463-934c-6bf832a1bbd2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:19:44 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a46158-51f9-4b65-a205-b795a8906515 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:d74ea732-6d3c-4463-934c-6bf832a1bbd2, portal: 172.16.0.220,3260]
Apr 11 16:19:44 user nova-compute[71229]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:d74ea732-6d3c-4463-934c-6bf832a1bbd2, portal: 172.16.0.220,3260] successful.
Apr 11 16:19:44 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:19:44 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d74ea732-6d3c-4463-934c-6bf832a1bbd2 -p 172.16.0.220:3260 --op delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:19:44 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d74ea732-6d3c-4463-934c-6bf832a1bbd2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:19:44 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5aa9fe6-51c5-440d-b8dd-95115208faa2]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:19:44 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a46158-51f9-4b65-a205-b795a8906515 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:19:44 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-92a46158-51f9-4b65-a205-b795a8906515 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 16:19:44 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a46158-51f9-4b65-a205-b795a8906515 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] <== disconnect_volume: return (294ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 16:19:44 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92a46158-51f9-4b65-a205-b795a8906515 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 16:19:45 user nova-compute[71229]: DEBUG nova.objects.instance [None req-92a46158-51f9-4b65-a205-b795a8906515 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lazy-loading 'flavor' on Instance uuid d0a9404e-69b2-4633-badb-520f3d92ded8 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:19:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-92a46158-51f9-4b65-a205-b795a8906515 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "d0a9404e-69b2-4633-badb-520f3d92ded8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.681s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:19:45 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:19:45 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:19:45 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 16:19:45 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Rebuilding the list of instances to heal {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 16:19:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "refresh_cache-d0a9404e-69b2-4633-badb-520f3d92ded8" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 16:19:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquired lock "refresh_cache-d0a9404e-69b2-4633-badb-520f3d92ded8" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 16:19:45 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Forcefully refreshing network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 16:19:45 user nova-compute[71229]: DEBUG nova.objects.instance [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lazy-loading 'info_cache' on Instance uuid d0a9404e-69b2-4633-badb-520f3d92ded8 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:19:46 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Updating instance_info_cache with network_info: [{"id": "fa104891-1010-43ae-96f4-d7daa88d142c", "address": "fa:16:3e:b3:43:20", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa104891-10", "ovs_interfaceid": "fa104891-1010-43ae-96f4-d7daa88d142c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 16:19:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Releasing lock "refresh_cache-d0a9404e-69b2-4633-badb-520f3d92ded8" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 16:19:46 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Updated the network info_cache for instance {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 16:19:48 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:19:49 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:19:50 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:19:50 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:19:50 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:19:50 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:19:50 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:19:50 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:19:50 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:19:50 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:19:51 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:19:52 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:19:55 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:19:55 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:20:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:20:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:20:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:20:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:20:10 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:20:11 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:20:15 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:20:20 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:20:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:20:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:20:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b80bccb3-0fa5-4643-962c-f4f16df32b06 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "d0a9404e-69b2-4633-badb-520f3d92ded8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:20:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b80bccb3-0fa5-4643-962c-f4f16df32b06 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "d0a9404e-69b2-4633-badb-520f3d92ded8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:20:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b80bccb3-0fa5-4643-962c-f4f16df32b06 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "d0a9404e-69b2-4633-badb-520f3d92ded8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:20:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b80bccb3-0fa5-4643-962c-f4f16df32b06 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "d0a9404e-69b2-4633-badb-520f3d92ded8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:20:33 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b80bccb3-0fa5-4643-962c-f4f16df32b06 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "d0a9404e-69b2-4633-badb-520f3d92ded8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:20:33 user nova-compute[71229]: INFO nova.compute.manager [None req-b80bccb3-0fa5-4643-962c-f4f16df32b06 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Terminating instance
Apr 11 16:20:33 user nova-compute[71229]: DEBUG nova.compute.manager [None req-b80bccb3-0fa5-4643-962c-f4f16df32b06 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Start destroying the instance on the hypervisor. {{(pid=71229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 16:20:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:20:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:20:33 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:20:34 user nova-compute[71229]: DEBUG nova.compute.manager [req-dc5b70c3-d594-41cd-a70a-c49dd5cae737 req-38a8fdc8-29ab-4675-a6ea-9a618f54ac96 service nova] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Received event network-vif-unplugged-fa104891-1010-43ae-96f4-d7daa88d142c {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:20:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-dc5b70c3-d594-41cd-a70a-c49dd5cae737 req-38a8fdc8-29ab-4675-a6ea-9a618f54ac96 service nova] Acquiring lock "d0a9404e-69b2-4633-badb-520f3d92ded8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:20:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-dc5b70c3-d594-41cd-a70a-c49dd5cae737 req-38a8fdc8-29ab-4675-a6ea-9a618f54ac96 service nova] Lock "d0a9404e-69b2-4633-badb-520f3d92ded8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:20:34 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-dc5b70c3-d594-41cd-a70a-c49dd5cae737 req-38a8fdc8-29ab-4675-a6ea-9a618f54ac96 service nova] Lock "d0a9404e-69b2-4633-badb-520f3d92ded8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:20:34 user nova-compute[71229]: DEBUG nova.compute.manager [req-dc5b70c3-d594-41cd-a70a-c49dd5cae737 req-38a8fdc8-29ab-4675-a6ea-9a618f54ac96 service nova] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] No waiting events found dispatching network-vif-unplugged-fa104891-1010-43ae-96f4-d7daa88d142c {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 16:20:34 user nova-compute[71229]: DEBUG nova.compute.manager [req-dc5b70c3-d594-41cd-a70a-c49dd5cae737 req-38a8fdc8-29ab-4675-a6ea-9a618f54ac96 service nova] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Received event network-vif-unplugged-fa104891-1010-43ae-96f4-d7daa88d142c for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 16:20:34 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:20:34 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Instance destroyed successfully.
Apr 11 16:20:34 user nova-compute[71229]: DEBUG nova.objects.instance [None req-b80bccb3-0fa5-4643-962c-f4f16df32b06 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lazy-loading 'resources' on Instance uuid d0a9404e-69b2-4633-badb-520f3d92ded8 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:20:34 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-b80bccb3-0fa5-4643-962c-f4f16df32b06 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T16:17:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2006453280',display_name='tempest-AttachVolumeNegativeTest-server-2006453280',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2006453280',id=45,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8dlbQFiB7ISPLitc6dlEUMareriBSlnSSkyjSbknoEp8Kff9mdhoyWRUd8YJ7RHBILd2bd9WuL5uTfC2Oa/ga9zutVFhTsrhuX4vX+7GQ3xSh2wsWvbCADZDal6vyiPQ==',key_name='tempest-keypair-987834870',keypairs=<?>,launch_index=0,launched_at=2023-04-11T16:17:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6241b8bab90c4f1991413b84c5241baf',ramdisk_id='',reservation_id='r-qe0hha41',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-537147684',owner_user_name='tempest-AttachVolumeNegativeTest-537147684-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T16:17:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1332668b568e41a98bb68f6c28c92db9',uuid=d0a9404e-69b2-4633-badb-520f3d92ded8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa104891-1010-43ae-96f4-d7daa88d142c", "address": "fa:16:3e:b3:43:20", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa104891-10", "ovs_interfaceid": "fa104891-1010-43ae-96f4-d7daa88d142c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 16:20:34 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-b80bccb3-0fa5-4643-962c-f4f16df32b06 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Converting VIF {"id": "fa104891-1010-43ae-96f4-d7daa88d142c", "address": "fa:16:3e:b3:43:20", "network": {"id": "c3def4c9-33a3-48eb-ad5c-45bb499758ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1972007172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6241b8bab90c4f1991413b84c5241baf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa104891-10", "ovs_interfaceid": "fa104891-1010-43ae-96f4-d7daa88d142c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 16:20:34 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-b80bccb3-0fa5-4643-962c-f4f16df32b06 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:43:20,bridge_name='br-int',has_traffic_filtering=True,id=fa104891-1010-43ae-96f4-d7daa88d142c,network=Network(c3def4c9-33a3-48eb-ad5c-45bb499758ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa104891-10') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 16:20:34 user nova-compute[71229]: DEBUG os_vif [None req-b80bccb3-0fa5-4643-962c-f4f16df32b06 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:43:20,bridge_name='br-int',has_traffic_filtering=True,id=fa104891-1010-43ae-96f4-d7daa88d142c,network=Network(c3def4c9-33a3-48eb-ad5c-45bb499758ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa104891-10') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 16:20:34 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:20:34 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa104891-10, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 16:20:34 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:20:34 user nova-compute[71229]: INFO os_vif [None req-b80bccb3-0fa5-4643-962c-f4f16df32b06 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:43:20,bridge_name='br-int',has_traffic_filtering=True,id=fa104891-1010-43ae-96f4-d7daa88d142c,network=Network(c3def4c9-33a3-48eb-ad5c-45bb499758ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa104891-10')
Apr 11 16:20:34 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-b80bccb3-0fa5-4643-962c-f4f16df32b06 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Deleting instance files /opt/stack/data/nova/instances/d0a9404e-69b2-4633-badb-520f3d92ded8_del
Apr 11 16:20:34 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-b80bccb3-0fa5-4643-962c-f4f16df32b06 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Deletion of /opt/stack/data/nova/instances/d0a9404e-69b2-4633-badb-520f3d92ded8_del complete
Apr 11 16:20:34 user nova-compute[71229]: INFO nova.compute.manager [None req-b80bccb3-0fa5-4643-962c-f4f16df32b06 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 11 16:20:34 user nova-compute[71229]: DEBUG oslo.service.loopingcall [None req-b80bccb3-0fa5-4643-962c-f4f16df32b06 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71229) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 16:20:34 user nova-compute[71229]: DEBUG nova.compute.manager [-] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Deallocating network for instance {{(pid=71229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 16:20:34 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] deallocate_for_instance() {{(pid=71229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 16:20:35 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 16:20:35 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Took 0.81 seconds to deallocate network for instance.
Apr 11 16:20:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b80bccb3-0fa5-4643-962c-f4f16df32b06 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:20:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b80bccb3-0fa5-4643-962c-f4f16df32b06 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:20:35 user nova-compute[71229]: DEBUG nova.compute.manager [req-01acdd92-f795-49ec-a2eb-a60d215b730c req-3541f89e-6692-4a8c-9d46-0bfb3a9527ba service nova] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Received event network-vif-deleted-fa104891-1010-43ae-96f4-d7daa88d142c {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:20:35 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-b80bccb3-0fa5-4643-962c-f4f16df32b06 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 16:20:35 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-b80bccb3-0fa5-4643-962c-f4f16df32b06 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 16:20:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b80bccb3-0fa5-4643-962c-f4f16df32b06 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.110s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:20:35 user nova-compute[71229]: INFO nova.scheduler.client.report [None req-b80bccb3-0fa5-4643-962c-f4f16df32b06 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Deleted allocations for instance d0a9404e-69b2-4633-badb-520f3d92ded8
Apr 11 16:20:35 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-b80bccb3-0fa5-4643-962c-f4f16df32b06 tempest-AttachVolumeNegativeTest-537147684 tempest-AttachVolumeNegativeTest-537147684-project-member] Lock "d0a9404e-69b2-4633-badb-520f3d92ded8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.969s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:20:36 user nova-compute[71229]: DEBUG nova.compute.manager [req-972dfb43-b2fc-4117-9290-c7856b322166 req-45715f84-6fa3-4459-a97b-de488e08ac5d service nova] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Received event network-vif-plugged-fa104891-1010-43ae-96f4-d7daa88d142c {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:20:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-972dfb43-b2fc-4117-9290-c7856b322166 req-45715f84-6fa3-4459-a97b-de488e08ac5d service nova] Acquiring lock "d0a9404e-69b2-4633-badb-520f3d92ded8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:20:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-972dfb43-b2fc-4117-9290-c7856b322166 req-45715f84-6fa3-4459-a97b-de488e08ac5d service nova] Lock "d0a9404e-69b2-4633-badb-520f3d92ded8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:20:36 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-972dfb43-b2fc-4117-9290-c7856b322166 req-45715f84-6fa3-4459-a97b-de488e08ac5d service nova] Lock "d0a9404e-69b2-4633-badb-520f3d92ded8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:20:36 user nova-compute[71229]: DEBUG nova.compute.manager [req-972dfb43-b2fc-4117-9290-c7856b322166 req-45715f84-6fa3-4459-a97b-de488e08ac5d service nova] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] No waiting events found dispatching network-vif-plugged-fa104891-1010-43ae-96f4-d7daa88d142c {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 16:20:36 user nova-compute[71229]: WARNING nova.compute.manager [req-972dfb43-b2fc-4117-9290-c7856b322166 req-45715f84-6fa3-4459-a97b-de488e08ac5d service nova] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Received unexpected event network-vif-plugged-fa104891-1010-43ae-96f4-d7daa88d142c for instance with vm_state deleted and task_state None.
Apr 11 16:20:37 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:20:37 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 16:20:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:20:41 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:20:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:20:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:20:41 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:20:41 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 16:20:42 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:20:42 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:20:42 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8938MB free_disk=25.963031768798828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 16:20:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:20:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:20:42 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 16:20:42 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 16:20:42 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 16:20:42 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 16:20:42 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 16:20:42 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.327s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:20:44 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:20:47 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:20:47 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 16:20:47 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Rebuilding the list of instances to heal {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 16:20:47 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Didn't find any instances for network info cache update. {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 16:20:49 user nova-compute[71229]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681230034.5342953, d0a9404e-69b2-4633-badb-520f3d92ded8 => Stopped> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 16:20:49 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] VM Stopped (Lifecycle Event)
Apr 11 16:20:49 user nova-compute[71229]: DEBUG nova.compute.manager [None req-2e4229ba-1d86-44ba-94cb-3abf5532498f None None] [instance: d0a9404e-69b2-4633-badb-520f3d92ded8] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 16:20:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:20:49 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:20:49 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:20:50 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:20:51 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:20:51 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:20:54 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:20:56 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:20:59 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:21:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:21:09 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:21:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:21:19 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:21:24 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:21:24 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:21:29 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:21:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:21:34 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:21:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:21:39 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:21:39 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 16:21:43 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:21:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:21:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:21:43 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:21:43 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 16:21:44 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:21:44 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:21:44 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8943MB free_disk=25.961223602294922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 16:21:44 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:21:44 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:21:44 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 16:21:44 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 16:21:44 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 16:21:44 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 16:21:44 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 16:21:44 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.124s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:21:44 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:21:44 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:21:44 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:21:44 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:21:44 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:21:44 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:21:47 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:21:47 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 16:21:47 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Rebuilding the list of instances to heal {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 16:21:47 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Didn't find any instances for network info cache update. {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 16:21:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:21:49 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:21:51 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:21:51 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:21:52 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:21:52 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:21:54 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:21:57 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "239c53cb-bad6-4da9-881f-15bbd7cc91ae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:21:57 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "239c53cb-bad6-4da9-881f-15bbd7cc91ae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:21:57 user nova-compute[71229]: DEBUG nova.compute.manager [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Starting instance... {{(pid=71229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 16:21:57 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:21:57 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:21:57 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 16:21:57 user nova-compute[71229]: INFO nova.compute.claims [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Claim successful on node user
Apr 11 16:21:57 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 16:21:57 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 16:21:57 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.177s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:21:57 user nova-compute[71229]: DEBUG nova.compute.manager [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Start building networks asynchronously for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 16:21:58 user nova-compute[71229]: DEBUG nova.compute.manager [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Allocating IP information in the background. {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 16:21:58 user nova-compute[71229]: DEBUG nova.network.neutron [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] allocate_for_instance() {{(pid=71229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 16:21:58 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 16:21:58 user nova-compute[71229]: DEBUG nova.compute.manager [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Start building block device mappings for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 16:21:58 user nova-compute[71229]: DEBUG nova.policy [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '341892e1cf424bc18b4b21b261659456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bb61cdc7fa4b64baf6e8ef8b1e7815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71229) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 16:21:58 user nova-compute[71229]: DEBUG nova.compute.manager [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Start spawning the instance on the hypervisor. {{(pid=71229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 16:21:58 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Creating instance directory {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 16:21:58 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Creating image(s)
Apr 11 16:21:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "/opt/stack/data/nova/instances/239c53cb-bad6-4da9-881f-15bbd7cc91ae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:21:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "/opt/stack/data/nova/instances/239c53cb-bad6-4da9-881f-15bbd7cc91ae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:21:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "/opt/stack/data/nova/instances/239c53cb-bad6-4da9-881f-15bbd7cc91ae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:21:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:21:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.146s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:21:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:21:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:21:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:21:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.135s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:21:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/239c53cb-bad6-4da9-881f-15bbd7cc91ae/disk 1073741824 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:21:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/239c53cb-bad6-4da9-881f-15bbd7cc91ae/disk 1073741824" returned: 0 in 0.064s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:21:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:21:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:21:58 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:21:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.157s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:21:58 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Checking if we can resize image /opt/stack/data/nova/instances/239c53cb-bad6-4da9-881f-15bbd7cc91ae/disk. size=1073741824 {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 16:21:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/239c53cb-bad6-4da9-881f-15bbd7cc91ae/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:21:58 user nova-compute[71229]: DEBUG nova.network.neutron [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Successfully created port: 99328a6c-19a8-4c52-9669-c2399e6e9469 {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 16:21:58 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/239c53cb-bad6-4da9-881f-15bbd7cc91ae/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:21:58 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Cannot resize image /opt/stack/data/nova/instances/239c53cb-bad6-4da9-881f-15bbd7cc91ae/disk to a smaller size. {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 16:21:58 user nova-compute[71229]: DEBUG nova.objects.instance [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lazy-loading 'migration_context' on Instance uuid 239c53cb-bad6-4da9-881f-15bbd7cc91ae {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:21:58 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Created local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 16:21:58 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Ensure instance console log exists: /opt/stack/data/nova/instances/239c53cb-bad6-4da9-881f-15bbd7cc91ae/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 16:21:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:21:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:21:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:21:59 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:21:59 user nova-compute[71229]: DEBUG nova.network.neutron [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Successfully updated port: 99328a6c-19a8-4c52-9669-c2399e6e9469 {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 16:21:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "refresh_cache-239c53cb-bad6-4da9-881f-15bbd7cc91ae" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 16:21:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquired lock "refresh_cache-239c53cb-bad6-4da9-881f-15bbd7cc91ae" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 16:21:59 user nova-compute[71229]: DEBUG nova.network.neutron [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 16:21:59 user nova-compute[71229]: DEBUG nova.compute.manager [req-1fa57c67-37fc-4a99-87c3-96aef1b49c17 req-ca864f66-c41b-4534-ab88-ebbb7f0f24f9 service nova] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Received event network-changed-99328a6c-19a8-4c52-9669-c2399e6e9469 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:21:59 user nova-compute[71229]: DEBUG nova.compute.manager [req-1fa57c67-37fc-4a99-87c3-96aef1b49c17 req-ca864f66-c41b-4534-ab88-ebbb7f0f24f9 service nova] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Refreshing instance network info cache due to event network-changed-99328a6c-19a8-4c52-9669-c2399e6e9469. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 16:21:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-1fa57c67-37fc-4a99-87c3-96aef1b49c17 req-ca864f66-c41b-4534-ab88-ebbb7f0f24f9 service nova] Acquiring lock "refresh_cache-239c53cb-bad6-4da9-881f-15bbd7cc91ae" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 16:21:59 user nova-compute[71229]: DEBUG nova.network.neutron [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 16:22:00 user nova-compute[71229]: DEBUG nova.network.neutron [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Updating instance_info_cache with network_info: [{"id": "99328a6c-19a8-4c52-9669-c2399e6e9469", "address": "fa:16:3e:0c:f9:81", "network": {"id": "52b232a4-075e-4b10-ba25-3e80eb1a06cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-653846895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "09bb61cdc7fa4b64baf6e8ef8b1e7815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99328a6c-19", "ovs_interfaceid": "99328a6c-19a8-4c52-9669-c2399e6e9469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 16:22:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Releasing lock "refresh_cache-239c53cb-bad6-4da9-881f-15bbd7cc91ae" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 16:22:00 user nova-compute[71229]: DEBUG nova.compute.manager [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Instance network_info: |[{"id": "99328a6c-19a8-4c52-9669-c2399e6e9469", "address": "fa:16:3e:0c:f9:81", "network": {"id": "52b232a4-075e-4b10-ba25-3e80eb1a06cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-653846895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "09bb61cdc7fa4b64baf6e8ef8b1e7815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99328a6c-19", "ovs_interfaceid": "99328a6c-19a8-4c52-9669-c2399e6e9469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 16:22:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-1fa57c67-37fc-4a99-87c3-96aef1b49c17 req-ca864f66-c41b-4534-ab88-ebbb7f0f24f9 service nova] Acquired lock "refresh_cache-239c53cb-bad6-4da9-881f-15bbd7cc91ae" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 16:22:00 user nova-compute[71229]: DEBUG nova.network.neutron [req-1fa57c67-37fc-4a99-87c3-96aef1b49c17 req-ca864f66-c41b-4534-ab88-ebbb7f0f24f9 service nova] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Refreshing network info cache for port 99328a6c-19a8-4c52-9669-c2399e6e9469 {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 16:22:00 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Start _get_guest_xml network_info=[{"id": "99328a6c-19a8-4c52-9669-c2399e6e9469", "address": "fa:16:3e:0c:f9:81", "network": {"id": "52b232a4-075e-4b10-ba25-3e80eb1a06cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-653846895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "09bb61cdc7fa4b64baf6e8ef8b1e7815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99328a6c-19", "ovs_interfaceid": "99328a6c-19a8-4c52-9669-c2399e6e9469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '52fe638c-5ada-47d5-b376-233bfa808a37'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 16:22:00 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:22:00 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:22:00 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 16:22:00 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 16:22:00 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 16:22:00 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 16:22:00 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 16:22:00 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 16:22:00 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 16:22:00 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 16:22:00 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 16:22:00 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 16:22:00 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 16:22:00 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 16:22:00 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T16:21:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-880122054',display_name='tempest-VolumesSnapshotTestJSON-instance-880122054',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-880122054',id=46,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09bb61cdc7fa4b64baf6e8ef8b1e7815',ramdisk_id='',reservation_id='r-c9yud4q1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1487607345',owner_user_name='tempest-VolumesSnapshotTestJSON-1487607345-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T16:21:58Z,user_data=None,user_id='341892e1cf424bc18b4b21b261659456',uuid=239c53cb-bad6-4da9-881f-15bbd7cc91ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99328a6c-19a8-4c52-9669-c2399e6e9469", "address": "fa:16:3e:0c:f9:81", "network": {"id": "52b232a4-075e-4b10-ba25-3e80eb1a06cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-653846895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "09bb61cdc7fa4b64baf6e8ef8b1e7815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99328a6c-19", "ovs_interfaceid": "99328a6c-19a8-4c52-9669-c2399e6e9469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 16:22:00 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Converting VIF {"id": "99328a6c-19a8-4c52-9669-c2399e6e9469", "address": "fa:16:3e:0c:f9:81", "network": {"id": "52b232a4-075e-4b10-ba25-3e80eb1a06cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-653846895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "09bb61cdc7fa4b64baf6e8ef8b1e7815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99328a6c-19", "ovs_interfaceid": "99328a6c-19a8-4c52-9669-c2399e6e9469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 16:22:00 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:f9:81,bridge_name='br-int',has_traffic_filtering=True,id=99328a6c-19a8-4c52-9669-c2399e6e9469,network=Network(52b232a4-075e-4b10-ba25-3e80eb1a06cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99328a6c-19') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 16:22:00 user nova-compute[71229]: DEBUG nova.objects.instance [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lazy-loading 'pci_devices' on Instance uuid 239c53cb-bad6-4da9-881f-15bbd7cc91ae {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:22:00 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] End _get_guest_xml xml=<domain type="kvm">
Apr 11 16:22:00 user nova-compute[71229]:   <uuid>239c53cb-bad6-4da9-881f-15bbd7cc91ae</uuid>
Apr 11 16:22:00 user nova-compute[71229]:   <name>instance-0000002e</name>
Apr 11 16:22:00 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 16:22:00 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 16:22:00 user nova-compute[71229]:   <metadata>
Apr 11 16:22:00 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 16:22:00 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 16:22:00 user nova-compute[71229]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-880122054</nova:name>
Apr 11 16:22:00 user nova-compute[71229]:       <nova:creationTime>2023-04-11 16:22:00</nova:creationTime>
Apr 11 16:22:00 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 16:22:00 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 16:22:00 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 16:22:00 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 16:22:00 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 16:22:00 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 16:22:00 user nova-compute[71229]:       </nova:flavor>
Apr 11 16:22:00 user nova-compute[71229]:       <nova:owner>
Apr 11 16:22:00 user nova-compute[71229]:         <nova:user uuid="341892e1cf424bc18b4b21b261659456">tempest-VolumesSnapshotTestJSON-1487607345-project-member</nova:user>
Apr 11 16:22:00 user nova-compute[71229]:         <nova:project uuid="09bb61cdc7fa4b64baf6e8ef8b1e7815">tempest-VolumesSnapshotTestJSON-1487607345</nova:project>
Apr 11 16:22:00 user nova-compute[71229]:       </nova:owner>
Apr 11 16:22:00 user nova-compute[71229]:       <nova:root type="image" uuid="52fe638c-5ada-47d5-b376-233bfa808a37"/>
Apr 11 16:22:00 user nova-compute[71229]:       <nova:ports>
Apr 11 16:22:00 user nova-compute[71229]:         <nova:port uuid="99328a6c-19a8-4c52-9669-c2399e6e9469">
Apr 11 16:22:00 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 11 16:22:00 user nova-compute[71229]:         </nova:port>
Apr 11 16:22:00 user nova-compute[71229]:       </nova:ports>
Apr 11 16:22:00 user nova-compute[71229]:     </nova:instance>
Apr 11 16:22:00 user nova-compute[71229]:   </metadata>
Apr 11 16:22:00 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 16:22:00 user nova-compute[71229]:     <system>
Apr 11 16:22:00 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 16:22:00 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 16:22:00 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 16:22:00 user nova-compute[71229]:       <entry name="serial">239c53cb-bad6-4da9-881f-15bbd7cc91ae</entry>
Apr 11 16:22:00 user nova-compute[71229]:       <entry name="uuid">239c53cb-bad6-4da9-881f-15bbd7cc91ae</entry>
Apr 11 16:22:00 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 16:22:00 user nova-compute[71229]:     </system>
Apr 11 16:22:00 user nova-compute[71229]:   </sysinfo>
Apr 11 16:22:00 user nova-compute[71229]:   <os>
Apr 11 16:22:00 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 16:22:00 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 16:22:00 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 16:22:00 user nova-compute[71229]:   </os>
Apr 11 16:22:00 user nova-compute[71229]:   <features>
Apr 11 16:22:00 user nova-compute[71229]:     <acpi/>
Apr 11 16:22:00 user nova-compute[71229]:     <apic/>
Apr 11 16:22:00 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 16:22:00 user nova-compute[71229]:   </features>
Apr 11 16:22:00 user nova-compute[71229]:   <clock offset="utc">
Apr 11 16:22:00 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 16:22:00 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 16:22:00 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 16:22:00 user nova-compute[71229]:   </clock>
Apr 11 16:22:00 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 16:22:00 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 16:22:00 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 16:22:00 user nova-compute[71229]:   </cpu>
Apr 11 16:22:00 user nova-compute[71229]:   <devices>
Apr 11 16:22:00 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 16:22:00 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 16:22:00 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/239c53cb-bad6-4da9-881f-15bbd7cc91ae/disk"/>
Apr 11 16:22:00 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 16:22:00 user nova-compute[71229]:     </disk>
Apr 11 16:22:00 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 16:22:00 user nova-compute[71229]:       <mac address="fa:16:3e:0c:f9:81"/>
Apr 11 16:22:00 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 16:22:00 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 16:22:00 user nova-compute[71229]:       <target dev="tap99328a6c-19"/>
Apr 11 16:22:00 user nova-compute[71229]:     </interface>
Apr 11 16:22:00 user nova-compute[71229]:     <serial type="pty">
Apr 11 16:22:00 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/239c53cb-bad6-4da9-881f-15bbd7cc91ae/console.log" append="off"/>
Apr 11 16:22:00 user nova-compute[71229]:     </serial>
Apr 11 16:22:00 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 16:22:00 user nova-compute[71229]:     <video>
Apr 11 16:22:00 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 16:22:00 user nova-compute[71229]:     </video>
Apr 11 16:22:00 user nova-compute[71229]:     <rng model="virtio">
Apr 11 16:22:00 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 16:22:00 user nova-compute[71229]:     </rng>
Apr 11 16:22:00 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 16:22:00 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 16:22:00 user nova-compute[71229]:       <stats period="10"/>
Apr 11 16:22:00 user nova-compute[71229]:     </memballoon>
Apr 11 16:22:00 user nova-compute[71229]:   </devices>
Apr 11 16:22:00 user nova-compute[71229]: </domain>
Apr 11 16:22:00 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 16:22:00 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T16:21:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-880122054',display_name='tempest-VolumesSnapshotTestJSON-instance-880122054',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-880122054',id=46,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09bb61cdc7fa4b64baf6e8ef8b1e7815',ramdisk_id='',reservation_id='r-c9yud4q1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1487607345',owner_user_name='tempest-VolumesSnapshotTestJSON-1487607345-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T16:21:58Z,user_data=None,user_id='341892e1cf424bc18b4b21b261659456',uuid=239c53cb-bad6-4da9-881f-15bbd7cc91ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99328a6c-19a8-4c52-9669-c2399e6e9469", "address": "fa:16:3e:0c:f9:81", "network": {"id": "52b232a4-075e-4b10-ba25-3e80eb1a06cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-653846895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "09bb61cdc7fa4b64baf6e8ef8b1e7815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99328a6c-19", "ovs_interfaceid": "99328a6c-19a8-4c52-9669-c2399e6e9469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 16:22:00 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Converting VIF {"id": "99328a6c-19a8-4c52-9669-c2399e6e9469", "address": "fa:16:3e:0c:f9:81", "network": {"id": "52b232a4-075e-4b10-ba25-3e80eb1a06cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-653846895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "09bb61cdc7fa4b64baf6e8ef8b1e7815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99328a6c-19", "ovs_interfaceid": "99328a6c-19a8-4c52-9669-c2399e6e9469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 16:22:00 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:f9:81,bridge_name='br-int',has_traffic_filtering=True,id=99328a6c-19a8-4c52-9669-c2399e6e9469,network=Network(52b232a4-075e-4b10-ba25-3e80eb1a06cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99328a6c-19') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 16:22:00 user nova-compute[71229]: DEBUG os_vif [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:f9:81,bridge_name='br-int',has_traffic_filtering=True,id=99328a6c-19a8-4c52-9669-c2399e6e9469,network=Network(52b232a4-075e-4b10-ba25-3e80eb1a06cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99328a6c-19') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 16:22:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:22:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 16:22:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 16:22:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:22:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99328a6c-19, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 16:22:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap99328a6c-19, col_values=(('external_ids', {'iface-id': '99328a6c-19a8-4c52-9669-c2399e6e9469', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:f9:81', 'vm-uuid': '239c53cb-bad6-4da9-881f-15bbd7cc91ae'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 16:22:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:22:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:22:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:22:00 user nova-compute[71229]: INFO os_vif [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:f9:81,bridge_name='br-int',has_traffic_filtering=True,id=99328a6c-19a8-4c52-9669-c2399e6e9469,network=Network(52b232a4-075e-4b10-ba25-3e80eb1a06cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99328a6c-19')
Apr 11 16:22:00 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 16:22:00 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] No VIF found with MAC fa:16:3e:0c:f9:81, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 16:22:00 user nova-compute[71229]: DEBUG nova.network.neutron [req-1fa57c67-37fc-4a99-87c3-96aef1b49c17 req-ca864f66-c41b-4534-ab88-ebbb7f0f24f9 service nova] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Updated VIF entry in instance network info cache for port 99328a6c-19a8-4c52-9669-c2399e6e9469. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 16:22:00 user nova-compute[71229]: DEBUG nova.network.neutron [req-1fa57c67-37fc-4a99-87c3-96aef1b49c17 req-ca864f66-c41b-4534-ab88-ebbb7f0f24f9 service nova] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Updating instance_info_cache with network_info: [{"id": "99328a6c-19a8-4c52-9669-c2399e6e9469", "address": "fa:16:3e:0c:f9:81", "network": {"id": "52b232a4-075e-4b10-ba25-3e80eb1a06cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-653846895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "09bb61cdc7fa4b64baf6e8ef8b1e7815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99328a6c-19", "ovs_interfaceid": "99328a6c-19a8-4c52-9669-c2399e6e9469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 16:22:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-1fa57c67-37fc-4a99-87c3-96aef1b49c17 req-ca864f66-c41b-4534-ab88-ebbb7f0f24f9 service nova] Releasing lock "refresh_cache-239c53cb-bad6-4da9-881f-15bbd7cc91ae" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 16:22:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:22:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:22:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:22:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:22:01 user nova-compute[71229]: DEBUG nova.compute.manager [req-1e1608de-f350-436a-ad31-c3466e484c10 req-8d146f95-1a18-485c-aeb0-57a407d55367 service nova] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Received event network-vif-plugged-99328a6c-19a8-4c52-9669-c2399e6e9469 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:22:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-1e1608de-f350-436a-ad31-c3466e484c10 req-8d146f95-1a18-485c-aeb0-57a407d55367 service nova] Acquiring lock "239c53cb-bad6-4da9-881f-15bbd7cc91ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:22:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-1e1608de-f350-436a-ad31-c3466e484c10 req-8d146f95-1a18-485c-aeb0-57a407d55367 service nova] Lock "239c53cb-bad6-4da9-881f-15bbd7cc91ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:22:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-1e1608de-f350-436a-ad31-c3466e484c10 req-8d146f95-1a18-485c-aeb0-57a407d55367 service nova] Lock "239c53cb-bad6-4da9-881f-15bbd7cc91ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:22:01 user nova-compute[71229]: DEBUG nova.compute.manager [req-1e1608de-f350-436a-ad31-c3466e484c10 req-8d146f95-1a18-485c-aeb0-57a407d55367 service nova] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] No waiting events found dispatching network-vif-plugged-99328a6c-19a8-4c52-9669-c2399e6e9469 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 16:22:01 user nova-compute[71229]: WARNING nova.compute.manager [req-1e1608de-f350-436a-ad31-c3466e484c10 req-8d146f95-1a18-485c-aeb0-57a407d55367 service nova] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Received unexpected event network-vif-plugged-99328a6c-19a8-4c52-9669-c2399e6e9469 for instance with vm_state building and task_state spawning.
Apr 11 16:22:02 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:22:03 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681230123.666936, 239c53cb-bad6-4da9-881f-15bbd7cc91ae => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 16:22:03 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] VM Resumed (Lifecycle Event)
Apr 11 16:22:03 user nova-compute[71229]: DEBUG nova.compute.manager [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 16:22:03 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Guest created on hypervisor {{(pid=71229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 16:22:03 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Instance spawned successfully.
Apr 11 16:22:03 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 16:22:03 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 16:22:03 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 16:22:03 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Found default for hw_cdrom_bus of ide {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 16:22:03 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Found default for hw_disk_bus of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 16:22:03 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Found default for hw_input_bus of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 16:22:03 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Found default for hw_pointer_model of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 16:22:03 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Found default for hw_video_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 16:22:03 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Found default for hw_vif_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 16:22:03 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 16:22:03 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681230123.6713824, 239c53cb-bad6-4da9-881f-15bbd7cc91ae => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 16:22:03 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] VM Started (Lifecycle Event)
Apr 11 16:22:03 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 16:22:03 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 16:22:03 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 16:22:03 user nova-compute[71229]: INFO nova.compute.manager [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Took 5.61 seconds to spawn the instance on the hypervisor.
Apr 11 16:22:03 user nova-compute[71229]: DEBUG nova.compute.manager [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 16:22:03 user nova-compute[71229]: INFO nova.compute.manager [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Took 6.11 seconds to build instance.
Apr 11 16:22:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-6f95e487-1372-4dc8-9921-4d6233b77e62 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "239c53cb-bad6-4da9-881f-15bbd7cc91ae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.204s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:22:03 user nova-compute[71229]: DEBUG nova.compute.manager [req-8346a543-6a7a-4fb0-b8da-866ba56c1321 req-75709996-f274-4845-9f78-1900c42ee532 service nova] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Received event network-vif-plugged-99328a6c-19a8-4c52-9669-c2399e6e9469 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:22:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-8346a543-6a7a-4fb0-b8da-866ba56c1321 req-75709996-f274-4845-9f78-1900c42ee532 service nova] Acquiring lock "239c53cb-bad6-4da9-881f-15bbd7cc91ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:22:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-8346a543-6a7a-4fb0-b8da-866ba56c1321 req-75709996-f274-4845-9f78-1900c42ee532 service nova] Lock "239c53cb-bad6-4da9-881f-15bbd7cc91ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:22:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-8346a543-6a7a-4fb0-b8da-866ba56c1321 req-75709996-f274-4845-9f78-1900c42ee532 service nova] Lock "239c53cb-bad6-4da9-881f-15bbd7cc91ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:22:03 user nova-compute[71229]: DEBUG nova.compute.manager [req-8346a543-6a7a-4fb0-b8da-866ba56c1321 req-75709996-f274-4845-9f78-1900c42ee532 service nova] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] No waiting events found dispatching network-vif-plugged-99328a6c-19a8-4c52-9669-c2399e6e9469 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 16:22:03 user nova-compute[71229]: WARNING nova.compute.manager [req-8346a543-6a7a-4fb0-b8da-866ba56c1321 req-75709996-f274-4845-9f78-1900c42ee532 service nova] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Received unexpected event network-vif-plugged-99328a6c-19a8-4c52-9669-c2399e6e9469 for instance with vm_state active and task_state None.
Apr 11 16:22:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:22:10 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:22:10 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:22:10 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:22:10 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:22:10 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:22:10 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:22:11 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:22:15 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:22:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:22:20 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:22:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:22:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:22:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:22:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:22:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:22:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:22:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:22:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:22:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:22:35 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:22:39 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:22:39 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 16:22:40 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:22:45 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:22:45 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:22:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:22:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:22:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:22:45 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 16:22:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/239c53cb-bad6-4da9-881f-15bbd7cc91ae/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:22:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/239c53cb-bad6-4da9-881f-15bbd7cc91ae/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:22:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/239c53cb-bad6-4da9-881f-15bbd7cc91ae/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:22:46 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/239c53cb-bad6-4da9-881f-15bbd7cc91ae/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:22:46 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:22:46 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:22:46 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8812MB free_disk=25.940433502197266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 16:22:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:22:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:22:46 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 239c53cb-bad6-4da9-881f-15bbd7cc91ae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 16:22:46 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 16:22:46 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 16:22:46 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 16:22:46 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 16:22:46 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 16:22:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:22:47 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:22:48 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:22:48 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 16:22:48 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Rebuilding the list of instances to heal {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 16:22:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "refresh_cache-239c53cb-bad6-4da9-881f-15bbd7cc91ae" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 16:22:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquired lock "refresh_cache-239c53cb-bad6-4da9-881f-15bbd7cc91ae" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 16:22:48 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Forcefully refreshing network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 16:22:48 user nova-compute[71229]: DEBUG nova.objects.instance [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lazy-loading 'info_cache' on Instance uuid 239c53cb-bad6-4da9-881f-15bbd7cc91ae {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:22:49 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Updating instance_info_cache with network_info: [{"id": "99328a6c-19a8-4c52-9669-c2399e6e9469", "address": "fa:16:3e:0c:f9:81", "network": {"id": "52b232a4-075e-4b10-ba25-3e80eb1a06cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-653846895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "09bb61cdc7fa4b64baf6e8ef8b1e7815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99328a6c-19", "ovs_interfaceid": "99328a6c-19a8-4c52-9669-c2399e6e9469", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 16:22:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Releasing lock "refresh_cache-239c53cb-bad6-4da9-881f-15bbd7cc91ae" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 16:22:49 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Updated the network info_cache for instance {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 16:22:50 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:22:50 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:22:51 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:22:51 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:22:51 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Cleaning up deleted instances {{(pid=71229) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 16:22:51 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] There are 0 instances to clean {{(pid=71229) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 16:22:53 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:22:53 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:22:54 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:22:55 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:22:59 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:23:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:23:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:23:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:23:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:23:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:23:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:23:05 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:23:10 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:23:15 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:23:15 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:23:15 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:23:15 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:23:15 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:23:15 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:23:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:23:19 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:23:19 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71229) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 16:23:20 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:23:22 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:23:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:23:25 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:23:30 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:23:35 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:23:40 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:23:41 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:23:41 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 16:23:45 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:23:45 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:23:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:23:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:23:45 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:23:45 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 16:23:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/239c53cb-bad6-4da9-881f-15bbd7cc91ae/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:23:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/239c53cb-bad6-4da9-881f-15bbd7cc91ae/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:23:45 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/239c53cb-bad6-4da9-881f-15bbd7cc91ae/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:23:46 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/239c53cb-bad6-4da9-881f-15bbd7cc91ae/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:23:46 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:23:46 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:23:46 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8828MB free_disk=25.93987274169922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 16:23:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:23:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:23:46 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance 239c53cb-bad6-4da9-881f-15bbd7cc91ae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 16:23:46 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 16:23:46 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 16:23:46 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Refreshing inventories for resource provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 16:23:46 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Updating ProviderTree inventory for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 16:23:46 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Updating inventory in ProviderTree for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 16:23:46 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Refreshing aggregate associations for resource provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de, aggregates: None {{(pid=71229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 16:23:46 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Refreshing trait associations for resource provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de, traits: COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=71229) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 16:23:46 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 16:23:46 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 16:23:46 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 16:23:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.327s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:23:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "239c53cb-bad6-4da9-881f-15bbd7cc91ae" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:23:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "239c53cb-bad6-4da9-881f-15bbd7cc91ae" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:23:47 user nova-compute[71229]: DEBUG nova.objects.instance [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lazy-loading 'flavor' on Instance uuid 239c53cb-bad6-4da9-881f-15bbd7cc91ae {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:23:47 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Ignoring supplied device name: /dev/vdb
Apr 11 16:23:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "239c53cb-bad6-4da9-881f-15bbd7cc91ae" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "239c53cb-bad6-4da9-881f-15bbd7cc91ae" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "239c53cb-bad6-4da9-881f-15bbd7cc91ae" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:23:48 user nova-compute[71229]: INFO nova.compute.manager [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Attaching volume 198df94c-d822-49f7-9f58-9265596246d5 to /dev/vdb
Apr 11 16:23:48 user nova-compute[71229]: DEBUG os_brick.utils [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 16:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:23:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[133a5c77-8297-4a22-ba42-6410ba5df6d9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d55e24a97c90\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:23:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b251c5a-3a20-45cd-94e4-68f876a7ecfe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:23:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[16add771-7636-4d61-bd30-c54c5d9bbcf9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:23:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2d2366-340b-4a7a-8642-a943482313dc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Running cmd (subprocess): nvme version {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] 'nvme version' failed. Not Retrying. {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 16:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] nvme not present on system {{(pid=71229) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 16:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 16:23:48 user nova-compute[71229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 16:23:48 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[df45e02c-ba38-4838-bb5f-4b6f6fe37442]: (4, '') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71229) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 16:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 16:23:48 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] LIGHTOS: no hostnqn found. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 16:23:48 user nova-compute[71229]: DEBUG os_brick.utils [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d55e24a97c90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 16:23:48 user nova-compute[71229]: DEBUG nova.virt.block_device [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Updating existing volume attachment record: 3bd6127e-da4e-4c0f-8179-3dfb98faa1b9 {{(pid=71229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 16:23:48 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:23:48 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 16:23:48 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Rebuilding the list of instances to heal {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 16:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "refresh_cache-239c53cb-bad6-4da9-881f-15bbd7cc91ae" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 16:23:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquired lock "refresh_cache-239c53cb-bad6-4da9-881f-15bbd7cc91ae" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 16:23:48 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Forcefully refreshing network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 16:23:48 user nova-compute[71229]: DEBUG nova.objects.instance [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lazy-loading 'info_cache' on Instance uuid 239c53cb-bad6-4da9-881f-15bbd7cc91ae {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:23:49 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Updating instance_info_cache with network_info: [{"id": "99328a6c-19a8-4c52-9669-c2399e6e9469", "address": "fa:16:3e:0c:f9:81", "network": {"id": "52b232a4-075e-4b10-ba25-3e80eb1a06cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-653846895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "09bb61cdc7fa4b64baf6e8ef8b1e7815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99328a6c-19", "ovs_interfaceid": "99328a6c-19a8-4c52-9669-c2399e6e9469", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 16:23:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Releasing lock "refresh_cache-239c53cb-bad6-4da9-881f-15bbd7cc91ae" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 16:23:49 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Updated the network info_cache for instance {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 16:23:50 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:23:51 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:23:51 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:198df94c-d822-49f7-9f58-9265596246d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYKnJQXD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 16:23:52 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 16:23:52 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 16:23:52 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 16:23:52 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:198df94c-d822-49f7-9f58-9265596246d5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:198df94c-d822-49f7-9f58-9265596246d5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 16:23:52 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 16:23:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:198df94c-d822-49f7-9f58-9265596246d5 -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:198df94c-d822-49f7-9f58-9265596246d5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf93742-7676-44ad-89bb-5f0f8501184d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 16:23:52 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:198df94c-d822-49f7-9f58-9265596246d5 -p 172.16.0.220:3260 --interface default --op new {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:198df94c-d822-49f7-9f58-9265596246d5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0903babc-9de2-46f3-82c2-2bb765eea4a5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:198df94c-d822-49f7-9f58-9265596246d5] added\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:198df94c-d822-49f7-9f58-9265596246d5] added
Apr 11 16:23:52 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:198df94c-d822-49f7-9f58-9265596246d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:198df94c-d822-49f7-9f58-9265596246d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[05622cd5-7ca5-4d7c-a374-e856233a4b43]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:198df94c-d822-49f7-9f58-9265596246d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:198df94c-d822-49f7-9f58-9265596246d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a3943e-a964-4c19-9586-43f86c6fa693]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:198df94c-d822-49f7-9f58-9265596246d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UYKnJQXD {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:198df94c-d822-49f7-9f58-9265596246d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UYKnJQXD" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcda9c6c-6e60-4b1a-9dc3-895d76974b90]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UYKnJQXD'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:198df94c-d822-49f7-9f58-9265596246d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:198df94c-d822-49f7-9f58-9265596246d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[44968983-c8fe-4166-b1ab-041930393129]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36e725c-1049-46ca-89ab-c894cdee7e09]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 11 16:23:52 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 11 16:23:52 user nova-compute[71229]:  {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 16:23:52 user nova-compute[71229]: WARNING os_brick.initiator.connectors.iscsi [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 11 16:23:52 user nova-compute[71229]: 
Apr 11 16:23:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:198df94c-d822-49f7-9f58-9265596246d5 -p 172.16.0.220:3260 --login {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:198df94c-d822-49f7-9f58-9265596246d5 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d978bb50-1cae-4ba0-a230-d5ebad0c1e63]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:198df94c-d822-49f7-9f58-9265596246d5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:198df94c-d822-49f7-9f58-9265596246d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:198df94c-d822-49f7-9f58-9265596246d5, portal: 172.16.0.220,3260]
Apr 11 16:23:52 user nova-compute[71229]: Login to [iface: default, target: iqn.2010-10.org.openstack:198df94c-d822-49f7-9f58-9265596246d5, portal: 172.16.0.220,3260] successful.
Apr 11 16:23:52 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:198df94c-d822-49f7-9f58-9265596246d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:198df94c-d822-49f7-9f58-9265596246d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bfbac3d-bc8f-4dc8-9596-3731f6260bf2]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ac7beb-8bc6-4cd3-8af5-ca2d2489ce8c]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198df94c-d822-49f7-9f58-9265596246d5 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198df94c-d822-49f7-9f58-9265596246d5 (non-flash)
Apr 11 16:23:52 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198df94c-d822-49f7-9f58-9265596246d5 (non-flash)
Apr 11 16:23:52 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:198df94c-d822-49f7-9f58-9265596246d5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.045s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[74949c9b-a4c9-4cd0-a835-61a73f106b9c]: (4, ('- - 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 16:23:52 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:198df94c-d822-49f7-9f58-9265596246d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYKnJQXD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 16:23:53 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:23:53 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 16:23:53 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23765393634326631', 'path': '/dev/sdb'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 16:23:53 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765393634326631', 'path': '/dev/sdb'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 16:23:53 user nova-compute[71229]: DEBUG nova.objects.instance [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lazy-loading 'flavor' on Instance uuid 239c53cb-bad6-4da9-881f-15bbd7cc91ae {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:23:53 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 16:23:53 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 16:23:53 user nova-compute[71229]:   <source dev="/dev/sdb"/>
Apr 11 16:23:53 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 16:23:53 user nova-compute[71229]:   <serial>198df94c-d822-49f7-9f58-9265596246d5</serial>
Apr 11 16:23:53 user nova-compute[71229]: </disk>
Apr 11 16:23:53 user nova-compute[71229]:  {{(pid=71229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 16:23:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 16:23:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 16:23:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] No VIF found with MAC fa:16:3e:0c:f9:81, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 16:23:54 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-13b0d649-c0bd-40f3-9241-b84835848834 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "239c53cb-bad6-4da9-881f-15bbd7cc91ae" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.411s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:23:55 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:23:55 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:23:55 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:24:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:24:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:24:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:24:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:24:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:24:00 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:24:00 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:24:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f21fa492-4322-4f9d-bfe5-a46cca71dfde tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "239c53cb-bad6-4da9-881f-15bbd7cc91ae" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:24:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f21fa492-4322-4f9d-bfe5-a46cca71dfde tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "239c53cb-bad6-4da9-881f-15bbd7cc91ae" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:24:01 user nova-compute[71229]: INFO nova.compute.manager [None req-f21fa492-4322-4f9d-bfe5-a46cca71dfde tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Detaching volume 198df94c-d822-49f7-9f58-9265596246d5
Apr 11 16:24:02 user nova-compute[71229]: INFO nova.virt.block_device [None req-f21fa492-4322-4f9d-bfe5-a46cca71dfde tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Attempting to driver detach volume 198df94c-d822-49f7-9f58-9265596246d5 from mountpoint /dev/vdb
Apr 11 16:24:02 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f21fa492-4322-4f9d-bfe5-a46cca71dfde tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Attempting to detach device vdb from instance 239c53cb-bad6-4da9-881f-15bbd7cc91ae from the persistent domain config. {{(pid=71229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-f21fa492-4322-4f9d-bfe5-a46cca71dfde tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 16:24:02 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 16:24:02 user nova-compute[71229]:   <source dev="/dev/sdb"/>
Apr 11 16:24:02 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 16:24:02 user nova-compute[71229]:   <serial>198df94c-d822-49f7-9f58-9265596246d5</serial>
Apr 11 16:24:02 user nova-compute[71229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 16:24:02 user nova-compute[71229]: </disk>
Apr 11 16:24:02 user nova-compute[71229]:  {{(pid=71229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 16:24:02 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-f21fa492-4322-4f9d-bfe5-a46cca71dfde tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Successfully detached device vdb from instance 239c53cb-bad6-4da9-881f-15bbd7cc91ae from the persistent domain config.
Apr 11 16:24:02 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f21fa492-4322-4f9d-bfe5-a46cca71dfde tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 239c53cb-bad6-4da9-881f-15bbd7cc91ae from the live domain config. {{(pid=71229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-f21fa492-4322-4f9d-bfe5-a46cca71dfde tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 16:24:02 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 16:24:02 user nova-compute[71229]:   <source dev="/dev/sdb"/>
Apr 11 16:24:02 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 16:24:02 user nova-compute[71229]:   <serial>198df94c-d822-49f7-9f58-9265596246d5</serial>
Apr 11 16:24:02 user nova-compute[71229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 16:24:02 user nova-compute[71229]: </disk>
Apr 11 16:24:02 user nova-compute[71229]:  {{(pid=71229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f5a28417-e92c-4c76-abe1-7b81b0063689 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "239c53cb-bad6-4da9-881f-15bbd7cc91ae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Received event <DeviceRemovedEvent: 1681230242.4398472, 239c53cb-bad6-4da9-881f-15bbd7cc91ae => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71229) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-f21fa492-4322-4f9d-bfe5-a46cca71dfde tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 239c53cb-bad6-4da9-881f-15bbd7cc91ae {{(pid=71229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 16:24:02 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-f21fa492-4322-4f9d-bfe5-a46cca71dfde tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Successfully detached device vdb from instance 239c53cb-bad6-4da9-881f-15bbd7cc91ae from the live domain config.
Apr 11 16:24:02 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f21fa492-4322-4f9d-bfe5-a46cca71dfde tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f21fa492-4322-4f9d-bfe5-a46cca71dfde tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:198df94c-d822-49f7-9f58-9265596246d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYKnJQXD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 16:24:02 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-f21fa492-4322-4f9d-bfe5-a46cca71dfde tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 16:24:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-f21fa492-4322-4f9d-bfe5-a46cca71dfde tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-f21fa492-4322-4f9d-bfe5-a46cca71dfde tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f440e1ec-b1eb-4d4a-a979-d8249aca2863]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:198df94c-d822-49f7-9f58-9265596246d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f21fa492-4322-4f9d-bfe5-a46cca71dfde tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 16:24:02 user nova-compute[71229]: No targets found.
Apr 11 16:24:02 user nova-compute[71229]: iSNS:
Apr 11 16:24:02 user nova-compute[71229]: No targets found.
Apr 11 16:24:02 user nova-compute[71229]: STATIC:
Apr 11 16:24:02 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:198df94c-d822-49f7-9f58-9265596246d5
Apr 11 16:24:02 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 16:24:02 user nova-compute[71229]:                 Iface Name: default
Apr 11 16:24:02 user nova-compute[71229]: FIRMWARE:
Apr 11 16:24:02 user nova-compute[71229]: No targets found.
Apr 11 16:24:02 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f21fa492-4322-4f9d-bfe5-a46cca71dfde tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 16:24:02 user nova-compute[71229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 16:24:02 user nova-compute[71229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71229) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f21fa492-4322-4f9d-bfe5-a46cca71dfde tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:198df94c-d822-49f7-9f58-9265596246d5', 0)] {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc359174-2e0f-41af-8baa-7e9de6d37b5a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:198df94c-d822-49f7-9f58-9265596246d5\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5859c6-b1e9-491a-8f19-acb2ba32dd8b]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198df94c-d822-49f7-9f58-9265596246d5 (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f21fa492-4322-4f9d-bfe5-a46cca71dfde tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198df94c-d822-49f7-9f58-9265596246d5 (non-flash)
Apr 11 16:24:02 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f21fa492-4322-4f9d-bfe5-a46cca71dfde tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:198df94c-d822-49f7-9f58-9265596246d5 (non-flash)
Apr 11 16:24:02 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f21fa492-4322-4f9d-bfe5-a46cca71dfde tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb5c2fd7e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:198df94c-d822-49f7-9f58-9265596246d5'): ({'sdb'}, set())}) {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-f21fa492-4322-4f9d-bfe5-a46cca71dfde tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Removing single pathed devices sdb {{(pid=71229) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4dfcb7-87d3-4862-88f8-c3d45ca206cf]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[28198077-bceb-4a97-b20a-55e9114d702e]: (4, ('ok\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-f21fa492-4322-4f9d-bfe5-a46cca71dfde tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Flushing IO for device /dev/sdb {{(pid=71229) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9cc692-c6a8-40fc-8719-10cbed3e7d44]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-f21fa492-4322-4f9d-bfe5-a46cca71dfde tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71229) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6914d884-d261-4c14-99ba-ae03e89e26ae]: (4, ('1', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-f21fa492-4322-4f9d-bfe5-a46cca71dfde tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-f21fa492-4322-4f9d-bfe5-a46cca71dfde tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] SCSI volumes sdb have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f21fa492-4322-4f9d-bfe5-a46cca71dfde tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:198df94c-d822-49f7-9f58-9265596246d5')] {{(pid=71229) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:198df94c-d822-49f7-9f58-9265596246d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:198df94c-d822-49f7-9f58-9265596246d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ba4334-376f-4e97-bdff-e2b396655bbc]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f21fa492-4322-4f9d-bfe5-a46cca71dfde tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:198df94c-d822-49f7-9f58-9265596246d5 -p 172.16.0.220:3260 --logout {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:198df94c-d822-49f7-9f58-9265596246d5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3d4c91-4714-4682-a8f0-dbcc9f49956b]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:198df94c-d822-49f7-9f58-9265596246d5, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:198df94c-d822-49f7-9f58-9265596246d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f21fa492-4322-4f9d-bfe5-a46cca71dfde tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:198df94c-d822-49f7-9f58-9265596246d5, portal: 172.16.0.220,3260]
Apr 11 16:24:02 user nova-compute[71229]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:198df94c-d822-49f7-9f58-9265596246d5, portal: 172.16.0.220,3260] successful.
Apr 11 16:24:02 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:198df94c-d822-49f7-9f58-9265596246d5 -p 172.16.0.220:3260 --op delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:198df94c-d822-49f7-9f58-9265596246d5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6d281e-3ccf-480b-ab2d-95c71aa7e92f]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f21fa492-4322-4f9d-bfe5-a46cca71dfde tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-f21fa492-4322-4f9d-bfe5-a46cca71dfde tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f21fa492-4322-4f9d-bfe5-a46cca71dfde tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] <== disconnect_volume: return (341ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 16:24:02 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f21fa492-4322-4f9d-bfe5-a46cca71dfde tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 16:24:03 user nova-compute[71229]: DEBUG nova.objects.instance [None req-f21fa492-4322-4f9d-bfe5-a46cca71dfde tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lazy-loading 'flavor' on Instance uuid 239c53cb-bad6-4da9-881f-15bbd7cc91ae {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:24:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f21fa492-4322-4f9d-bfe5-a46cca71dfde tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "239c53cb-bad6-4da9-881f-15bbd7cc91ae" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.670s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:24:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f5a28417-e92c-4c76-abe1-7b81b0063689 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "239c53cb-bad6-4da9-881f-15bbd7cc91ae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.561s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:24:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f5a28417-e92c-4c76-abe1-7b81b0063689 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "239c53cb-bad6-4da9-881f-15bbd7cc91ae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:24:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f5a28417-e92c-4c76-abe1-7b81b0063689 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "239c53cb-bad6-4da9-881f-15bbd7cc91ae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:24:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f5a28417-e92c-4c76-abe1-7b81b0063689 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "239c53cb-bad6-4da9-881f-15bbd7cc91ae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:24:03 user nova-compute[71229]: INFO nova.compute.manager [None req-f5a28417-e92c-4c76-abe1-7b81b0063689 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Terminating instance
Apr 11 16:24:03 user nova-compute[71229]: DEBUG nova.compute.manager [None req-f5a28417-e92c-4c76-abe1-7b81b0063689 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Start destroying the instance on the hypervisor. {{(pid=71229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 16:24:03 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:24:03 user nova-compute[71229]: DEBUG nova.compute.manager [req-12bc3504-10b8-47d4-a086-43bf22171dc9 req-1b625c8f-5cb2-464a-a9ba-d5d6e2d68004 service nova] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Received event network-vif-unplugged-99328a6c-19a8-4c52-9669-c2399e6e9469 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:24:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-12bc3504-10b8-47d4-a086-43bf22171dc9 req-1b625c8f-5cb2-464a-a9ba-d5d6e2d68004 service nova] Acquiring lock "239c53cb-bad6-4da9-881f-15bbd7cc91ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:24:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-12bc3504-10b8-47d4-a086-43bf22171dc9 req-1b625c8f-5cb2-464a-a9ba-d5d6e2d68004 service nova] Lock "239c53cb-bad6-4da9-881f-15bbd7cc91ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:24:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-12bc3504-10b8-47d4-a086-43bf22171dc9 req-1b625c8f-5cb2-464a-a9ba-d5d6e2d68004 service nova] Lock "239c53cb-bad6-4da9-881f-15bbd7cc91ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:24:03 user nova-compute[71229]: DEBUG nova.compute.manager [req-12bc3504-10b8-47d4-a086-43bf22171dc9 req-1b625c8f-5cb2-464a-a9ba-d5d6e2d68004 service nova] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] No waiting events found dispatching network-vif-unplugged-99328a6c-19a8-4c52-9669-c2399e6e9469 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 16:24:03 user nova-compute[71229]: DEBUG nova.compute.manager [req-12bc3504-10b8-47d4-a086-43bf22171dc9 req-1b625c8f-5cb2-464a-a9ba-d5d6e2d68004 service nova] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Received event network-vif-unplugged-99328a6c-19a8-4c52-9669-c2399e6e9469 for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 16:24:04 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Instance destroyed successfully.
Apr 11 16:24:04 user nova-compute[71229]: DEBUG nova.objects.instance [None req-f5a28417-e92c-4c76-abe1-7b81b0063689 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lazy-loading 'resources' on Instance uuid 239c53cb-bad6-4da9-881f-15bbd7cc91ae {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:24:04 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-f5a28417-e92c-4c76-abe1-7b81b0063689 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T16:21:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-880122054',display_name='tempest-VolumesSnapshotTestJSON-instance-880122054',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-880122054',id=46,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T16:22:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='09bb61cdc7fa4b64baf6e8ef8b1e7815',ramdisk_id='',reservation_id='r-c9yud4q1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1487607345',owner_user_name='tempest-VolumesSnapshotTestJSON-1487607345-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T16:22:04Z,user_data=None,user_id='341892e1cf424bc18b4b21b261659456',uuid=239c53cb-bad6-4da9-881f-15bbd7cc91ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99328a6c-19a8-4c52-9669-c2399e6e9469", "address": "fa:16:3e:0c:f9:81", "network": {"id": "52b232a4-075e-4b10-ba25-3e80eb1a06cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-653846895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "09bb61cdc7fa4b64baf6e8ef8b1e7815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99328a6c-19", "ovs_interfaceid": "99328a6c-19a8-4c52-9669-c2399e6e9469", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 16:24:04 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-f5a28417-e92c-4c76-abe1-7b81b0063689 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Converting VIF {"id": "99328a6c-19a8-4c52-9669-c2399e6e9469", "address": "fa:16:3e:0c:f9:81", "network": {"id": "52b232a4-075e-4b10-ba25-3e80eb1a06cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-653846895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "09bb61cdc7fa4b64baf6e8ef8b1e7815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99328a6c-19", "ovs_interfaceid": "99328a6c-19a8-4c52-9669-c2399e6e9469", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 16:24:04 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-f5a28417-e92c-4c76-abe1-7b81b0063689 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:f9:81,bridge_name='br-int',has_traffic_filtering=True,id=99328a6c-19a8-4c52-9669-c2399e6e9469,network=Network(52b232a4-075e-4b10-ba25-3e80eb1a06cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99328a6c-19') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 16:24:04 user nova-compute[71229]: DEBUG os_vif [None req-f5a28417-e92c-4c76-abe1-7b81b0063689 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:f9:81,bridge_name='br-int',has_traffic_filtering=True,id=99328a6c-19a8-4c52-9669-c2399e6e9469,network=Network(52b232a4-075e-4b10-ba25-3e80eb1a06cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99328a6c-19') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 16:24:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:24:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap99328a6c-19, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 16:24:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:24:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:24:04 user nova-compute[71229]: INFO os_vif [None req-f5a28417-e92c-4c76-abe1-7b81b0063689 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:f9:81,bridge_name='br-int',has_traffic_filtering=True,id=99328a6c-19a8-4c52-9669-c2399e6e9469,network=Network(52b232a4-075e-4b10-ba25-3e80eb1a06cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99328a6c-19')
Apr 11 16:24:04 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5a28417-e92c-4c76-abe1-7b81b0063689 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 16:24:04 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a28417-e92c-4c76-abe1-7b81b0063689 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:198df94c-d822-49f7-9f58-9265596246d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYKnJQXD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 16:24:04 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-f5a28417-e92c-4c76-abe1-7b81b0063689 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 16:24:04 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-f5a28417-e92c-4c76-abe1-7b81b0063689 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 16:24:04 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-f5a28417-e92c-4c76-abe1-7b81b0063689 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 16:24:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:24:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:24:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 16:24:04 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[4e9ed341-ed2e-4520-a4bd-a6fb506ba683]: Unexpected error while running command.
Apr 11 16:24:04 user nova-compute[71229]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 11 16:24:04 user nova-compute[71229]: Exit code: 21
Apr 11 16:24:04 user nova-compute[71229]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 11 16:24:04 user nova-compute[71229]: Stderr: '' {{(pid=81310) _process_cmd /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:479}}
Apr 11 16:24:04 user nova-compute[71229]: Traceback (most recent call last):
Apr 11 16:24:04 user nova-compute[71229]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 476, in _process_cmd
Apr 11 16:24:04 user nova-compute[71229]:     ret = func(*f_args, **f_kwargs)
Apr 11 16:24:04 user nova-compute[71229]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Apr 11 16:24:04 user nova-compute[71229]:     return func(*args, **kwargs)
Apr 11 16:24:04 user nova-compute[71229]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Apr 11 16:24:04 user nova-compute[71229]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Apr 11 16:24:04 user nova-compute[71229]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Apr 11 16:24:04 user nova-compute[71229]:     return putils.execute(on_execute=on_execute,
Apr 11 16:24:04 user nova-compute[71229]:   File "/usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py", line 438, in execute
Apr 11 16:24:04 user nova-compute[71229]:     raise ProcessExecutionError(exit_code=_returncode,
Apr 11 16:24:04 user nova-compute[71229]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 11 16:24:04 user nova-compute[71229]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 11 16:24:04 user nova-compute[71229]: Exit code: 21
Apr 11 16:24:04 user nova-compute[71229]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 11 16:24:04 user nova-compute[71229]: Stderr: ''
Apr 11 16:24:04 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9ed341-ed2e-4520-a4bd-a6fb506ba683]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:24:04 user nova-compute[71229]: ERROR os_brick.initiator.connectors.iscsi [None req-f5a28417-e92c-4c76-abe1-7b81b0063689 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 11 16:24:04 user nova-compute[71229]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 11 16:24:04 user nova-compute[71229]: Exit code: 21
Apr 11 16:24:04 user nova-compute[71229]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 11 16:24:04 user nova-compute[71229]: Stderr: ''
Apr 11 16:24:04 user nova-compute[71229]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Apr 11 16:24:04 user nova-compute[71229]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 206, in _get_ips_iqns_luns
Apr 11 16:24:04 user nova-compute[71229]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Apr 11 16:24:04 user nova-compute[71229]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 365, in _get_discoverydb_portals
Apr 11 16:24:04 user nova-compute[71229]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Apr 11 16:24:04 user nova-compute[71229]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 1177, in _run_iscsiadm_bare
Apr 11 16:24:04 user nova-compute[71229]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Apr 11 16:24:04 user nova-compute[71229]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/executor.py", line 55, in _execute
Apr 11 16:24:04 user nova-compute[71229]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Apr 11 16:24:04 user nova-compute[71229]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Apr 11 16:24:04 user nova-compute[71229]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Apr 11 16:24:04 user nova-compute[71229]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Apr 11 16:24:04 user nova-compute[71229]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Apr 11 16:24:04 user nova-compute[71229]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 215, in remote_call
Apr 11 16:24:04 user nova-compute[71229]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Apr 11 16:24:04 user nova-compute[71229]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 11 16:24:04 user nova-compute[71229]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Apr 11 16:24:04 user nova-compute[71229]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Apr 11 16:24:04 user nova-compute[71229]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 11 16:24:04 user nova-compute[71229]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Apr 11 16:24:04 user nova-compute[71229]: ERROR os_brick.initiator.connectors.iscsi 
Apr 11 16:24:04 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a28417-e92c-4c76-abe1-7b81b0063689 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=71229) _cleanup_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:923}}
Apr 11 16:24:04 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-f5a28417-e92c-4c76-abe1-7b81b0063689 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.038s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 16:24:04 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a28417-e92c-4c76-abe1-7b81b0063689 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] <== disconnect_volume: return (39ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 16:24:04 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5a28417-e92c-4c76-abe1-7b81b0063689 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 16:24:04 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-f5a28417-e92c-4c76-abe1-7b81b0063689 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Deleting instance files /opt/stack/data/nova/instances/239c53cb-bad6-4da9-881f-15bbd7cc91ae_del
Apr 11 16:24:04 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-f5a28417-e92c-4c76-abe1-7b81b0063689 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Deletion of /opt/stack/data/nova/instances/239c53cb-bad6-4da9-881f-15bbd7cc91ae_del complete
Apr 11 16:24:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:24:04 user nova-compute[71229]: INFO nova.compute.manager [None req-f5a28417-e92c-4c76-abe1-7b81b0063689 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Took 0.70 seconds to destroy the instance on the hypervisor.
Apr 11 16:24:04 user nova-compute[71229]: DEBUG oslo.service.loopingcall [None req-f5a28417-e92c-4c76-abe1-7b81b0063689 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71229) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 16:24:04 user nova-compute[71229]: DEBUG nova.compute.manager [-] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Deallocating network for instance {{(pid=71229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 16:24:04 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] deallocate_for_instance() {{(pid=71229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 16:24:04 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 16:24:04 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Took 0.57 seconds to deallocate network for instance.
Apr 11 16:24:04 user nova-compute[71229]: WARNING nova.volume.cinder [None req-f5a28417-e92c-4c76-abe1-7b81b0063689 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Attachment 3bd6127e-da4e-4c0f-8179-3dfb98faa1b9 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 3bd6127e-da4e-4c0f-8179-3dfb98faa1b9. (HTTP 404) (Request-ID: req-e818bf2a-dd18-4047-85fa-1870961882d1)
Apr 11 16:24:04 user nova-compute[71229]: INFO nova.compute.manager [None req-f5a28417-e92c-4c76-abe1-7b81b0063689 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Took 0.03 seconds to detach 1 volumes for instance.
Apr 11 16:24:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f5a28417-e92c-4c76-abe1-7b81b0063689 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:24:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f5a28417-e92c-4c76-abe1-7b81b0063689 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:24:05 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-f5a28417-e92c-4c76-abe1-7b81b0063689 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 16:24:05 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-f5a28417-e92c-4c76-abe1-7b81b0063689 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 16:24:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f5a28417-e92c-4c76-abe1-7b81b0063689 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.129s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:24:05 user nova-compute[71229]: INFO nova.scheduler.client.report [None req-f5a28417-e92c-4c76-abe1-7b81b0063689 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Deleted allocations for instance 239c53cb-bad6-4da9-881f-15bbd7cc91ae
Apr 11 16:24:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-f5a28417-e92c-4c76-abe1-7b81b0063689 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "239c53cb-bad6-4da9-881f-15bbd7cc91ae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.618s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:24:05 user nova-compute[71229]: DEBUG nova.compute.manager [req-88bf4601-7572-4fbf-b1d2-e90b33295fc8 req-199def97-48fc-4f98-87d3-567e666c46cd service nova] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Received event network-vif-plugged-99328a6c-19a8-4c52-9669-c2399e6e9469 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:24:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-88bf4601-7572-4fbf-b1d2-e90b33295fc8 req-199def97-48fc-4f98-87d3-567e666c46cd service nova] Acquiring lock "239c53cb-bad6-4da9-881f-15bbd7cc91ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:24:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-88bf4601-7572-4fbf-b1d2-e90b33295fc8 req-199def97-48fc-4f98-87d3-567e666c46cd service nova] Lock "239c53cb-bad6-4da9-881f-15bbd7cc91ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:24:06 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-88bf4601-7572-4fbf-b1d2-e90b33295fc8 req-199def97-48fc-4f98-87d3-567e666c46cd service nova] Lock "239c53cb-bad6-4da9-881f-15bbd7cc91ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:24:06 user nova-compute[71229]: DEBUG nova.compute.manager [req-88bf4601-7572-4fbf-b1d2-e90b33295fc8 req-199def97-48fc-4f98-87d3-567e666c46cd service nova] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] No waiting events found dispatching network-vif-plugged-99328a6c-19a8-4c52-9669-c2399e6e9469 {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 16:24:06 user nova-compute[71229]: WARNING nova.compute.manager [req-88bf4601-7572-4fbf-b1d2-e90b33295fc8 req-199def97-48fc-4f98-87d3-567e666c46cd service nova] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Received unexpected event network-vif-plugged-99328a6c-19a8-4c52-9669-c2399e6e9469 for instance with vm_state deleted and task_state None.
Apr 11 16:24:06 user nova-compute[71229]: DEBUG nova.compute.manager [req-88bf4601-7572-4fbf-b1d2-e90b33295fc8 req-199def97-48fc-4f98-87d3-567e666c46cd service nova] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Received event network-vif-deleted-99328a6c-19a8-4c52-9669-c2399e6e9469 {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:24:09 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:24:13 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:24:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:24:19 user nova-compute[71229]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681230244.1698725, 239c53cb-bad6-4da9-881f-15bbd7cc91ae => Stopped> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 16:24:19 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] VM Stopped (Lifecycle Event)
Apr 11 16:24:19 user nova-compute[71229]: DEBUG nova.compute.manager [None req-1a132111-a189-45e5-8462-051b350095d9 None None] [instance: 239c53cb-bad6-4da9-881f-15bbd7cc91ae] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 16:24:19 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:24:24 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:24:29 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:24:34 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:24:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:24:42 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:24:42 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 16:24:44 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:24:46 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:24:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:24:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:24:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:24:46 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 16:24:47 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:24:47 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:24:47 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8926MB free_disk=25.95716094970703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 16:24:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:24:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:24:47 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 16:24:47 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 16:24:47 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 16:24:47 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 16:24:47 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 16:24:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.147s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:24:48 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:24:48 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 16:24:48 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Rebuilding the list of instances to heal {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 16:24:48 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Didn't find any instances for network info cache update. {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 16:24:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:24:52 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:24:52 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:24:54 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:24:54 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:24:54 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:24:54 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:24:54 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:24:54 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:24:54 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:24:55 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:24:55 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:24:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "ae79fdab-2a0d-4dac-bcde-ac3544aca749" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:24:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ae79fdab-2a0d-4dac-bcde-ac3544aca749" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:24:58 user nova-compute[71229]: DEBUG nova.compute.manager [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Starting instance... {{(pid=71229) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 16:24:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:24:58 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:24:58 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71229) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 16:24:58 user nova-compute[71229]: INFO nova.compute.claims [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Claim successful on node user
Apr 11 16:24:59 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 16:24:59 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 16:24:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.198s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:24:59 user nova-compute[71229]: DEBUG nova.compute.manager [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Start building networks asynchronously for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 16:24:59 user nova-compute[71229]: DEBUG nova.compute.manager [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Allocating IP information in the background. {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 16:24:59 user nova-compute[71229]: DEBUG nova.network.neutron [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] allocate_for_instance() {{(pid=71229) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 16:24:59 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 16:24:59 user nova-compute[71229]: DEBUG nova.compute.manager [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Start building block device mappings for instance. {{(pid=71229) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 16:24:59 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:24:59 user nova-compute[71229]: DEBUG nova.compute.manager [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Start spawning the instance on the hypervisor. {{(pid=71229) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 16:24:59 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Creating instance directory {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 16:24:59 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Creating image(s)
Apr 11 16:24:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "/opt/stack/data/nova/instances/ae79fdab-2a0d-4dac-bcde-ac3544aca749/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:24:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "/opt/stack/data/nova/instances/ae79fdab-2a0d-4dac-bcde-ac3544aca749/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:24:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "/opt/stack/data/nova/instances/ae79fdab-2a0d-4dac-bcde-ac3544aca749/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:24:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:24:59 user nova-compute[71229]: DEBUG nova.policy [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '341892e1cf424bc18b4b21b261659456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bb61cdc7fa4b64baf6e8ef8b1e7815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71229) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 16:24:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.141s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:24:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:24:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:24:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:24:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.139s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:24:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/ae79fdab-2a0d-4dac-bcde-ac3544aca749/disk 1073741824 {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:24:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a,backing_fmt=raw /opt/stack/data/nova/instances/ae79fdab-2a0d-4dac-bcde-ac3544aca749/disk 1073741824" returned: 0 in 0.051s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:24:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:24:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:24:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d6e8db03ef6eef45d9bacdd85a2d697cee65f3a --force-share --output=json" returned: 0 in 0.153s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:24:59 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ae79fdab-2a0d-4dac-bcde-ac3544aca749/disk. size=1073741824 {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 16:24:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae79fdab-2a0d-4dac-bcde-ac3544aca749/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:24:59 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae79fdab-2a0d-4dac-bcde-ac3544aca749/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:24:59 user nova-compute[71229]: DEBUG nova.virt.disk.api [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Cannot resize image /opt/stack/data/nova/instances/ae79fdab-2a0d-4dac-bcde-ac3544aca749/disk to a smaller size. {{(pid=71229) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 16:24:59 user nova-compute[71229]: DEBUG nova.objects.instance [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lazy-loading 'migration_context' on Instance uuid ae79fdab-2a0d-4dac-bcde-ac3544aca749 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:24:59 user nova-compute[71229]: DEBUG nova.network.neutron [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Successfully created port: 5304223b-a94f-43cc-b3cd-2f6f6b33ac7c {{(pid=71229) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 16:24:59 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Created local disks {{(pid=71229) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 16:24:59 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Ensure instance console log exists: /opt/stack/data/nova/instances/ae79fdab-2a0d-4dac-bcde-ac3544aca749/console.log {{(pid=71229) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 16:24:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:24:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:24:59 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:25:00 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:25:00 user nova-compute[71229]: DEBUG nova.network.neutron [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Successfully updated port: 5304223b-a94f-43cc-b3cd-2f6f6b33ac7c {{(pid=71229) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 16:25:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "refresh_cache-ae79fdab-2a0d-4dac-bcde-ac3544aca749" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 16:25:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquired lock "refresh_cache-ae79fdab-2a0d-4dac-bcde-ac3544aca749" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 16:25:00 user nova-compute[71229]: DEBUG nova.network.neutron [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Building network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 16:25:00 user nova-compute[71229]: DEBUG nova.compute.manager [req-b8ec0600-0c11-4b56-b08f-e6ae2a450143 req-7c8961e3-9604-4196-8874-38f403c90524 service nova] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Received event network-changed-5304223b-a94f-43cc-b3cd-2f6f6b33ac7c {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:25:00 user nova-compute[71229]: DEBUG nova.compute.manager [req-b8ec0600-0c11-4b56-b08f-e6ae2a450143 req-7c8961e3-9604-4196-8874-38f403c90524 service nova] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Refreshing instance network info cache due to event network-changed-5304223b-a94f-43cc-b3cd-2f6f6b33ac7c. {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 16:25:00 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-b8ec0600-0c11-4b56-b08f-e6ae2a450143 req-7c8961e3-9604-4196-8874-38f403c90524 service nova] Acquiring lock "refresh_cache-ae79fdab-2a0d-4dac-bcde-ac3544aca749" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 16:25:00 user nova-compute[71229]: DEBUG nova.network.neutron [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Instance cache missing network info. {{(pid=71229) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 16:25:01 user nova-compute[71229]: DEBUG nova.network.neutron [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Updating instance_info_cache with network_info: [{"id": "5304223b-a94f-43cc-b3cd-2f6f6b33ac7c", "address": "fa:16:3e:e5:a2:5e", "network": {"id": "52b232a4-075e-4b10-ba25-3e80eb1a06cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-653846895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "09bb61cdc7fa4b64baf6e8ef8b1e7815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5304223b-a9", "ovs_interfaceid": "5304223b-a94f-43cc-b3cd-2f6f6b33ac7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 16:25:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Releasing lock "refresh_cache-ae79fdab-2a0d-4dac-bcde-ac3544aca749" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 16:25:01 user nova-compute[71229]: DEBUG nova.compute.manager [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Instance network_info: |[{"id": "5304223b-a94f-43cc-b3cd-2f6f6b33ac7c", "address": "fa:16:3e:e5:a2:5e", "network": {"id": "52b232a4-075e-4b10-ba25-3e80eb1a06cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-653846895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "09bb61cdc7fa4b64baf6e8ef8b1e7815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5304223b-a9", "ovs_interfaceid": "5304223b-a94f-43cc-b3cd-2f6f6b33ac7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71229) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 16:25:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-b8ec0600-0c11-4b56-b08f-e6ae2a450143 req-7c8961e3-9604-4196-8874-38f403c90524 service nova] Acquired lock "refresh_cache-ae79fdab-2a0d-4dac-bcde-ac3544aca749" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 16:25:01 user nova-compute[71229]: DEBUG nova.network.neutron [req-b8ec0600-0c11-4b56-b08f-e6ae2a450143 req-7c8961e3-9604-4196-8874-38f403c90524 service nova] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Refreshing network info cache for port 5304223b-a94f-43cc-b3cd-2f6f6b33ac7c {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 16:25:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Start _get_guest_xml network_info=[{"id": "5304223b-a94f-43cc-b3cd-2f6f6b33ac7c", "address": "fa:16:3e:e5:a2:5e", "network": {"id": "52b232a4-075e-4b10-ba25-3e80eb1a06cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-653846895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "09bb61cdc7fa4b64baf6e8ef8b1e7815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5304223b-a9", "ovs_interfaceid": "5304223b-a94f-43cc-b3cd-2f6f6b33ac7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '52fe638c-5ada-47d5-b376-233bfa808a37'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 16:25:01 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:25:01 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:25:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71229) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 16:25:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T15:18:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T15:17:16Z,direct_url=<?>,disk_format='qcow2',id=52fe638c-5ada-47d5-b376-233bfa808a37,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='da25b23996564e4b84947ca5a81d90ad',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T15:17:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 16:25:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Flavor limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 16:25:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Image limits 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 16:25:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Flavor pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 16:25:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Image pref 0:0:0 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 16:25:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 16:25:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 16:25:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 16:25:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Got 1 possible topologies {{(pid=71229) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 16:25:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 16:25:01 user nova-compute[71229]: DEBUG nova.virt.hardware [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71229) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 16:25:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T16:24:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2045943056',display_name='tempest-VolumesSnapshotTestJSON-instance-2045943056',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2045943056',id=47,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09bb61cdc7fa4b64baf6e8ef8b1e7815',ramdisk_id='',reservation_id='r-ppky32ol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1487607345',owner_user_name='tempest-VolumesSnapshotTestJSON-1487607345-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T16:24:59Z,user_data=None,user_id='341892e1cf424bc18b4b21b261659456',uuid=ae79fdab-2a0d-4dac-bcde-ac3544aca749,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5304223b-a94f-43cc-b3cd-2f6f6b33ac7c", "address": "fa:16:3e:e5:a2:5e", "network": {"id": "52b232a4-075e-4b10-ba25-3e80eb1a06cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-653846895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "09bb61cdc7fa4b64baf6e8ef8b1e7815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5304223b-a9", "ovs_interfaceid": "5304223b-a94f-43cc-b3cd-2f6f6b33ac7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71229) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 16:25:01 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Converting VIF {"id": "5304223b-a94f-43cc-b3cd-2f6f6b33ac7c", "address": "fa:16:3e:e5:a2:5e", "network": {"id": "52b232a4-075e-4b10-ba25-3e80eb1a06cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-653846895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "09bb61cdc7fa4b64baf6e8ef8b1e7815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5304223b-a9", "ovs_interfaceid": "5304223b-a94f-43cc-b3cd-2f6f6b33ac7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 16:25:01 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:a2:5e,bridge_name='br-int',has_traffic_filtering=True,id=5304223b-a94f-43cc-b3cd-2f6f6b33ac7c,network=Network(52b232a4-075e-4b10-ba25-3e80eb1a06cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5304223b-a9') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 16:25:01 user nova-compute[71229]: DEBUG nova.objects.instance [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lazy-loading 'pci_devices' on Instance uuid ae79fdab-2a0d-4dac-bcde-ac3544aca749 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:25:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] End _get_guest_xml xml=<domain type="kvm">
Apr 11 16:25:01 user nova-compute[71229]:   <uuid>ae79fdab-2a0d-4dac-bcde-ac3544aca749</uuid>
Apr 11 16:25:01 user nova-compute[71229]:   <name>instance-0000002f</name>
Apr 11 16:25:01 user nova-compute[71229]:   <memory>131072</memory>
Apr 11 16:25:01 user nova-compute[71229]:   <vcpu>1</vcpu>
Apr 11 16:25:01 user nova-compute[71229]:   <metadata>
Apr 11 16:25:01 user nova-compute[71229]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 16:25:01 user nova-compute[71229]:       <nova:package version="0.0.0"/>
Apr 11 16:25:01 user nova-compute[71229]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-2045943056</nova:name>
Apr 11 16:25:01 user nova-compute[71229]:       <nova:creationTime>2023-04-11 16:25:01</nova:creationTime>
Apr 11 16:25:01 user nova-compute[71229]:       <nova:flavor name="m1.nano">
Apr 11 16:25:01 user nova-compute[71229]:         <nova:memory>128</nova:memory>
Apr 11 16:25:01 user nova-compute[71229]:         <nova:disk>1</nova:disk>
Apr 11 16:25:01 user nova-compute[71229]:         <nova:swap>0</nova:swap>
Apr 11 16:25:01 user nova-compute[71229]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 16:25:01 user nova-compute[71229]:         <nova:vcpus>1</nova:vcpus>
Apr 11 16:25:01 user nova-compute[71229]:       </nova:flavor>
Apr 11 16:25:01 user nova-compute[71229]:       <nova:owner>
Apr 11 16:25:01 user nova-compute[71229]:         <nova:user uuid="341892e1cf424bc18b4b21b261659456">tempest-VolumesSnapshotTestJSON-1487607345-project-member</nova:user>
Apr 11 16:25:01 user nova-compute[71229]:         <nova:project uuid="09bb61cdc7fa4b64baf6e8ef8b1e7815">tempest-VolumesSnapshotTestJSON-1487607345</nova:project>
Apr 11 16:25:01 user nova-compute[71229]:       </nova:owner>
Apr 11 16:25:01 user nova-compute[71229]:       <nova:root type="image" uuid="52fe638c-5ada-47d5-b376-233bfa808a37"/>
Apr 11 16:25:01 user nova-compute[71229]:       <nova:ports>
Apr 11 16:25:01 user nova-compute[71229]:         <nova:port uuid="5304223b-a94f-43cc-b3cd-2f6f6b33ac7c">
Apr 11 16:25:01 user nova-compute[71229]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 11 16:25:01 user nova-compute[71229]:         </nova:port>
Apr 11 16:25:01 user nova-compute[71229]:       </nova:ports>
Apr 11 16:25:01 user nova-compute[71229]:     </nova:instance>
Apr 11 16:25:01 user nova-compute[71229]:   </metadata>
Apr 11 16:25:01 user nova-compute[71229]:   <sysinfo type="smbios">
Apr 11 16:25:01 user nova-compute[71229]:     <system>
Apr 11 16:25:01 user nova-compute[71229]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 16:25:01 user nova-compute[71229]:       <entry name="product">OpenStack Nova</entry>
Apr 11 16:25:01 user nova-compute[71229]:       <entry name="version">0.0.0</entry>
Apr 11 16:25:01 user nova-compute[71229]:       <entry name="serial">ae79fdab-2a0d-4dac-bcde-ac3544aca749</entry>
Apr 11 16:25:01 user nova-compute[71229]:       <entry name="uuid">ae79fdab-2a0d-4dac-bcde-ac3544aca749</entry>
Apr 11 16:25:01 user nova-compute[71229]:       <entry name="family">Virtual Machine</entry>
Apr 11 16:25:01 user nova-compute[71229]:     </system>
Apr 11 16:25:01 user nova-compute[71229]:   </sysinfo>
Apr 11 16:25:01 user nova-compute[71229]:   <os>
Apr 11 16:25:01 user nova-compute[71229]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 16:25:01 user nova-compute[71229]:     <boot dev="hd"/>
Apr 11 16:25:01 user nova-compute[71229]:     <smbios mode="sysinfo"/>
Apr 11 16:25:01 user nova-compute[71229]:   </os>
Apr 11 16:25:01 user nova-compute[71229]:   <features>
Apr 11 16:25:01 user nova-compute[71229]:     <acpi/>
Apr 11 16:25:01 user nova-compute[71229]:     <apic/>
Apr 11 16:25:01 user nova-compute[71229]:     <vmcoreinfo/>
Apr 11 16:25:01 user nova-compute[71229]:   </features>
Apr 11 16:25:01 user nova-compute[71229]:   <clock offset="utc">
Apr 11 16:25:01 user nova-compute[71229]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 16:25:01 user nova-compute[71229]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 16:25:01 user nova-compute[71229]:     <timer name="hpet" present="no"/>
Apr 11 16:25:01 user nova-compute[71229]:   </clock>
Apr 11 16:25:01 user nova-compute[71229]:   <cpu mode="custom" match="exact">
Apr 11 16:25:01 user nova-compute[71229]:     <model>Nehalem</model>
Apr 11 16:25:01 user nova-compute[71229]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 16:25:01 user nova-compute[71229]:   </cpu>
Apr 11 16:25:01 user nova-compute[71229]:   <devices>
Apr 11 16:25:01 user nova-compute[71229]:     <disk type="file" device="disk">
Apr 11 16:25:01 user nova-compute[71229]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 16:25:01 user nova-compute[71229]:       <source file="/opt/stack/data/nova/instances/ae79fdab-2a0d-4dac-bcde-ac3544aca749/disk"/>
Apr 11 16:25:01 user nova-compute[71229]:       <target dev="vda" bus="virtio"/>
Apr 11 16:25:01 user nova-compute[71229]:     </disk>
Apr 11 16:25:01 user nova-compute[71229]:     <interface type="ethernet">
Apr 11 16:25:01 user nova-compute[71229]:       <mac address="fa:16:3e:e5:a2:5e"/>
Apr 11 16:25:01 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 16:25:01 user nova-compute[71229]:       <mtu size="1442"/>
Apr 11 16:25:01 user nova-compute[71229]:       <target dev="tap5304223b-a9"/>
Apr 11 16:25:01 user nova-compute[71229]:     </interface>
Apr 11 16:25:01 user nova-compute[71229]:     <serial type="pty">
Apr 11 16:25:01 user nova-compute[71229]:       <log file="/opt/stack/data/nova/instances/ae79fdab-2a0d-4dac-bcde-ac3544aca749/console.log" append="off"/>
Apr 11 16:25:01 user nova-compute[71229]:     </serial>
Apr 11 16:25:01 user nova-compute[71229]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 16:25:01 user nova-compute[71229]:     <video>
Apr 11 16:25:01 user nova-compute[71229]:       <model type="virtio"/>
Apr 11 16:25:01 user nova-compute[71229]:     </video>
Apr 11 16:25:01 user nova-compute[71229]:     <rng model="virtio">
Apr 11 16:25:01 user nova-compute[71229]:       <backend model="random">/dev/urandom</backend>
Apr 11 16:25:01 user nova-compute[71229]:     </rng>
Apr 11 16:25:01 user nova-compute[71229]:     <controller type="usb" index="0" model="none"/>
Apr 11 16:25:01 user nova-compute[71229]:     <memballoon model="virtio">
Apr 11 16:25:01 user nova-compute[71229]:       <stats period="10"/>
Apr 11 16:25:01 user nova-compute[71229]:     </memballoon>
Apr 11 16:25:01 user nova-compute[71229]:   </devices>
Apr 11 16:25:01 user nova-compute[71229]: </domain>
Apr 11 16:25:01 user nova-compute[71229]:  {{(pid=71229) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 16:25:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T16:24:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2045943056',display_name='tempest-VolumesSnapshotTestJSON-instance-2045943056',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2045943056',id=47,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09bb61cdc7fa4b64baf6e8ef8b1e7815',ramdisk_id='',reservation_id='r-ppky32ol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1487607345',owner_user_name='tempest-VolumesSnapshotTestJSON-1487607345-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T16:24:59Z,user_data=None,user_id='341892e1cf424bc18b4b21b261659456',uuid=ae79fdab-2a0d-4dac-bcde-ac3544aca749,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5304223b-a94f-43cc-b3cd-2f6f6b33ac7c", "address": "fa:16:3e:e5:a2:5e", "network": {"id": "52b232a4-075e-4b10-ba25-3e80eb1a06cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-653846895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "09bb61cdc7fa4b64baf6e8ef8b1e7815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5304223b-a9", "ovs_interfaceid": "5304223b-a94f-43cc-b3cd-2f6f6b33ac7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 16:25:01 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Converting VIF {"id": "5304223b-a94f-43cc-b3cd-2f6f6b33ac7c", "address": "fa:16:3e:e5:a2:5e", "network": {"id": "52b232a4-075e-4b10-ba25-3e80eb1a06cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-653846895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "09bb61cdc7fa4b64baf6e8ef8b1e7815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5304223b-a9", "ovs_interfaceid": "5304223b-a94f-43cc-b3cd-2f6f6b33ac7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 16:25:01 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:a2:5e,bridge_name='br-int',has_traffic_filtering=True,id=5304223b-a94f-43cc-b3cd-2f6f6b33ac7c,network=Network(52b232a4-075e-4b10-ba25-3e80eb1a06cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5304223b-a9') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 16:25:01 user nova-compute[71229]: DEBUG os_vif [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:a2:5e,bridge_name='br-int',has_traffic_filtering=True,id=5304223b-a94f-43cc-b3cd-2f6f6b33ac7c,network=Network(52b232a4-075e-4b10-ba25-3e80eb1a06cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5304223b-a9') {{(pid=71229) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 16:25:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:25:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 16:25:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 16:25:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:25:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5304223b-a9, may_exist=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 16:25:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5304223b-a9, col_values=(('external_ids', {'iface-id': '5304223b-a94f-43cc-b3cd-2f6f6b33ac7c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:a2:5e', 'vm-uuid': 'ae79fdab-2a0d-4dac-bcde-ac3544aca749'}),)) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 16:25:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:25:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:25:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:25:01 user nova-compute[71229]: INFO os_vif [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:a2:5e,bridge_name='br-int',has_traffic_filtering=True,id=5304223b-a94f-43cc-b3cd-2f6f6b33ac7c,network=Network(52b232a4-075e-4b10-ba25-3e80eb1a06cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5304223b-a9')
Apr 11 16:25:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 16:25:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] No VIF found with MAC fa:16:3e:e5:a2:5e, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 16:25:02 user nova-compute[71229]: DEBUG nova.network.neutron [req-b8ec0600-0c11-4b56-b08f-e6ae2a450143 req-7c8961e3-9604-4196-8874-38f403c90524 service nova] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Updated VIF entry in instance network info cache for port 5304223b-a94f-43cc-b3cd-2f6f6b33ac7c. {{(pid=71229) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 16:25:02 user nova-compute[71229]: DEBUG nova.network.neutron [req-b8ec0600-0c11-4b56-b08f-e6ae2a450143 req-7c8961e3-9604-4196-8874-38f403c90524 service nova] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Updating instance_info_cache with network_info: [{"id": "5304223b-a94f-43cc-b3cd-2f6f6b33ac7c", "address": "fa:16:3e:e5:a2:5e", "network": {"id": "52b232a4-075e-4b10-ba25-3e80eb1a06cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-653846895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "09bb61cdc7fa4b64baf6e8ef8b1e7815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5304223b-a9", "ovs_interfaceid": "5304223b-a94f-43cc-b3cd-2f6f6b33ac7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 16:25:02 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-b8ec0600-0c11-4b56-b08f-e6ae2a450143 req-7c8961e3-9604-4196-8874-38f403c90524 service nova] Releasing lock "refresh_cache-ae79fdab-2a0d-4dac-bcde-ac3544aca749" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 16:25:03 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:25:03 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:25:03 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:25:03 user nova-compute[71229]: DEBUG nova.compute.manager [req-3d45063e-fb73-4707-aff3-bb25d19664bd req-65426946-4e6e-46d9-b7bd-9685d7eed92a service nova] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Received event network-vif-plugged-5304223b-a94f-43cc-b3cd-2f6f6b33ac7c {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:25:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3d45063e-fb73-4707-aff3-bb25d19664bd req-65426946-4e6e-46d9-b7bd-9685d7eed92a service nova] Acquiring lock "ae79fdab-2a0d-4dac-bcde-ac3544aca749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:25:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3d45063e-fb73-4707-aff3-bb25d19664bd req-65426946-4e6e-46d9-b7bd-9685d7eed92a service nova] Lock "ae79fdab-2a0d-4dac-bcde-ac3544aca749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:25:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-3d45063e-fb73-4707-aff3-bb25d19664bd req-65426946-4e6e-46d9-b7bd-9685d7eed92a service nova] Lock "ae79fdab-2a0d-4dac-bcde-ac3544aca749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:25:03 user nova-compute[71229]: DEBUG nova.compute.manager [req-3d45063e-fb73-4707-aff3-bb25d19664bd req-65426946-4e6e-46d9-b7bd-9685d7eed92a service nova] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] No waiting events found dispatching network-vif-plugged-5304223b-a94f-43cc-b3cd-2f6f6b33ac7c {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 16:25:03 user nova-compute[71229]: WARNING nova.compute.manager [req-3d45063e-fb73-4707-aff3-bb25d19664bd req-65426946-4e6e-46d9-b7bd-9685d7eed92a service nova] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Received unexpected event network-vif-plugged-5304223b-a94f-43cc-b3cd-2f6f6b33ac7c for instance with vm_state building and task_state spawning.
Apr 11 16:25:03 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:25:05 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681230305.097651, ae79fdab-2a0d-4dac-bcde-ac3544aca749 => Resumed> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 16:25:05 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] VM Resumed (Lifecycle Event)
Apr 11 16:25:05 user nova-compute[71229]: DEBUG nova.compute.manager [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Instance event wait completed in 0 seconds for  {{(pid=71229) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 16:25:05 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Guest created on hypervisor {{(pid=71229) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 16:25:05 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Instance spawned successfully.
Apr 11 16:25:05 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 16:25:05 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 16:25:05 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 16:25:05 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Found default for hw_cdrom_bus of ide {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 16:25:05 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Found default for hw_disk_bus of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 16:25:05 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Found default for hw_input_bus of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 16:25:05 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Found default for hw_pointer_model of None {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 16:25:05 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Found default for hw_video_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 16:25:05 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Found default for hw_vif_model of virtio {{(pid=71229) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 16:25:05 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 16:25:05 user nova-compute[71229]: DEBUG nova.virt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Emitting event <LifecycleEvent: 1681230305.1040995, ae79fdab-2a0d-4dac-bcde-ac3544aca749 => Started> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 16:25:05 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] VM Started (Lifecycle Event)
Apr 11 16:25:05 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 16:25:05 user nova-compute[71229]: DEBUG nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71229) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 16:25:05 user nova-compute[71229]: INFO nova.compute.manager [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 16:25:05 user nova-compute[71229]: INFO nova.compute.manager [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Took 5.92 seconds to spawn the instance on the hypervisor.
Apr 11 16:25:05 user nova-compute[71229]: DEBUG nova.compute.manager [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 16:25:05 user nova-compute[71229]: INFO nova.compute.manager [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Took 6.42 seconds to build instance.
Apr 11 16:25:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-5048db60-1d02-4b0a-8386-880142a884a8 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ae79fdab-2a0d-4dac-bcde-ac3544aca749" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.527s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:25:05 user nova-compute[71229]: DEBUG nova.compute.manager [req-f6af84af-16c5-4398-8fe6-46eea7641e1e req-74313cd5-52b5-4bf6-8c02-c95d40c282c9 service nova] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Received event network-vif-plugged-5304223b-a94f-43cc-b3cd-2f6f6b33ac7c {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:25:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-f6af84af-16c5-4398-8fe6-46eea7641e1e req-74313cd5-52b5-4bf6-8c02-c95d40c282c9 service nova] Acquiring lock "ae79fdab-2a0d-4dac-bcde-ac3544aca749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:25:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-f6af84af-16c5-4398-8fe6-46eea7641e1e req-74313cd5-52b5-4bf6-8c02-c95d40c282c9 service nova] Lock "ae79fdab-2a0d-4dac-bcde-ac3544aca749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:25:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-f6af84af-16c5-4398-8fe6-46eea7641e1e req-74313cd5-52b5-4bf6-8c02-c95d40c282c9 service nova] Lock "ae79fdab-2a0d-4dac-bcde-ac3544aca749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:25:05 user nova-compute[71229]: DEBUG nova.compute.manager [req-f6af84af-16c5-4398-8fe6-46eea7641e1e req-74313cd5-52b5-4bf6-8c02-c95d40c282c9 service nova] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] No waiting events found dispatching network-vif-plugged-5304223b-a94f-43cc-b3cd-2f6f6b33ac7c {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 16:25:05 user nova-compute[71229]: WARNING nova.compute.manager [req-f6af84af-16c5-4398-8fe6-46eea7641e1e req-74313cd5-52b5-4bf6-8c02-c95d40c282c9 service nova] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Received unexpected event network-vif-plugged-5304223b-a94f-43cc-b3cd-2f6f6b33ac7c for instance with vm_state active and task_state None.
Apr 11 16:25:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:25:07 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:25:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:25:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:25:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:25:21 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:25:22 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:25:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:25:27 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:25:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:25:32 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:25:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:25:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:25:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:25:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:25:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:25:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:25:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:25:44 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:25:44 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 16:25:46 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:25:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:25:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:25:46 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:25:46 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 16:25:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:25:46 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae79fdab-2a0d-4dac-bcde-ac3544aca749/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:25:46 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae79fdab-2a0d-4dac-bcde-ac3544aca749/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:25:46 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae79fdab-2a0d-4dac-bcde-ac3544aca749/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:25:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae79fdab-2a0d-4dac-bcde-ac3544aca749/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:25:47 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:25:47 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:25:47 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8818MB free_disk=25.92901611328125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 16:25:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:25:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:25:47 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance ae79fdab-2a0d-4dac-bcde-ac3544aca749 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 16:25:47 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 16:25:47 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 16:25:47 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 16:25:47 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 16:25:47 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 16:25:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.240s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:25:49 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:25:49 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 16:25:49 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Rebuilding the list of instances to heal {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 16:25:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "refresh_cache-ae79fdab-2a0d-4dac-bcde-ac3544aca749" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 16:25:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquired lock "refresh_cache-ae79fdab-2a0d-4dac-bcde-ac3544aca749" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 16:25:49 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Forcefully refreshing network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 16:25:49 user nova-compute[71229]: DEBUG nova.objects.instance [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lazy-loading 'info_cache' on Instance uuid ae79fdab-2a0d-4dac-bcde-ac3544aca749 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:25:50 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Updating instance_info_cache with network_info: [{"id": "5304223b-a94f-43cc-b3cd-2f6f6b33ac7c", "address": "fa:16:3e:e5:a2:5e", "network": {"id": "52b232a4-075e-4b10-ba25-3e80eb1a06cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-653846895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "09bb61cdc7fa4b64baf6e8ef8b1e7815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5304223b-a9", "ovs_interfaceid": "5304223b-a94f-43cc-b3cd-2f6f6b33ac7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 16:25:50 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Releasing lock "refresh_cache-ae79fdab-2a0d-4dac-bcde-ac3544aca749" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 16:25:50 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Updated the network info_cache for instance {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 16:25:51 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:25:52 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:25:54 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:25:54 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:25:54 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:25:56 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:25:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:25:57 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:26:01 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:26:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:26:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:26:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:26:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:26:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:26:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:26:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:26:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:26:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:26:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:26:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:26:06 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:26:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:26:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:26:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:26:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:26:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:26:11 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:26:14 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:26:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:26:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:26:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:26:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:26:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:26:16 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:26:17 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:26:21 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:26:26 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:26:27 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:26:31 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:26:36 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:26:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:26:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:26:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:26:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:26:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:26:41 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:26:45 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:26:45 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 16:26:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:26:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:26:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:26:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:26:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:26:46 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:26:47 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:26:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:26:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:26:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:26:47 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 16:26:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae79fdab-2a0d-4dac-bcde-ac3544aca749/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:26:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae79fdab-2a0d-4dac-bcde-ac3544aca749/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:26:47 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae79fdab-2a0d-4dac-bcde-ac3544aca749/disk --force-share --output=json {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:26:48 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae79fdab-2a0d-4dac-bcde-ac3544aca749/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:26:48 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:26:48 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:26:48 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8837MB free_disk=25.92844009399414GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 16:26:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:26:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:26:48 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Instance ae79fdab-2a0d-4dac-bcde-ac3544aca749 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71229) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 16:26:48 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 16:26:48 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 16:26:48 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 16:26:48 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 16:26:48 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 16:26:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.183s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:26:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "ae79fdab-2a0d-4dac-bcde-ac3544aca749" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:26:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ae79fdab-2a0d-4dac-bcde-ac3544aca749" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:26:48 user nova-compute[71229]: DEBUG nova.objects.instance [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lazy-loading 'flavor' on Instance uuid ae79fdab-2a0d-4dac-bcde-ac3544aca749 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:26:48 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Ignoring supplied device name: /dev/vdb
Apr 11 16:26:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ae79fdab-2a0d-4dac-bcde-ac3544aca749" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:26:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "ae79fdab-2a0d-4dac-bcde-ac3544aca749" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:26:49 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ae79fdab-2a0d-4dac-bcde-ac3544aca749" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:26:49 user nova-compute[71229]: INFO nova.compute.manager [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Attaching volume 209c684f-2d87-48d9-8910-ccb78895b9db to /dev/vdb
Apr 11 16:26:49 user nova-compute[71229]: DEBUG os_brick.utils [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 16:26:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:26:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:26:49 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[70fe3c73-206a-4d44-bc4b-f71abc8c9d5e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d55e24a97c90\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:26:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:26:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:26:49 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fe027a-98af-41ba-8938-5196d676bb0e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:26:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:26:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:26:49 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b41c46-1743-46c3-b926-6ed223d27226]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:26:49 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2cc4c9-be97-4307-9a2a-bad866d42186]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:26:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Running cmd (subprocess): nvme version {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:26:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] 'nvme version' failed. Not Retrying. {{(pid=71229) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 16:26:49 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] nvme not present on system {{(pid=71229) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 16:26:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:26:49 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 16:26:49 user nova-compute[71229]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 16:26:49 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5127b30-bc01-428c-8dfa-ce147e2bfede]: (4, '') {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:26:49 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71229) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 16:26:49 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 16:26:49 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.lightos [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] LIGHTOS: no hostnqn found. {{(pid=71229) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 16:26:49 user nova-compute[71229]: DEBUG os_brick.utils [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d55e24a97c90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 16:26:49 user nova-compute[71229]: DEBUG nova.virt.block_device [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Updating existing volume attachment record: e075ff15-866e-4e41-9f10-5b938da8e1e0 {{(pid=71229) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 16:26:50 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:26:50 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 16:26:50 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Rebuilding the list of instances to heal {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 16:26:50 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "refresh_cache-ae79fdab-2a0d-4dac-bcde-ac3544aca749" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 16:26:50 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquired lock "refresh_cache-ae79fdab-2a0d-4dac-bcde-ac3544aca749" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 16:26:50 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Forcefully refreshing network info cache for instance {{(pid=71229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 16:26:50 user nova-compute[71229]: DEBUG nova.objects.instance [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lazy-loading 'info_cache' on Instance uuid ae79fdab-2a0d-4dac-bcde-ac3544aca749 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:26:51 user nova-compute[71229]: DEBUG nova.network.neutron [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Updating instance_info_cache with network_info: [{"id": "5304223b-a94f-43cc-b3cd-2f6f6b33ac7c", "address": "fa:16:3e:e5:a2:5e", "network": {"id": "52b232a4-075e-4b10-ba25-3e80eb1a06cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-653846895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "09bb61cdc7fa4b64baf6e8ef8b1e7815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5304223b-a9", "ovs_interfaceid": "5304223b-a94f-43cc-b3cd-2f6f6b33ac7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 16:26:51 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Releasing lock "refresh_cache-ae79fdab-2a0d-4dac-bcde-ac3544aca749" {{(pid=71229) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 16:26:51 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Updated the network info_cache for instance {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 16:26:51 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Calling os-brick to attach iSCSI Volume {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:209c684f-2d87-48d9-8910-ccb78895b9db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rognusiK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 16:26:53 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 16:26:53 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 16:26:53 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 16:26:53 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:209c684f-2d87-48d9-8910-ccb78895b9db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:209c684f-2d87-48d9-8910-ccb78895b9db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 16:26:53 user nova-compute[71229]: INFO os_brick.initiator.connectors.iscsi [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 16:26:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:209c684f-2d87-48d9-8910-ccb78895b9db -p 172.16.0.220:3260 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:209c684f-2d87-48d9-8910-ccb78895b9db -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4950ff50-a825-4636-91eb-233192942208]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 16:26:53 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:209c684f-2d87-48d9-8910-ccb78895b9db -p 172.16.0.220:3260 --interface default --op new {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:209c684f-2d87-48d9-8910-ccb78895b9db -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[64533147-62bb-4262-b00e-eea2b578b010]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:209c684f-2d87-48d9-8910-ccb78895b9db] added\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:209c684f-2d87-48d9-8910-ccb78895b9db] added
Apr 11 16:26:53 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:209c684f-2d87-48d9-8910-ccb78895b9db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:209c684f-2d87-48d9-8910-ccb78895b9db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4481a83-fb38-41dc-a0bf-e61429f145de]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:209c684f-2d87-48d9-8910-ccb78895b9db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:209c684f-2d87-48d9-8910-ccb78895b9db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6dbff11-fd8e-42a2-aaea-331fc0b0c26c]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:209c684f-2d87-48d9-8910-ccb78895b9db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rognusiK {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:209c684f-2d87-48d9-8910-ccb78895b9db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rognusiK" returned: 0 in 0.019s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af9c7c7-9b56-4cfc-a5e8-50cfba85bfb5]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rognusiK'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:209c684f-2d87-48d9-8910-ccb78895b9db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:209c684f-2d87-48d9-8910-ccb78895b9db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81b0417-2a0a-4c26-afcb-9fd0b00f1735]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[086ca863-0287-41fa-b19e-673a9e0ae599]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 11 16:26:53 user nova-compute[71229]:  {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 11 16:26:53 user nova-compute[71229]:  {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 16:26:53 user nova-compute[71229]: WARNING os_brick.initiator.connectors.iscsi [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 11 16:26:53 user nova-compute[71229]: 
Apr 11 16:26:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:209c684f-2d87-48d9-8910-ccb78895b9db -p 172.16.0.220:3260 --login {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:209c684f-2d87-48d9-8910-ccb78895b9db -p 172.16.0.220:3260 --login" returned: 0 in 0.041s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f89d519-2f34-4682-886f-fda4dd78616a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:209c684f-2d87-48d9-8910-ccb78895b9db, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:209c684f-2d87-48d9-8910-ccb78895b9db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:209c684f-2d87-48d9-8910-ccb78895b9db, portal: 172.16.0.220,3260]
Apr 11 16:26:53 user nova-compute[71229]: Login to [iface: default, target: iqn.2010-10.org.openstack:209c684f-2d87-48d9-8910-ccb78895b9db, portal: 172.16.0.220,3260] successful.
Apr 11 16:26:53 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:209c684f-2d87-48d9-8910-ccb78895b9db -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:209c684f-2d87-48d9-8910-ccb78895b9db -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a624eae-6b2e-475e-b3c9-6325d8ebff38]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6ffd90-bcf2-4d84-811e-d31bd607d840]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209c684f-2d87-48d9-8910-ccb78895b9db (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209c684f-2d87-48d9-8910-ccb78895b9db (non-flash)
Apr 11 16:26:53 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209c684f-2d87-48d9-8910-ccb78895b9db (non-flash)
Apr 11 16:26:53 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:209c684f-2d87-48d9-8910-ccb78895b9db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Connected to 172.16.0.220:3260 {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=71229) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71229) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ef0add-8591-4d89-96cd-ea44d1779cdb]: (4, ('- - 0', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71229) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 16:26:53 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:209c684f-2d87-48d9-8910-ccb78895b9db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rognusiK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71229) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 16:26:54 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 16:26:54 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '23933303333663530', 'path': '/dev/sdb'} {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 16:26:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933303333663530', 'path': '/dev/sdb'} {{(pid=71229) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 16:26:54 user nova-compute[71229]: DEBUG nova.objects.instance [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lazy-loading 'flavor' on Instance uuid ae79fdab-2a0d-4dac-bcde-ac3544aca749 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:26:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 16:26:54 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 16:26:54 user nova-compute[71229]:   <source dev="/dev/sdb"/>
Apr 11 16:26:54 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 16:26:54 user nova-compute[71229]:   <serial>209c684f-2d87-48d9-8910-ccb78895b9db</serial>
Apr 11 16:26:54 user nova-compute[71229]: </disk>
Apr 11 16:26:54 user nova-compute[71229]:  {{(pid=71229) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 16:26:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] No BDM found with device name vda, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 16:26:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71229) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 16:26:54 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] No VIF found with MAC fa:16:3e:e5:a2:5e, not building metadata {{(pid=71229) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 16:26:55 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-dcd5a6e2-ed9c-4092-bb9a-7224bff4a4f9 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ae79fdab-2a0d-4dac-bcde-ac3544aca749" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 5.993s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:26:55 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:26:55 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:26:55 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:26:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:26:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:26:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71229) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 16:26:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:26:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:26:56 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71229) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 16:26:57 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:26:59 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:27:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-99a04733-19fb-4c45-88c1-2530787d5d20 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "ae79fdab-2a0d-4dac-bcde-ac3544aca749" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:27:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-99a04733-19fb-4c45-88c1-2530787d5d20 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ae79fdab-2a0d-4dac-bcde-ac3544aca749" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:27:01 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:27:01 user nova-compute[71229]: INFO nova.compute.manager [None req-99a04733-19fb-4c45-88c1-2530787d5d20 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Detaching volume 209c684f-2d87-48d9-8910-ccb78895b9db
Apr 11 16:27:01 user nova-compute[71229]: INFO nova.virt.block_device [None req-99a04733-19fb-4c45-88c1-2530787d5d20 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Attempting to driver detach volume 209c684f-2d87-48d9-8910-ccb78895b9db from mountpoint /dev/vdb
Apr 11 16:27:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-99a04733-19fb-4c45-88c1-2530787d5d20 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Attempting to detach device vdb from instance ae79fdab-2a0d-4dac-bcde-ac3544aca749 from the persistent domain config. {{(pid=71229) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 16:27:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-99a04733-19fb-4c45-88c1-2530787d5d20 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 16:27:01 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 16:27:01 user nova-compute[71229]:   <source dev="/dev/sdb"/>
Apr 11 16:27:01 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 16:27:01 user nova-compute[71229]:   <serial>209c684f-2d87-48d9-8910-ccb78895b9db</serial>
Apr 11 16:27:01 user nova-compute[71229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 16:27:01 user nova-compute[71229]: </disk>
Apr 11 16:27:01 user nova-compute[71229]:  {{(pid=71229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 16:27:01 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-99a04733-19fb-4c45-88c1-2530787d5d20 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Successfully detached device vdb from instance ae79fdab-2a0d-4dac-bcde-ac3544aca749 from the persistent domain config.
Apr 11 16:27:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-99a04733-19fb-4c45-88c1-2530787d5d20 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ae79fdab-2a0d-4dac-bcde-ac3544aca749 from the live domain config. {{(pid=71229) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 16:27:01 user nova-compute[71229]: DEBUG nova.virt.libvirt.guest [None req-99a04733-19fb-4c45-88c1-2530787d5d20 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 16:27:01 user nova-compute[71229]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 16:27:01 user nova-compute[71229]:   <source dev="/dev/sdb"/>
Apr 11 16:27:01 user nova-compute[71229]:   <target dev="vdb" bus="virtio"/>
Apr 11 16:27:01 user nova-compute[71229]:   <serial>209c684f-2d87-48d9-8910-ccb78895b9db</serial>
Apr 11 16:27:01 user nova-compute[71229]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 16:27:01 user nova-compute[71229]: </disk>
Apr 11 16:27:01 user nova-compute[71229]:  {{(pid=71229) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 16:27:01 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-938962ab-702c-41c8-b6a7-8ff402f16836 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "ae79fdab-2a0d-4dac-bcde-ac3544aca749" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-a7659292-fe0d-49b2-95ef-f78e11962c49 None None] Received event <DeviceRemovedEvent: 1681230422.2870498, ae79fdab-2a0d-4dac-bcde-ac3544aca749 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71229) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG nova.virt.libvirt.driver [None req-99a04733-19fb-4c45-88c1-2530787d5d20 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ae79fdab-2a0d-4dac-bcde-ac3544aca749 {{(pid=71229) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 16:27:02 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-99a04733-19fb-4c45-88c1-2530787d5d20 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Successfully detached device vdb from instance ae79fdab-2a0d-4dac-bcde-ac3544aca749 from the live domain config.
Apr 11 16:27:02 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99a04733-19fb-4c45-88c1-2530787d5d20 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a04733-19fb-4c45-88c1-2530787d5d20 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:209c684f-2d87-48d9-8910-ccb78895b9db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rognusiK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 16:27:02 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-99a04733-19fb-4c45-88c1-2530787d5d20 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 16:27:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-99a04733-19fb-4c45-88c1-2530787d5d20 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-99a04733-19fb-4c45-88c1-2530787d5d20 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ad02e6-7dc5-47b7-886b-1e45de20ba0f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:209c684f-2d87-48d9-8910-ccb78895b9db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a04733-19fb-4c45-88c1-2530787d5d20 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 16:27:02 user nova-compute[71229]: No targets found.
Apr 11 16:27:02 user nova-compute[71229]: iSNS:
Apr 11 16:27:02 user nova-compute[71229]: No targets found.
Apr 11 16:27:02 user nova-compute[71229]: STATIC:
Apr 11 16:27:02 user nova-compute[71229]: Target: iqn.2010-10.org.openstack:209c684f-2d87-48d9-8910-ccb78895b9db
Apr 11 16:27:02 user nova-compute[71229]:         Portal: 172.16.0.220:3260,-1
Apr 11 16:27:02 user nova-compute[71229]:                 Iface Name: default
Apr 11 16:27:02 user nova-compute[71229]: FIRMWARE:
Apr 11 16:27:02 user nova-compute[71229]: No targets found.
Apr 11 16:27:02 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a04733-19fb-4c45-88c1-2530787d5d20 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 16:27:02 user nova-compute[71229]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 16:27:02 user nova-compute[71229]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71229) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a04733-19fb-4c45-88c1-2530787d5d20 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:209c684f-2d87-48d9-8910-ccb78895b9db', 0)] {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57b3d9b-d2d9-4485-8e7a-607ebf454f15]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:209c684f-2d87-48d9-8910-ccb78895b9db\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4591fa-cd42-45c7-97ec-96553b081c82]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209c684f-2d87-48d9-8910-ccb78895b9db (non-flash)\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a04733-19fb-4c45-88c1-2530787d5d20 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209c684f-2d87-48d9-8910-ccb78895b9db (non-flash)
Apr 11 16:27:02 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a04733-19fb-4c45-88c1-2530787d5d20 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209c684f-2d87-48d9-8910-ccb78895b9db (non-flash)
Apr 11 16:27:02 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a04733-19fb-4c45-88c1-2530787d5d20 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb5c3b0790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:209c684f-2d87-48d9-8910-ccb78895b9db'): ({'sdb'}, set())}) {{(pid=71229) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-99a04733-19fb-4c45-88c1-2530787d5d20 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Removing single pathed devices sdb {{(pid=71229) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96f7aff-588f-442d-94ae-3c8df3667e6a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[943b8b54-68ec-4ccb-9c1c-8cde2067928e]: (4, ('ok\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-99a04733-19fb-4c45-88c1-2530787d5d20 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Flushing IO for device /dev/sdb {{(pid=71229) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[abbf5ca4-10fb-4ea2-8189-8a12a52a0076]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-99a04733-19fb-4c45-88c1-2530787d5d20 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71229) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d2c7e3-25ea-4a1e-b44e-07b701459c4b]: (4, ('1', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-99a04733-19fb-4c45-88c1-2530787d5d20 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG os_brick.initiator.linuxscsi [None req-99a04733-19fb-4c45-88c1-2530787d5d20 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] SCSI volumes sdb have been removed. {{(pid=71229) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a04733-19fb-4c45-88c1-2530787d5d20 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:209c684f-2d87-48d9-8910-ccb78895b9db')] {{(pid=71229) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:209c684f-2d87-48d9-8910-ccb78895b9db -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:209c684f-2d87-48d9-8910-ccb78895b9db -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae68059a-1307-4d77-a0f6-9d1c7a8114f6]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a04733-19fb-4c45-88c1-2530787d5d20 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:209c684f-2d87-48d9-8910-ccb78895b9db -p 172.16.0.220:3260 --logout {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:209c684f-2d87-48d9-8910-ccb78895b9db -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe1dcc5-983d-4668-b348-0e0c4222c692]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:209c684f-2d87-48d9-8910-ccb78895b9db, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:209c684f-2d87-48d9-8910-ccb78895b9db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a04733-19fb-4c45-88c1-2530787d5d20 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:209c684f-2d87-48d9-8910-ccb78895b9db, portal: 172.16.0.220,3260]
Apr 11 16:27:02 user nova-compute[71229]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:209c684f-2d87-48d9-8910-ccb78895b9db, portal: 172.16.0.220,3260] successful.
Apr 11 16:27:02 user nova-compute[71229]:  stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:209c684f-2d87-48d9-8910-ccb78895b9db -p 172.16.0.220:3260 --op delete {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:209c684f-2d87-48d9-8910-ccb78895b9db -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[900df60f-9521-47c1-a776-b1eda70174ae]: (4, ('', '')) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a04733-19fb-4c45-88c1-2530787d5d20 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71229) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-99a04733-19fb-4c45-88c1-2530787d5d20 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-99a04733-19fb-4c45-88c1-2530787d5d20 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] <== disconnect_volume: return (301ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99a04733-19fb-4c45-88c1-2530787d5d20 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 16:27:02 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:27:03 user nova-compute[71229]: DEBUG nova.objects.instance [None req-99a04733-19fb-4c45-88c1-2530787d5d20 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lazy-loading 'flavor' on Instance uuid ae79fdab-2a0d-4dac-bcde-ac3544aca749 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:27:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-99a04733-19fb-4c45-88c1-2530787d5d20 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ae79fdab-2a0d-4dac-bcde-ac3544aca749" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.656s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:27:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-938962ab-702c-41c8-b6a7-8ff402f16836 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ae79fdab-2a0d-4dac-bcde-ac3544aca749" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.530s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:27:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-938962ab-702c-41c8-b6a7-8ff402f16836 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "ae79fdab-2a0d-4dac-bcde-ac3544aca749-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:27:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-938962ab-702c-41c8-b6a7-8ff402f16836 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ae79fdab-2a0d-4dac-bcde-ac3544aca749-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:27:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-938962ab-702c-41c8-b6a7-8ff402f16836 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ae79fdab-2a0d-4dac-bcde-ac3544aca749-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:27:03 user nova-compute[71229]: INFO nova.compute.manager [None req-938962ab-702c-41c8-b6a7-8ff402f16836 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Terminating instance
Apr 11 16:27:03 user nova-compute[71229]: DEBUG nova.compute.manager [None req-938962ab-702c-41c8-b6a7-8ff402f16836 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Start destroying the instance on the hypervisor. {{(pid=71229) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 16:27:03 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:27:03 user nova-compute[71229]: DEBUG nova.compute.manager [req-811c8f45-fd04-4d85-a210-a0ee2a2dc022 req-05e19117-174f-47a4-8b3e-e76a845403a7 service nova] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Received event network-vif-unplugged-5304223b-a94f-43cc-b3cd-2f6f6b33ac7c {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:27:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-811c8f45-fd04-4d85-a210-a0ee2a2dc022 req-05e19117-174f-47a4-8b3e-e76a845403a7 service nova] Acquiring lock "ae79fdab-2a0d-4dac-bcde-ac3544aca749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:27:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-811c8f45-fd04-4d85-a210-a0ee2a2dc022 req-05e19117-174f-47a4-8b3e-e76a845403a7 service nova] Lock "ae79fdab-2a0d-4dac-bcde-ac3544aca749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:27:03 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-811c8f45-fd04-4d85-a210-a0ee2a2dc022 req-05e19117-174f-47a4-8b3e-e76a845403a7 service nova] Lock "ae79fdab-2a0d-4dac-bcde-ac3544aca749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:27:03 user nova-compute[71229]: DEBUG nova.compute.manager [req-811c8f45-fd04-4d85-a210-a0ee2a2dc022 req-05e19117-174f-47a4-8b3e-e76a845403a7 service nova] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] No waiting events found dispatching network-vif-unplugged-5304223b-a94f-43cc-b3cd-2f6f6b33ac7c {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 16:27:03 user nova-compute[71229]: DEBUG nova.compute.manager [req-811c8f45-fd04-4d85-a210-a0ee2a2dc022 req-05e19117-174f-47a4-8b3e-e76a845403a7 service nova] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Received event network-vif-unplugged-5304223b-a94f-43cc-b3cd-2f6f6b33ac7c for instance with task_state deleting. {{(pid=71229) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 16:27:03 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:27:04 user nova-compute[71229]: INFO nova.virt.libvirt.driver [-] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Instance destroyed successfully.
Apr 11 16:27:04 user nova-compute[71229]: DEBUG nova.objects.instance [None req-938962ab-702c-41c8-b6a7-8ff402f16836 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lazy-loading 'resources' on Instance uuid ae79fdab-2a0d-4dac-bcde-ac3544aca749 {{(pid=71229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 16:27:04 user nova-compute[71229]: DEBUG nova.virt.libvirt.vif [None req-938962ab-702c-41c8-b6a7-8ff402f16836 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T16:24:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2045943056',display_name='tempest-VolumesSnapshotTestJSON-instance-2045943056',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2045943056',id=47,image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T16:25:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='09bb61cdc7fa4b64baf6e8ef8b1e7815',ramdisk_id='',reservation_id='r-ppky32ol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='52fe638c-5ada-47d5-b376-233bfa808a37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1487607345',owner_user_name='tempest-VolumesSnapshotTestJSON-1487607345-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T16:25:05Z,user_data=None,user_id='341892e1cf424bc18b4b21b261659456',uuid=ae79fdab-2a0d-4dac-bcde-ac3544aca749,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5304223b-a94f-43cc-b3cd-2f6f6b33ac7c", "address": "fa:16:3e:e5:a2:5e", "network": {"id": "52b232a4-075e-4b10-ba25-3e80eb1a06cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-653846895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "09bb61cdc7fa4b64baf6e8ef8b1e7815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5304223b-a9", "ovs_interfaceid": "5304223b-a94f-43cc-b3cd-2f6f6b33ac7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 16:27:04 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-938962ab-702c-41c8-b6a7-8ff402f16836 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Converting VIF {"id": "5304223b-a94f-43cc-b3cd-2f6f6b33ac7c", "address": "fa:16:3e:e5:a2:5e", "network": {"id": "52b232a4-075e-4b10-ba25-3e80eb1a06cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-653846895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "09bb61cdc7fa4b64baf6e8ef8b1e7815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5304223b-a9", "ovs_interfaceid": "5304223b-a94f-43cc-b3cd-2f6f6b33ac7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 16:27:04 user nova-compute[71229]: DEBUG nova.network.os_vif_util [None req-938962ab-702c-41c8-b6a7-8ff402f16836 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:a2:5e,bridge_name='br-int',has_traffic_filtering=True,id=5304223b-a94f-43cc-b3cd-2f6f6b33ac7c,network=Network(52b232a4-075e-4b10-ba25-3e80eb1a06cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5304223b-a9') {{(pid=71229) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 16:27:04 user nova-compute[71229]: DEBUG os_vif [None req-938962ab-702c-41c8-b6a7-8ff402f16836 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:a2:5e,bridge_name='br-int',has_traffic_filtering=True,id=5304223b-a94f-43cc-b3cd-2f6f6b33ac7c,network=Network(52b232a4-075e-4b10-ba25-3e80eb1a06cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5304223b-a9') {{(pid=71229) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 16:27:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:27:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5304223b-a9, bridge=br-int, if_exists=True) {{(pid=71229) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 16:27:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:27:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:27:04 user nova-compute[71229]: INFO os_vif [None req-938962ab-702c-41c8-b6a7-8ff402f16836 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:a2:5e,bridge_name='br-int',has_traffic_filtering=True,id=5304223b-a94f-43cc-b3cd-2f6f6b33ac7c,network=Network(52b232a4-075e-4b10-ba25-3e80eb1a06cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5304223b-a9')
Apr 11 16:27:04 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-938962ab-702c-41c8-b6a7-8ff402f16836 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] calling os-brick to detach iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 16:27:04 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-938962ab-702c-41c8-b6a7-8ff402f16836 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb5c2a5660>, {'target_iqn': 'iqn.2010-10.org.openstack:209c684f-2d87-48d9-8910-ccb78895b9db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rognusiK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 16:27:04 user nova-compute[71229]: WARNING os_brick.initiator.connectors.base [None req-938962ab-702c-41c8-b6a7-8ff402f16836 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 16:27:04 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-938962ab-702c-41c8-b6a7-8ff402f16836 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 16:27:04 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-938962ab-702c-41c8-b6a7-8ff402f16836 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 16:27:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:27:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.017s {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:27:04 user nova-compute[71229]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=81310) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 16:27:04 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[3f2511c8-d0e5-4f82-8904-1065976cd84e]: Unexpected error while running command.
Apr 11 16:27:04 user nova-compute[71229]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 11 16:27:04 user nova-compute[71229]: Exit code: 21
Apr 11 16:27:04 user nova-compute[71229]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 11 16:27:04 user nova-compute[71229]: Stderr: '' {{(pid=81310) _process_cmd /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:479}}
Apr 11 16:27:04 user nova-compute[71229]: Traceback (most recent call last):
Apr 11 16:27:04 user nova-compute[71229]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 476, in _process_cmd
Apr 11 16:27:04 user nova-compute[71229]:     ret = func(*f_args, **f_kwargs)
Apr 11 16:27:04 user nova-compute[71229]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Apr 11 16:27:04 user nova-compute[71229]:     return func(*args, **kwargs)
Apr 11 16:27:04 user nova-compute[71229]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Apr 11 16:27:04 user nova-compute[71229]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Apr 11 16:27:04 user nova-compute[71229]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Apr 11 16:27:04 user nova-compute[71229]:     return putils.execute(on_execute=on_execute,
Apr 11 16:27:04 user nova-compute[71229]:   File "/usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py", line 438, in execute
Apr 11 16:27:04 user nova-compute[71229]:     raise ProcessExecutionError(exit_code=_returncode,
Apr 11 16:27:04 user nova-compute[71229]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 11 16:27:04 user nova-compute[71229]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 11 16:27:04 user nova-compute[71229]: Exit code: 21
Apr 11 16:27:04 user nova-compute[71229]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 11 16:27:04 user nova-compute[71229]: Stderr: ''
Apr 11 16:27:04 user nova-compute[71229]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2511c8-d0e5-4f82-8904-1065976cd84e]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=81310) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 16:27:04 user nova-compute[71229]: ERROR os_brick.initiator.connectors.iscsi [None req-938962ab-702c-41c8-b6a7-8ff402f16836 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 11 16:27:04 user nova-compute[71229]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 11 16:27:04 user nova-compute[71229]: Exit code: 21
Apr 11 16:27:04 user nova-compute[71229]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 11 16:27:04 user nova-compute[71229]: Stderr: ''
Apr 11 16:27:04 user nova-compute[71229]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Apr 11 16:27:04 user nova-compute[71229]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 206, in _get_ips_iqns_luns
Apr 11 16:27:04 user nova-compute[71229]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Apr 11 16:27:04 user nova-compute[71229]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 365, in _get_discoverydb_portals
Apr 11 16:27:04 user nova-compute[71229]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Apr 11 16:27:04 user nova-compute[71229]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 1177, in _run_iscsiadm_bare
Apr 11 16:27:04 user nova-compute[71229]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Apr 11 16:27:04 user nova-compute[71229]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/executor.py", line 55, in _execute
Apr 11 16:27:04 user nova-compute[71229]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Apr 11 16:27:04 user nova-compute[71229]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Apr 11 16:27:04 user nova-compute[71229]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Apr 11 16:27:04 user nova-compute[71229]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Apr 11 16:27:04 user nova-compute[71229]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Apr 11 16:27:04 user nova-compute[71229]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 215, in remote_call
Apr 11 16:27:04 user nova-compute[71229]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Apr 11 16:27:04 user nova-compute[71229]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 11 16:27:04 user nova-compute[71229]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Apr 11 16:27:04 user nova-compute[71229]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Apr 11 16:27:04 user nova-compute[71229]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 11 16:27:04 user nova-compute[71229]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Apr 11 16:27:04 user nova-compute[71229]: ERROR os_brick.initiator.connectors.iscsi 
Apr 11 16:27:04 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-938962ab-702c-41c8-b6a7-8ff402f16836 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=71229) _cleanup_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:923}}
Apr 11 16:27:04 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.base [None req-938962ab-702c-41c8-b6a7-8ff402f16836 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.023s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 16:27:04 user nova-compute[71229]: DEBUG os_brick.initiator.connectors.iscsi [None req-938962ab-702c-41c8-b6a7-8ff402f16836 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] <== disconnect_volume: return (24ms) None {{(pid=71229) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 16:27:04 user nova-compute[71229]: DEBUG nova.virt.libvirt.volume.iscsi [None req-938962ab-702c-41c8-b6a7-8ff402f16836 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Disconnected iSCSI Volume {{(pid=71229) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 16:27:04 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-938962ab-702c-41c8-b6a7-8ff402f16836 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Deleting instance files /opt/stack/data/nova/instances/ae79fdab-2a0d-4dac-bcde-ac3544aca749_del
Apr 11 16:27:04 user nova-compute[71229]: INFO nova.virt.libvirt.driver [None req-938962ab-702c-41c8-b6a7-8ff402f16836 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Deletion of /opt/stack/data/nova/instances/ae79fdab-2a0d-4dac-bcde-ac3544aca749_del complete
Apr 11 16:27:04 user nova-compute[71229]: INFO nova.compute.manager [None req-938962ab-702c-41c8-b6a7-8ff402f16836 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 11 16:27:04 user nova-compute[71229]: DEBUG oslo.service.loopingcall [None req-938962ab-702c-41c8-b6a7-8ff402f16836 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71229) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 16:27:04 user nova-compute[71229]: DEBUG nova.compute.manager [-] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Deallocating network for instance {{(pid=71229) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 16:27:04 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] deallocate_for_instance() {{(pid=71229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 16:27:04 user nova-compute[71229]: DEBUG nova.network.neutron [-] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Updating instance_info_cache with network_info: [] {{(pid=71229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 16:27:04 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Took 0.48 seconds to deallocate network for instance.
Apr 11 16:27:04 user nova-compute[71229]: WARNING nova.volume.cinder [None req-938962ab-702c-41c8-b6a7-8ff402f16836 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Attachment e075ff15-866e-4e41-9f10-5b938da8e1e0 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = e075ff15-866e-4e41-9f10-5b938da8e1e0. (HTTP 404) (Request-ID: req-988ce271-e653-4626-8437-016baefd9a7e)
Apr 11 16:27:04 user nova-compute[71229]: INFO nova.compute.manager [None req-938962ab-702c-41c8-b6a7-8ff402f16836 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Took 0.02 seconds to detach 1 volumes for instance.
Apr 11 16:27:04 user nova-compute[71229]: DEBUG nova.compute.manager [req-d1489211-7779-4e5a-ad4b-e1ab732684db req-ec2b92b7-e29b-410d-9b5d-1c540e16b12b service nova] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Received event network-vif-deleted-5304223b-a94f-43cc-b3cd-2f6f6b33ac7c {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:27:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-938962ab-702c-41c8-b6a7-8ff402f16836 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:27:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-938962ab-702c-41c8-b6a7-8ff402f16836 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:27:04 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-938962ab-702c-41c8-b6a7-8ff402f16836 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 16:27:04 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-938962ab-702c-41c8-b6a7-8ff402f16836 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 16:27:04 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-938962ab-702c-41c8-b6a7-8ff402f16836 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.116s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:27:05 user nova-compute[71229]: INFO nova.scheduler.client.report [None req-938962ab-702c-41c8-b6a7-8ff402f16836 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Deleted allocations for instance ae79fdab-2a0d-4dac-bcde-ac3544aca749
Apr 11 16:27:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-938962ab-702c-41c8-b6a7-8ff402f16836 tempest-VolumesSnapshotTestJSON-1487607345 tempest-VolumesSnapshotTestJSON-1487607345-project-member] Lock "ae79fdab-2a0d-4dac-bcde-ac3544aca749" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.683s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:27:05 user nova-compute[71229]: DEBUG nova.compute.manager [req-d088a90f-b759-4100-bc88-6ca91f0350d8 req-9131a037-1d7c-400f-88a3-4201d4ce715b service nova] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Received event network-vif-plugged-5304223b-a94f-43cc-b3cd-2f6f6b33ac7c {{(pid=71229) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 16:27:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-d088a90f-b759-4100-bc88-6ca91f0350d8 req-9131a037-1d7c-400f-88a3-4201d4ce715b service nova] Acquiring lock "ae79fdab-2a0d-4dac-bcde-ac3544aca749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:27:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-d088a90f-b759-4100-bc88-6ca91f0350d8 req-9131a037-1d7c-400f-88a3-4201d4ce715b service nova] Lock "ae79fdab-2a0d-4dac-bcde-ac3544aca749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:27:05 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [req-d088a90f-b759-4100-bc88-6ca91f0350d8 req-9131a037-1d7c-400f-88a3-4201d4ce715b service nova] Lock "ae79fdab-2a0d-4dac-bcde-ac3544aca749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:27:05 user nova-compute[71229]: DEBUG nova.compute.manager [req-d088a90f-b759-4100-bc88-6ca91f0350d8 req-9131a037-1d7c-400f-88a3-4201d4ce715b service nova] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] No waiting events found dispatching network-vif-plugged-5304223b-a94f-43cc-b3cd-2f6f6b33ac7c {{(pid=71229) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 16:27:05 user nova-compute[71229]: WARNING nova.compute.manager [req-d088a90f-b759-4100-bc88-6ca91f0350d8 req-9131a037-1d7c-400f-88a3-4201d4ce715b service nova] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Received unexpected event network-vif-plugged-5304223b-a94f-43cc-b3cd-2f6f6b33ac7c for instance with vm_state deleted and task_state None.
Apr 11 16:27:09 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:27:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:27:19 user nova-compute[71229]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681230424.161073, ae79fdab-2a0d-4dac-bcde-ac3544aca749 => Stopped> {{(pid=71229) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 16:27:19 user nova-compute[71229]: INFO nova.compute.manager [-] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] VM Stopped (Lifecycle Event)
Apr 11 16:27:19 user nova-compute[71229]: DEBUG nova.compute.manager [None req-2cd36875-b2b9-4085-a48a-66d9b94a5e0d None None] [instance: ae79fdab-2a0d-4dac-bcde-ac3544aca749] Checking state {{(pid=71229) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 16:27:19 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:27:24 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:27:29 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:27:34 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:27:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:27:44 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:27:46 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:27:46 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71229) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 16:27:47 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:27:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:27:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:27:47 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:27:47 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Auditing locally available compute resources for user (node: user) {{(pid=71229) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 16:27:48 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:27:48 user nova-compute[71229]: WARNING nova.virt.libvirt.driver [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:27:48 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Hypervisor/Node resource view: name=user free_ram=8912MB free_disk=25.94573974609375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71229) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 16:27:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:27:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:27:48 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 16:27:48 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71229) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 16:27:48 user nova-compute[71229]: DEBUG nova.compute.provider_tree [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed in ProviderTree for provider: 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de {{(pid=71229) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 16:27:48 user nova-compute[71229]: DEBUG nova.scheduler.client.report [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Inventory has not changed for provider 116bdb33-5cbe-4ccb-b8e2-ae91b60ed1de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71229) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 16:27:48 user nova-compute[71229]: DEBUG nova.compute.resource_tracker [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Compute_service record updated for user:user {{(pid=71229) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 16:27:48 user nova-compute[71229]: DEBUG oslo_concurrency.lockutils [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.157s {{(pid=71229) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:27:49 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:27:50 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:27:50 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Starting heal instance info cache {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 16:27:50 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Rebuilding the list of instances to heal {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 16:27:50 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Didn't find any instances for network info cache update. {{(pid=71229) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 16:27:54 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:27:54 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:27:54 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Cleaning up deleted instances {{(pid=71229) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 16:27:54 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] There are 0 instances to clean {{(pid=71229) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 16:27:55 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:27:55 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:27:56 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:27:57 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:27:59 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 16:28:00 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:28:02 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:28:04 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:28:08 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:28:09 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:28:09 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:28:14 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:28:16 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:28:19 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:28:22 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:28:24 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:28:29 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:28:31 user nova-compute[71229]: DEBUG oslo_service.periodic_task [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71229) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:28:31 user nova-compute[71229]: DEBUG nova.compute.manager [None req-73d7392e-44d1-4dd9-8acc-6787fe948e90 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71229) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 16:28:34 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 16:28:39 user nova-compute[71229]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71229) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}